You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-user@hadoop.apache.org by ch huang <ju...@gmail.com> on 2013/08/09 04:07:47 UTC
problem about DN&NM directory design
hi,all:
i plan to put DN together with NM, i want to use 2*1TB disk , one
disk mount on /data/1 and another mount on /data/2
and i set dfs.datanode.data.dir as "/data/1/hadoopdataspace
,/data/2/hadoopdataspace",
set yarn.nodemanager.local-dirs as "/data/1/yarn/local ,/data/2/yarn/local"
,
set yarn.nodemanager.log-dirs as "/data/1/yarn/logs,/data/2/yarn/logs",
i do not kown if this plan is appropriate ,any good suggestion ,thanks all?
Re: problem about DN&NM directory design
Posted by Harsh J <ha...@cloudera.com>.
This is appropriate. You are making use of both disk mounts and have
the directories for each service isolated as well.
On Fri, Aug 9, 2013 at 7:37 AM, ch huang <ju...@gmail.com> wrote:
> hi,all:
> i plan to put DN together with NM, i want to use 2*1TB disk , one
> disk mount on /data/1 and another mount on /data/2
>
> and i set dfs.datanode.data.dir as "/data/1/hadoopdataspace
> ,/data/2/hadoopdataspace",
> set yarn.nodemanager.local-dirs as "/data/1/yarn/local ,/data/2/yarn/local"
> ,
> set yarn.nodemanager.log-dirs as "/data/1/yarn/logs,/data/2/yarn/logs",
> i do not kown if this plan is appropriate ,any good suggestion ,thanks all?
--
Harsh J
Re: problem about DN&NM directory design
Posted by Harsh J <ha...@cloudera.com>.
This is appropriate. You are making use of both disk mounts and have
the directories for each service isolated as well.
On Fri, Aug 9, 2013 at 7:37 AM, ch huang <ju...@gmail.com> wrote:
> hi,all:
> i plan to put DN together with NM, i want to use 2*1TB disk , one
> disk mount on /data/1 and another mount on /data/2
>
> and i set dfs.datanode.data.dir as "/data/1/hadoopdataspace
> ,/data/2/hadoopdataspace",
> set yarn.nodemanager.local-dirs as "/data/1/yarn/local ,/data/2/yarn/local"
> ,
> set yarn.nodemanager.log-dirs as "/data/1/yarn/logs,/data/2/yarn/logs",
> i do not kown if this plan is appropriate ,any good suggestion ,thanks all?
--
Harsh J
Re: problem about DN&NM directory design
Posted by Harsh J <ha...@cloudera.com>.
This is appropriate. You are making use of both disk mounts and have
the directories for each service isolated as well.
On Fri, Aug 9, 2013 at 7:37 AM, ch huang <ju...@gmail.com> wrote:
> hi,all:
> i plan to put DN together with NM, i want to use 2*1TB disk , one
> disk mount on /data/1 and another mount on /data/2
>
> and i set dfs.datanode.data.dir as "/data/1/hadoopdataspace
> ,/data/2/hadoopdataspace",
> set yarn.nodemanager.local-dirs as "/data/1/yarn/local ,/data/2/yarn/local"
> ,
> set yarn.nodemanager.log-dirs as "/data/1/yarn/logs,/data/2/yarn/logs",
> i do not kown if this plan is appropriate ,any good suggestion ,thanks all?
--
Harsh J
Re: problem about DN&NM directory design
Posted by Harsh J <ha...@cloudera.com>.
This is appropriate. You are making use of both disk mounts and have
the directories for each service isolated as well.
On Fri, Aug 9, 2013 at 7:37 AM, ch huang <ju...@gmail.com> wrote:
> hi,all:
> i plan to put DN together with NM, i want to use 2*1TB disk , one
> disk mount on /data/1 and another mount on /data/2
>
> and i set dfs.datanode.data.dir as "/data/1/hadoopdataspace
> ,/data/2/hadoopdataspace",
> set yarn.nodemanager.local-dirs as "/data/1/yarn/local ,/data/2/yarn/local"
> ,
> set yarn.nodemanager.log-dirs as "/data/1/yarn/logs,/data/2/yarn/logs",
> i do not kown if this plan is appropriate ,any good suggestion ,thanks all?
--
Harsh J