You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Tao Xiao <xi...@gmail.com> on 2014/05/20 05:22:44 UTC

How to start one nodemanager in HDP 2.0.6 ?

I'm using Hortonworks HDP 2.0.6. One of the nodes reboots and I want to
start nodemanager manually on that node, but the command
"/usr/lib/hadoop-yarn/sbin/yarn-daemon.sh
start nodemanager" complains the following:

/usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 44:
/usr/lib/hadoop-yarn/sbin/../libexec/yarn-config.sh: No such file or
directory
mkdir: cannot create directory `/logs': Permission denied
chown: cannot access `/logs': No such file or directory
starting nodemanager, logging to
/logs/yarn-hadoop-nodemanager-a04.jsepc.com.out
/usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 124:
/logs/yarn-hadoop-nodemanager-a04.jsepc.com.out: No such file or directory
head: cannot open `/logs/yarn-hadoop-nodemanager-a04.jsepc.com.out' for
reading: No such file or directory
/usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 129:
/logs/yarn-hadoop-nodemanager-a04.jsepc.com.out: No such file or directory
/usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 130:
/logs/yarn-hadoop-nodemanager-a04.jsepc.com.out: No such file or directory


I suppose that is caused by configuration-related issues (
/usr/lib/hadoop-yarn/sbin/../libexec/yarn-config.sh:
No such file or directory). So how should I start a nodemanager manually ?

Re: How to start one nodemanager in HDP 2.0.6 ?

Posted by Tao Xiao <xi...@gmail.com>.
I have noticed this problem and changed from user *hadoop *to *root*, there
is no error like "mkdir: cannot create directory `/logs': Permission denied",
yet errors like "mkdir: cannot create directory `/logs': Permission denied"
and "nice: /bin/yarn: No such file or directory" appear on the console.

 I tried to search for environment variables like $HADOOP_YARN_HOME by "set
| grep HADOOP | grep HOME" ,  "set | grep YARN | grep HOME"  and "set |
grep HADOOP | grep YARN", however there is no result.


2014-05-20 11:40 GMT+08:00 Shengjun Xin <sx...@gopivotal.com>:

> Did you configure the environment variables, such as $HADOOP_YARN_HOME?
>
>
> On Tue, May 20, 2014 at 11:32 AM, Ted Yu <yu...@gmail.com> wrote:
>
>> Which user did you use for the yarn-daemon.sh command ?
>>
>> See the following:
>>
>> bq. mkdir: cannot create directory `/logs': Permission denied
>>
>> Cheers
>>
>>
>> On Mon, May 19, 2014 at 8:22 PM, Tao Xiao <xi...@gmail.com>wrote:
>>
>>> I'm using Hortonworks HDP 2.0.6. One of the nodes reboots and I want to
>>> start nodemanager manually on that node, but the command "/usr/lib/hadoop-yarn/sbin/yarn-daemon.sh
>>> start nodemanager" complains the following:
>>>
>>> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 44:
>>> /usr/lib/hadoop-yarn/sbin/../libexec/yarn-config.sh: No such file or
>>> directory
>>> mkdir: cannot create directory `/logs': Permission denied
>>> chown: cannot access `/logs': No such file or directory
>>> starting nodemanager, logging to
>>> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out
>>> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 124:
>>> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out: No such file or directory
>>> head: cannot open `/logs/yarn-hadoop-nodemanager-a04.jsepc.com.out' for
>>> reading: No such file or directory
>>> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 129:
>>> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out: No such file or directory
>>> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 130:
>>> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out: No such file or directory
>>>
>>>
>>> I suppose that is caused by configuration-related issues ( /usr/lib/hadoop-yarn/sbin/../libexec/yarn-config.sh:
>>> No such file or directory). So how should I start a nodemanager
>>> manually ?
>>>
>>>
>>>
>>
>
>
> --
> Regards
> Shengjun
>

Re: How to start one nodemanager in HDP 2.0.6 ?

Posted by Tao Xiao <xi...@gmail.com>.
I have noticed this problem and changed from user *hadoop *to *root*, there
is no error like "mkdir: cannot create directory `/logs': Permission denied",
yet errors like "mkdir: cannot create directory `/logs': Permission denied"
and "nice: /bin/yarn: No such file or directory" appear on the console.

 I tried to search for environment variables like $HADOOP_YARN_HOME by "set
| grep HADOOP | grep HOME" ,  "set | grep YARN | grep HOME"  and "set |
grep HADOOP | grep YARN", however there is no result.


2014-05-20 11:40 GMT+08:00 Shengjun Xin <sx...@gopivotal.com>:

> Did you configure the environment variables, such as $HADOOP_YARN_HOME?
>
>
> On Tue, May 20, 2014 at 11:32 AM, Ted Yu <yu...@gmail.com> wrote:
>
>> Which user did you use for the yarn-daemon.sh command ?
>>
>> See the following:
>>
>> bq. mkdir: cannot create directory `/logs': Permission denied
>>
>> Cheers
>>
>>
>> On Mon, May 19, 2014 at 8:22 PM, Tao Xiao <xi...@gmail.com>wrote:
>>
>>> I'm using Hortonworks HDP 2.0.6. One of the nodes reboots and I want to
>>> start nodemanager manually on that node, but the command "/usr/lib/hadoop-yarn/sbin/yarn-daemon.sh
>>> start nodemanager" complains the following:
>>>
>>> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 44:
>>> /usr/lib/hadoop-yarn/sbin/../libexec/yarn-config.sh: No such file or
>>> directory
>>> mkdir: cannot create directory `/logs': Permission denied
>>> chown: cannot access `/logs': No such file or directory
>>> starting nodemanager, logging to
>>> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out
>>> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 124:
>>> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out: No such file or directory
>>> head: cannot open `/logs/yarn-hadoop-nodemanager-a04.jsepc.com.out' for
>>> reading: No such file or directory
>>> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 129:
>>> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out: No such file or directory
>>> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 130:
>>> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out: No such file or directory
>>>
>>>
>>> I suppose that is caused by configuration-related issues ( /usr/lib/hadoop-yarn/sbin/../libexec/yarn-config.sh:
>>> No such file or directory). So how should I start a nodemanager
>>> manually ?
>>>
>>>
>>>
>>
>
>
> --
> Regards
> Shengjun
>

Re: How to start one nodemanager in HDP 2.0.6 ?

Posted by Tao Xiao <xi...@gmail.com>.
I have noticed this problem and changed from user *hadoop *to *root*, there
is no error like "mkdir: cannot create directory `/logs': Permission denied",
yet errors like "mkdir: cannot create directory `/logs': Permission denied"
and "nice: /bin/yarn: No such file or directory" appear on the console.

 I tried to search for environment variables like $HADOOP_YARN_HOME by "set
| grep HADOOP | grep HOME" ,  "set | grep YARN | grep HOME"  and "set |
grep HADOOP | grep YARN", however there is no result.


2014-05-20 11:40 GMT+08:00 Shengjun Xin <sx...@gopivotal.com>:

> Did you configure the environment variables, such as $HADOOP_YARN_HOME?
>
>
> On Tue, May 20, 2014 at 11:32 AM, Ted Yu <yu...@gmail.com> wrote:
>
>> Which user did you use for the yarn-daemon.sh command ?
>>
>> See the following:
>>
>> bq. mkdir: cannot create directory `/logs': Permission denied
>>
>> Cheers
>>
>>
>> On Mon, May 19, 2014 at 8:22 PM, Tao Xiao <xi...@gmail.com>wrote:
>>
>>> I'm using Hortonworks HDP 2.0.6. One of the nodes reboots and I want to
>>> start nodemanager manually on that node, but the command "/usr/lib/hadoop-yarn/sbin/yarn-daemon.sh
>>> start nodemanager" complains the following:
>>>
>>> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 44:
>>> /usr/lib/hadoop-yarn/sbin/../libexec/yarn-config.sh: No such file or
>>> directory
>>> mkdir: cannot create directory `/logs': Permission denied
>>> chown: cannot access `/logs': No such file or directory
>>> starting nodemanager, logging to
>>> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out
>>> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 124:
>>> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out: No such file or directory
>>> head: cannot open `/logs/yarn-hadoop-nodemanager-a04.jsepc.com.out' for
>>> reading: No such file or directory
>>> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 129:
>>> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out: No such file or directory
>>> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 130:
>>> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out: No such file or directory
>>>
>>>
>>> I suppose that is caused by configuration-related issues ( /usr/lib/hadoop-yarn/sbin/../libexec/yarn-config.sh:
>>> No such file or directory). So how should I start a nodemanager
>>> manually ?
>>>
>>>
>>>
>>
>
>
> --
> Regards
> Shengjun
>

Re: How to start one nodemanager in HDP 2.0.6 ?

Posted by Tao Xiao <xi...@gmail.com>.
I have noticed this problem and changed from user *hadoop *to *root*, there
is no error like "mkdir: cannot create directory `/logs': Permission denied",
yet errors like "mkdir: cannot create directory `/logs': Permission denied"
and "nice: /bin/yarn: No such file or directory" appear on the console.

 I tried to search for environment variables like $HADOOP_YARN_HOME by "set
| grep HADOOP | grep HOME" ,  "set | grep YARN | grep HOME"  and "set |
grep HADOOP | grep YARN", however there is no result.


2014-05-20 11:40 GMT+08:00 Shengjun Xin <sx...@gopivotal.com>:

> Did you configure the environment variables, such as $HADOOP_YARN_HOME?
>
>
> On Tue, May 20, 2014 at 11:32 AM, Ted Yu <yu...@gmail.com> wrote:
>
>> Which user did you use for the yarn-daemon.sh command ?
>>
>> See the following:
>>
>> bq. mkdir: cannot create directory `/logs': Permission denied
>>
>> Cheers
>>
>>
>> On Mon, May 19, 2014 at 8:22 PM, Tao Xiao <xi...@gmail.com>wrote:
>>
>>> I'm using Hortonworks HDP 2.0.6. One of the nodes reboots and I want to
>>> start nodemanager manually on that node, but the command "/usr/lib/hadoop-yarn/sbin/yarn-daemon.sh
>>> start nodemanager" complains the following:
>>>
>>> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 44:
>>> /usr/lib/hadoop-yarn/sbin/../libexec/yarn-config.sh: No such file or
>>> directory
>>> mkdir: cannot create directory `/logs': Permission denied
>>> chown: cannot access `/logs': No such file or directory
>>> starting nodemanager, logging to
>>> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out
>>> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 124:
>>> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out: No such file or directory
>>> head: cannot open `/logs/yarn-hadoop-nodemanager-a04.jsepc.com.out' for
>>> reading: No such file or directory
>>> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 129:
>>> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out: No such file or directory
>>> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 130:
>>> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out: No such file or directory
>>>
>>>
>>> I suppose that is caused by configuration-related issues ( /usr/lib/hadoop-yarn/sbin/../libexec/yarn-config.sh:
>>> No such file or directory). So how should I start a nodemanager
>>> manually ?
>>>
>>>
>>>
>>
>
>
> --
> Regards
> Shengjun
>

Re: How to start one nodemanager in HDP 2.0.6 ?

Posted by Shengjun Xin <sx...@gopivotal.com>.
Did you configure the environment variables, such as $HADOOP_YARN_HOME?


On Tue, May 20, 2014 at 11:32 AM, Ted Yu <yu...@gmail.com> wrote:

> Which user did you use for the yarn-daemon.sh command ?
>
> See the following:
>
> bq. mkdir: cannot create directory `/logs': Permission denied
>
> Cheers
>
>
> On Mon, May 19, 2014 at 8:22 PM, Tao Xiao <xi...@gmail.com>wrote:
>
>> I'm using Hortonworks HDP 2.0.6. One of the nodes reboots and I want to
>> start nodemanager manually on that node, but the command "/usr/lib/hadoop-yarn/sbin/yarn-daemon.sh
>> start nodemanager" complains the following:
>>
>> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 44:
>> /usr/lib/hadoop-yarn/sbin/../libexec/yarn-config.sh: No such file or
>> directory
>> mkdir: cannot create directory `/logs': Permission denied
>> chown: cannot access `/logs': No such file or directory
>> starting nodemanager, logging to
>> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out
>> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 124:
>> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out: No such file or directory
>> head: cannot open `/logs/yarn-hadoop-nodemanager-a04.jsepc.com.out' for
>> reading: No such file or directory
>> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 129:
>> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out: No such file or directory
>> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 130:
>> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out: No such file or directory
>>
>>
>> I suppose that is caused by configuration-related issues ( /usr/lib/hadoop-yarn/sbin/../libexec/yarn-config.sh:
>> No such file or directory). So how should I start a nodemanager manually
>> ?
>>
>>
>>
>


-- 
Regards
Shengjun

Re: How to start one nodemanager in HDP 2.0.6 ?

Posted by Shengjun Xin <sx...@gopivotal.com>.
Did you configure the environment variables, such as $HADOOP_YARN_HOME?


On Tue, May 20, 2014 at 11:32 AM, Ted Yu <yu...@gmail.com> wrote:

> Which user did you use for the yarn-daemon.sh command ?
>
> See the following:
>
> bq. mkdir: cannot create directory `/logs': Permission denied
>
> Cheers
>
>
> On Mon, May 19, 2014 at 8:22 PM, Tao Xiao <xi...@gmail.com>wrote:
>
>> I'm using Hortonworks HDP 2.0.6. One of the nodes reboots and I want to
>> start nodemanager manually on that node, but the command "/usr/lib/hadoop-yarn/sbin/yarn-daemon.sh
>> start nodemanager" complains the following:
>>
>> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 44:
>> /usr/lib/hadoop-yarn/sbin/../libexec/yarn-config.sh: No such file or
>> directory
>> mkdir: cannot create directory `/logs': Permission denied
>> chown: cannot access `/logs': No such file or directory
>> starting nodemanager, logging to
>> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out
>> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 124:
>> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out: No such file or directory
>> head: cannot open `/logs/yarn-hadoop-nodemanager-a04.jsepc.com.out' for
>> reading: No such file or directory
>> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 129:
>> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out: No such file or directory
>> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 130:
>> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out: No such file or directory
>>
>>
>> I suppose that is caused by configuration-related issues ( /usr/lib/hadoop-yarn/sbin/../libexec/yarn-config.sh:
>> No such file or directory). So how should I start a nodemanager manually
>> ?
>>
>>
>>
>


-- 
Regards
Shengjun

Re: How to start one nodemanager in HDP 2.0.6 ?

Posted by Shengjun Xin <sx...@gopivotal.com>.
Did you configure the environment variables, such as $HADOOP_YARN_HOME?


On Tue, May 20, 2014 at 11:32 AM, Ted Yu <yu...@gmail.com> wrote:

> Which user did you use for the yarn-daemon.sh command ?
>
> See the following:
>
> bq. mkdir: cannot create directory `/logs': Permission denied
>
> Cheers
>
>
> On Mon, May 19, 2014 at 8:22 PM, Tao Xiao <xi...@gmail.com>wrote:
>
>> I'm using Hortonworks HDP 2.0.6. One of the nodes reboots and I want to
>> start nodemanager manually on that node, but the command "/usr/lib/hadoop-yarn/sbin/yarn-daemon.sh
>> start nodemanager" complains the following:
>>
>> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 44:
>> /usr/lib/hadoop-yarn/sbin/../libexec/yarn-config.sh: No such file or
>> directory
>> mkdir: cannot create directory `/logs': Permission denied
>> chown: cannot access `/logs': No such file or directory
>> starting nodemanager, logging to
>> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out
>> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 124:
>> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out: No such file or directory
>> head: cannot open `/logs/yarn-hadoop-nodemanager-a04.jsepc.com.out' for
>> reading: No such file or directory
>> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 129:
>> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out: No such file or directory
>> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 130:
>> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out: No such file or directory
>>
>>
>> I suppose that is caused by configuration-related issues ( /usr/lib/hadoop-yarn/sbin/../libexec/yarn-config.sh:
>> No such file or directory). So how should I start a nodemanager manually
>> ?
>>
>>
>>
>


-- 
Regards
Shengjun

Re: How to start one nodemanager in HDP 2.0.6 ?

Posted by Shengjun Xin <sx...@gopivotal.com>.
Did you configure the environment variables, such as $HADOOP_YARN_HOME?


On Tue, May 20, 2014 at 11:32 AM, Ted Yu <yu...@gmail.com> wrote:

> Which user did you use for the yarn-daemon.sh command ?
>
> See the following:
>
> bq. mkdir: cannot create directory `/logs': Permission denied
>
> Cheers
>
>
> On Mon, May 19, 2014 at 8:22 PM, Tao Xiao <xi...@gmail.com>wrote:
>
>> I'm using Hortonworks HDP 2.0.6. One of the nodes reboots and I want to
>> start nodemanager manually on that node, but the command "/usr/lib/hadoop-yarn/sbin/yarn-daemon.sh
>> start nodemanager" complains the following:
>>
>> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 44:
>> /usr/lib/hadoop-yarn/sbin/../libexec/yarn-config.sh: No such file or
>> directory
>> mkdir: cannot create directory `/logs': Permission denied
>> chown: cannot access `/logs': No such file or directory
>> starting nodemanager, logging to
>> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out
>> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 124:
>> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out: No such file or directory
>> head: cannot open `/logs/yarn-hadoop-nodemanager-a04.jsepc.com.out' for
>> reading: No such file or directory
>> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 129:
>> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out: No such file or directory
>> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 130:
>> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out: No such file or directory
>>
>>
>> I suppose that is caused by configuration-related issues ( /usr/lib/hadoop-yarn/sbin/../libexec/yarn-config.sh:
>> No such file or directory). So how should I start a nodemanager manually
>> ?
>>
>>
>>
>


-- 
Regards
Shengjun

Re: How to start one nodemanager in HDP 2.0.6 ?

Posted by Ted Yu <yu...@gmail.com>.
Which user did you use for the yarn-daemon.sh command ?

See the following:

bq. mkdir: cannot create directory `/logs': Permission denied

Cheers


On Mon, May 19, 2014 at 8:22 PM, Tao Xiao <xi...@gmail.com> wrote:

> I'm using Hortonworks HDP 2.0.6. One of the nodes reboots and I want to
> start nodemanager manually on that node, but the command "/usr/lib/hadoop-yarn/sbin/yarn-daemon.sh
> start nodemanager" complains the following:
>
> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 44:
> /usr/lib/hadoop-yarn/sbin/../libexec/yarn-config.sh: No such file or
> directory
> mkdir: cannot create directory `/logs': Permission denied
> chown: cannot access `/logs': No such file or directory
> starting nodemanager, logging to
> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out
> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 124:
> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out: No such file or directory
> head: cannot open `/logs/yarn-hadoop-nodemanager-a04.jsepc.com.out' for
> reading: No such file or directory
> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 129:
> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out: No such file or directory
> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 130:
> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out: No such file or directory
>
>
> I suppose that is caused by configuration-related issues ( /usr/lib/hadoop-yarn/sbin/../libexec/yarn-config.sh:
> No such file or directory). So how should I start a nodemanager manually ?
>
>
>

Re: How to start one nodemanager in HDP 2.0.6 ?

Posted by Ted Yu <yu...@gmail.com>.
Which user did you use for the yarn-daemon.sh command ?

See the following:

bq. mkdir: cannot create directory `/logs': Permission denied

Cheers


On Mon, May 19, 2014 at 8:22 PM, Tao Xiao <xi...@gmail.com> wrote:

> I'm using Hortonworks HDP 2.0.6. One of the nodes reboots and I want to
> start nodemanager manually on that node, but the command "/usr/lib/hadoop-yarn/sbin/yarn-daemon.sh
> start nodemanager" complains the following:
>
> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 44:
> /usr/lib/hadoop-yarn/sbin/../libexec/yarn-config.sh: No such file or
> directory
> mkdir: cannot create directory `/logs': Permission denied
> chown: cannot access `/logs': No such file or directory
> starting nodemanager, logging to
> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out
> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 124:
> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out: No such file or directory
> head: cannot open `/logs/yarn-hadoop-nodemanager-a04.jsepc.com.out' for
> reading: No such file or directory
> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 129:
> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out: No such file or directory
> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 130:
> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out: No such file or directory
>
>
> I suppose that is caused by configuration-related issues ( /usr/lib/hadoop-yarn/sbin/../libexec/yarn-config.sh:
> No such file or directory). So how should I start a nodemanager manually ?
>
>
>

Re: How to start one nodemanager in HDP 2.0.6 ?

Posted by Ted Yu <yu...@gmail.com>.
Which user did you use for the yarn-daemon.sh command ?

See the following:

bq. mkdir: cannot create directory `/logs': Permission denied

Cheers


On Mon, May 19, 2014 at 8:22 PM, Tao Xiao <xi...@gmail.com> wrote:

> I'm using Hortonworks HDP 2.0.6. One of the nodes reboots and I want to
> start nodemanager manually on that node, but the command "/usr/lib/hadoop-yarn/sbin/yarn-daemon.sh
> start nodemanager" complains the following:
>
> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 44:
> /usr/lib/hadoop-yarn/sbin/../libexec/yarn-config.sh: No such file or
> directory
> mkdir: cannot create directory `/logs': Permission denied
> chown: cannot access `/logs': No such file or directory
> starting nodemanager, logging to
> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out
> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 124:
> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out: No such file or directory
> head: cannot open `/logs/yarn-hadoop-nodemanager-a04.jsepc.com.out' for
> reading: No such file or directory
> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 129:
> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out: No such file or directory
> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 130:
> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out: No such file or directory
>
>
> I suppose that is caused by configuration-related issues ( /usr/lib/hadoop-yarn/sbin/../libexec/yarn-config.sh:
> No such file or directory). So how should I start a nodemanager manually ?
>
>
>

Re: How to start one nodemanager in HDP 2.0.6 ?

Posted by Ted Yu <yu...@gmail.com>.
Which user did you use for the yarn-daemon.sh command ?

See the following:

bq. mkdir: cannot create directory `/logs': Permission denied

Cheers


On Mon, May 19, 2014 at 8:22 PM, Tao Xiao <xi...@gmail.com> wrote:

> I'm using Hortonworks HDP 2.0.6. One of the nodes reboots and I want to
> start nodemanager manually on that node, but the command "/usr/lib/hadoop-yarn/sbin/yarn-daemon.sh
> start nodemanager" complains the following:
>
> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 44:
> /usr/lib/hadoop-yarn/sbin/../libexec/yarn-config.sh: No such file or
> directory
> mkdir: cannot create directory `/logs': Permission denied
> chown: cannot access `/logs': No such file or directory
> starting nodemanager, logging to
> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out
> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 124:
> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out: No such file or directory
> head: cannot open `/logs/yarn-hadoop-nodemanager-a04.jsepc.com.out' for
> reading: No such file or directory
> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 129:
> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out: No such file or directory
> /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh: line 130:
> /logs/yarn-hadoop-nodemanager-a04.jsepc.com.out: No such file or directory
>
>
> I suppose that is caused by configuration-related issues ( /usr/lib/hadoop-yarn/sbin/../libexec/yarn-config.sh:
> No such file or directory). So how should I start a nodemanager manually ?
>
>
>