You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-user@hadoop.apache.org by Susheel Kumar Gadalay <sk...@gmail.com> on 2014/09/29 08:50:58 UTC
Hadoop shutdown scripts failing
How to redirect the storing of the following files from /tmp to some
other location.
hadoop-<os user>-namenode.pid
hadoop-<os user>-datanode.pid
yarn-<os user>-resourcemanager.pid
yarn-<os user>-nodemanager.pid
In /tmp, these files are cleared by OS sometime back and I am unable
to shutdown by standard scripts stop-dfs.sh or stop-yarn.sh
In core-site.xml I have given property hadoop.tmp.dir but still these
pid files are present in /tmp only,
Re: Hadoop shutdown scripts failing
Posted by Susheel Kumar Gadalay <sk...@gmail.com>.
Thanks
On 9/29/14, Aitor Cedres <ac...@pivotal.io> wrote:
> Check the file "$HADOOP_HOME/bin/yarn-daemon.sh"; there is a reference to
> YARN_PID_DIR. If it's not set. it will default to /tmp.
>
>
> On 29 September 2014 13:11, Susheel Kumar Gadalay <sk...@gmail.com>
> wrote:
>
>> Thanks Aitor.
>>
>> There is a shell variable HADOOP_PID_DIR refererred in hadoop-env.sh
>> but not in yarn-env.sh.
>>
>>
>>
>> On 9/29/14, Aitor Cedres <ac...@pivotal.io> wrote:
>> > Hi Susheel,
>> >
>> > You have to set in your hadoop-env.sh and yarn-env.sh the variabkes:
>> >
>> > - HADOOP_PID_DIR
>> > - YARN_PID_DIR
>> >
>> > To point to some other directory (most common is /var/run/hadoop-hdfs
>> > hadoop-yarn)
>> >
>> > Hope it helps,
>> > Aitor
>> >
>> > On 29 September 2014 07:50, Susheel Kumar Gadalay <sk...@gmail.com>
>> > wrote:
>> >
>> >> How to redirect the storing of the following files from /tmp to some
>> >> other location.
>> >> hadoop-<os user>-namenode.pid
>> >> hadoop-<os user>-datanode.pid
>> >> yarn-<os user>-resourcemanager.pid
>> >> yarn-<os user>-nodemanager.pid
>> >>
>> >> In /tmp, these files are cleared by OS sometime back and I am unable
>> >> to shutdown by standard scripts stop-dfs.sh or stop-yarn.sh
>> >>
>> >> In core-site.xml I have given property hadoop.tmp.dir but still these
>> >> pid files are present in /tmp only,
>> >>
>> >
>>
>
Re: Hadoop shutdown scripts failing
Posted by Susheel Kumar Gadalay <sk...@gmail.com>.
Thanks
On 9/29/14, Aitor Cedres <ac...@pivotal.io> wrote:
> Check the file "$HADOOP_HOME/bin/yarn-daemon.sh"; there is a reference to
> YARN_PID_DIR. If it's not set. it will default to /tmp.
>
>
> On 29 September 2014 13:11, Susheel Kumar Gadalay <sk...@gmail.com>
> wrote:
>
>> Thanks Aitor.
>>
>> There is a shell variable HADOOP_PID_DIR refererred in hadoop-env.sh
>> but not in yarn-env.sh.
>>
>>
>>
>> On 9/29/14, Aitor Cedres <ac...@pivotal.io> wrote:
>> > Hi Susheel,
>> >
>> > You have to set in your hadoop-env.sh and yarn-env.sh the variabkes:
>> >
>> > - HADOOP_PID_DIR
>> > - YARN_PID_DIR
>> >
>> > To point to some other directory (most common is /var/run/hadoop-hdfs
>> > hadoop-yarn)
>> >
>> > Hope it helps,
>> > Aitor
>> >
>> > On 29 September 2014 07:50, Susheel Kumar Gadalay <sk...@gmail.com>
>> > wrote:
>> >
>> >> How to redirect the storing of the following files from /tmp to some
>> >> other location.
>> >> hadoop-<os user>-namenode.pid
>> >> hadoop-<os user>-datanode.pid
>> >> yarn-<os user>-resourcemanager.pid
>> >> yarn-<os user>-nodemanager.pid
>> >>
>> >> In /tmp, these files are cleared by OS sometime back and I am unable
>> >> to shutdown by standard scripts stop-dfs.sh or stop-yarn.sh
>> >>
>> >> In core-site.xml I have given property hadoop.tmp.dir but still these
>> >> pid files are present in /tmp only,
>> >>
>> >
>>
>
Re: Hadoop shutdown scripts failing
Posted by Susheel Kumar Gadalay <sk...@gmail.com>.
Thanks
On 9/29/14, Aitor Cedres <ac...@pivotal.io> wrote:
> Check the file "$HADOOP_HOME/bin/yarn-daemon.sh"; there is a reference to
> YARN_PID_DIR. If it's not set. it will default to /tmp.
>
>
> On 29 September 2014 13:11, Susheel Kumar Gadalay <sk...@gmail.com>
> wrote:
>
>> Thanks Aitor.
>>
>> There is a shell variable HADOOP_PID_DIR refererred in hadoop-env.sh
>> but not in yarn-env.sh.
>>
>>
>>
>> On 9/29/14, Aitor Cedres <ac...@pivotal.io> wrote:
>> > Hi Susheel,
>> >
>> > You have to set in your hadoop-env.sh and yarn-env.sh the variabkes:
>> >
>> > - HADOOP_PID_DIR
>> > - YARN_PID_DIR
>> >
>> > To point to some other directory (most common is /var/run/hadoop-hdfs
>> > hadoop-yarn)
>> >
>> > Hope it helps,
>> > Aitor
>> >
>> > On 29 September 2014 07:50, Susheel Kumar Gadalay <sk...@gmail.com>
>> > wrote:
>> >
>> >> How to redirect the storing of the following files from /tmp to some
>> >> other location.
>> >> hadoop-<os user>-namenode.pid
>> >> hadoop-<os user>-datanode.pid
>> >> yarn-<os user>-resourcemanager.pid
>> >> yarn-<os user>-nodemanager.pid
>> >>
>> >> In /tmp, these files are cleared by OS sometime back and I am unable
>> >> to shutdown by standard scripts stop-dfs.sh or stop-yarn.sh
>> >>
>> >> In core-site.xml I have given property hadoop.tmp.dir but still these
>> >> pid files are present in /tmp only,
>> >>
>> >
>>
>
Re: Hadoop shutdown scripts failing
Posted by Susheel Kumar Gadalay <sk...@gmail.com>.
Thanks
On 9/29/14, Aitor Cedres <ac...@pivotal.io> wrote:
> Check the file "$HADOOP_HOME/bin/yarn-daemon.sh"; there is a reference to
> YARN_PID_DIR. If it's not set. it will default to /tmp.
>
>
> On 29 September 2014 13:11, Susheel Kumar Gadalay <sk...@gmail.com>
> wrote:
>
>> Thanks Aitor.
>>
>> There is a shell variable HADOOP_PID_DIR refererred in hadoop-env.sh
>> but not in yarn-env.sh.
>>
>>
>>
>> On 9/29/14, Aitor Cedres <ac...@pivotal.io> wrote:
>> > Hi Susheel,
>> >
>> > You have to set in your hadoop-env.sh and yarn-env.sh the variabkes:
>> >
>> > - HADOOP_PID_DIR
>> > - YARN_PID_DIR
>> >
>> > To point to some other directory (most common is /var/run/hadoop-hdfs
>> > hadoop-yarn)
>> >
>> > Hope it helps,
>> > Aitor
>> >
>> > On 29 September 2014 07:50, Susheel Kumar Gadalay <sk...@gmail.com>
>> > wrote:
>> >
>> >> How to redirect the storing of the following files from /tmp to some
>> >> other location.
>> >> hadoop-<os user>-namenode.pid
>> >> hadoop-<os user>-datanode.pid
>> >> yarn-<os user>-resourcemanager.pid
>> >> yarn-<os user>-nodemanager.pid
>> >>
>> >> In /tmp, these files are cleared by OS sometime back and I am unable
>> >> to shutdown by standard scripts stop-dfs.sh or stop-yarn.sh
>> >>
>> >> In core-site.xml I have given property hadoop.tmp.dir but still these
>> >> pid files are present in /tmp only,
>> >>
>> >
>>
>
Re: Hadoop shutdown scripts failing
Posted by Aitor Cedres <ac...@pivotal.io>.
Check the file "$HADOOP_HOME/bin/yarn-daemon.sh"; there is a reference to
YARN_PID_DIR. If it's not set. it will default to /tmp.
On 29 September 2014 13:11, Susheel Kumar Gadalay <sk...@gmail.com>
wrote:
> Thanks Aitor.
>
> There is a shell variable HADOOP_PID_DIR refererred in hadoop-env.sh
> but not in yarn-env.sh.
>
>
>
> On 9/29/14, Aitor Cedres <ac...@pivotal.io> wrote:
> > Hi Susheel,
> >
> > You have to set in your hadoop-env.sh and yarn-env.sh the variabkes:
> >
> > - HADOOP_PID_DIR
> > - YARN_PID_DIR
> >
> > To point to some other directory (most common is /var/run/hadoop-hdfs
> > hadoop-yarn)
> >
> > Hope it helps,
> > Aitor
> >
> > On 29 September 2014 07:50, Susheel Kumar Gadalay <sk...@gmail.com>
> > wrote:
> >
> >> How to redirect the storing of the following files from /tmp to some
> >> other location.
> >> hadoop-<os user>-namenode.pid
> >> hadoop-<os user>-datanode.pid
> >> yarn-<os user>-resourcemanager.pid
> >> yarn-<os user>-nodemanager.pid
> >>
> >> In /tmp, these files are cleared by OS sometime back and I am unable
> >> to shutdown by standard scripts stop-dfs.sh or stop-yarn.sh
> >>
> >> In core-site.xml I have given property hadoop.tmp.dir but still these
> >> pid files are present in /tmp only,
> >>
> >
>
Re: Hadoop shutdown scripts failing
Posted by Aitor Cedres <ac...@pivotal.io>.
Check the file "$HADOOP_HOME/bin/yarn-daemon.sh"; there is a reference to
YARN_PID_DIR. If it's not set. it will default to /tmp.
On 29 September 2014 13:11, Susheel Kumar Gadalay <sk...@gmail.com>
wrote:
> Thanks Aitor.
>
> There is a shell variable HADOOP_PID_DIR refererred in hadoop-env.sh
> but not in yarn-env.sh.
>
>
>
> On 9/29/14, Aitor Cedres <ac...@pivotal.io> wrote:
> > Hi Susheel,
> >
> > You have to set in your hadoop-env.sh and yarn-env.sh the variabkes:
> >
> > - HADOOP_PID_DIR
> > - YARN_PID_DIR
> >
> > To point to some other directory (most common is /var/run/hadoop-hdfs
> > hadoop-yarn)
> >
> > Hope it helps,
> > Aitor
> >
> > On 29 September 2014 07:50, Susheel Kumar Gadalay <sk...@gmail.com>
> > wrote:
> >
> >> How to redirect the storing of the following files from /tmp to some
> >> other location.
> >> hadoop-<os user>-namenode.pid
> >> hadoop-<os user>-datanode.pid
> >> yarn-<os user>-resourcemanager.pid
> >> yarn-<os user>-nodemanager.pid
> >>
> >> In /tmp, these files are cleared by OS sometime back and I am unable
> >> to shutdown by standard scripts stop-dfs.sh or stop-yarn.sh
> >>
> >> In core-site.xml I have given property hadoop.tmp.dir but still these
> >> pid files are present in /tmp only,
> >>
> >
>
Re: Hadoop shutdown scripts failing
Posted by Aitor Cedres <ac...@pivotal.io>.
Check the file "$HADOOP_HOME/bin/yarn-daemon.sh"; there is a reference to
YARN_PID_DIR. If it's not set. it will default to /tmp.
On 29 September 2014 13:11, Susheel Kumar Gadalay <sk...@gmail.com>
wrote:
> Thanks Aitor.
>
> There is a shell variable HADOOP_PID_DIR refererred in hadoop-env.sh
> but not in yarn-env.sh.
>
>
>
> On 9/29/14, Aitor Cedres <ac...@pivotal.io> wrote:
> > Hi Susheel,
> >
> > You have to set in your hadoop-env.sh and yarn-env.sh the variabkes:
> >
> > - HADOOP_PID_DIR
> > - YARN_PID_DIR
> >
> > To point to some other directory (most common is /var/run/hadoop-hdfs
> > hadoop-yarn)
> >
> > Hope it helps,
> > Aitor
> >
> > On 29 September 2014 07:50, Susheel Kumar Gadalay <sk...@gmail.com>
> > wrote:
> >
> >> How to redirect the storing of the following files from /tmp to some
> >> other location.
> >> hadoop-<os user>-namenode.pid
> >> hadoop-<os user>-datanode.pid
> >> yarn-<os user>-resourcemanager.pid
> >> yarn-<os user>-nodemanager.pid
> >>
> >> In /tmp, these files are cleared by OS sometime back and I am unable
> >> to shutdown by standard scripts stop-dfs.sh or stop-yarn.sh
> >>
> >> In core-site.xml I have given property hadoop.tmp.dir but still these
> >> pid files are present in /tmp only,
> >>
> >
>
Re: Hadoop shutdown scripts failing
Posted by Aitor Cedres <ac...@pivotal.io>.
Check the file "$HADOOP_HOME/bin/yarn-daemon.sh"; there is a reference to
YARN_PID_DIR. If it's not set. it will default to /tmp.
On 29 September 2014 13:11, Susheel Kumar Gadalay <sk...@gmail.com>
wrote:
> Thanks Aitor.
>
> There is a shell variable HADOOP_PID_DIR refererred in hadoop-env.sh
> but not in yarn-env.sh.
>
>
>
> On 9/29/14, Aitor Cedres <ac...@pivotal.io> wrote:
> > Hi Susheel,
> >
> > You have to set in your hadoop-env.sh and yarn-env.sh the variabkes:
> >
> > - HADOOP_PID_DIR
> > - YARN_PID_DIR
> >
> > To point to some other directory (most common is /var/run/hadoop-hdfs
> > hadoop-yarn)
> >
> > Hope it helps,
> > Aitor
> >
> > On 29 September 2014 07:50, Susheel Kumar Gadalay <sk...@gmail.com>
> > wrote:
> >
> >> How to redirect the storing of the following files from /tmp to some
> >> other location.
> >> hadoop-<os user>-namenode.pid
> >> hadoop-<os user>-datanode.pid
> >> yarn-<os user>-resourcemanager.pid
> >> yarn-<os user>-nodemanager.pid
> >>
> >> In /tmp, these files are cleared by OS sometime back and I am unable
> >> to shutdown by standard scripts stop-dfs.sh or stop-yarn.sh
> >>
> >> In core-site.xml I have given property hadoop.tmp.dir but still these
> >> pid files are present in /tmp only,
> >>
> >
>
Re: Hadoop shutdown scripts failing
Posted by Susheel Kumar Gadalay <sk...@gmail.com>.
Thanks Aitor.
There is a shell variable HADOOP_PID_DIR refererred in hadoop-env.sh
but not in yarn-env.sh.
On 9/29/14, Aitor Cedres <ac...@pivotal.io> wrote:
> Hi Susheel,
>
> You have to set in your hadoop-env.sh and yarn-env.sh the variabkes:
>
> - HADOOP_PID_DIR
> - YARN_PID_DIR
>
> To point to some other directory (most common is /var/run/hadoop-hdfs
> hadoop-yarn)
>
> Hope it helps,
> Aitor
>
> On 29 September 2014 07:50, Susheel Kumar Gadalay <sk...@gmail.com>
> wrote:
>
>> How to redirect the storing of the following files from /tmp to some
>> other location.
>> hadoop-<os user>-namenode.pid
>> hadoop-<os user>-datanode.pid
>> yarn-<os user>-resourcemanager.pid
>> yarn-<os user>-nodemanager.pid
>>
>> In /tmp, these files are cleared by OS sometime back and I am unable
>> to shutdown by standard scripts stop-dfs.sh or stop-yarn.sh
>>
>> In core-site.xml I have given property hadoop.tmp.dir but still these
>> pid files are present in /tmp only,
>>
>
Re: Hadoop shutdown scripts failing
Posted by Susheel Kumar Gadalay <sk...@gmail.com>.
Thanks Aitor.
There is a shell variable HADOOP_PID_DIR refererred in hadoop-env.sh
but not in yarn-env.sh.
On 9/29/14, Aitor Cedres <ac...@pivotal.io> wrote:
> Hi Susheel,
>
> You have to set in your hadoop-env.sh and yarn-env.sh the variabkes:
>
> - HADOOP_PID_DIR
> - YARN_PID_DIR
>
> To point to some other directory (most common is /var/run/hadoop-hdfs
> hadoop-yarn)
>
> Hope it helps,
> Aitor
>
> On 29 September 2014 07:50, Susheel Kumar Gadalay <sk...@gmail.com>
> wrote:
>
>> How to redirect the storing of the following files from /tmp to some
>> other location.
>> hadoop-<os user>-namenode.pid
>> hadoop-<os user>-datanode.pid
>> yarn-<os user>-resourcemanager.pid
>> yarn-<os user>-nodemanager.pid
>>
>> In /tmp, these files are cleared by OS sometime back and I am unable
>> to shutdown by standard scripts stop-dfs.sh or stop-yarn.sh
>>
>> In core-site.xml I have given property hadoop.tmp.dir but still these
>> pid files are present in /tmp only,
>>
>
Re: Hadoop shutdown scripts failing
Posted by Susheel Kumar Gadalay <sk...@gmail.com>.
Thanks Aitor.
There is a shell variable HADOOP_PID_DIR refererred in hadoop-env.sh
but not in yarn-env.sh.
On 9/29/14, Aitor Cedres <ac...@pivotal.io> wrote:
> Hi Susheel,
>
> You have to set in your hadoop-env.sh and yarn-env.sh the variabkes:
>
> - HADOOP_PID_DIR
> - YARN_PID_DIR
>
> To point to some other directory (most common is /var/run/hadoop-hdfs
> hadoop-yarn)
>
> Hope it helps,
> Aitor
>
> On 29 September 2014 07:50, Susheel Kumar Gadalay <sk...@gmail.com>
> wrote:
>
>> How to redirect the storing of the following files from /tmp to some
>> other location.
>> hadoop-<os user>-namenode.pid
>> hadoop-<os user>-datanode.pid
>> yarn-<os user>-resourcemanager.pid
>> yarn-<os user>-nodemanager.pid
>>
>> In /tmp, these files are cleared by OS sometime back and I am unable
>> to shutdown by standard scripts stop-dfs.sh or stop-yarn.sh
>>
>> In core-site.xml I have given property hadoop.tmp.dir but still these
>> pid files are present in /tmp only,
>>
>
Re: Hadoop shutdown scripts failing
Posted by Susheel Kumar Gadalay <sk...@gmail.com>.
Thanks Aitor.
There is a shell variable HADOOP_PID_DIR refererred in hadoop-env.sh
but not in yarn-env.sh.
On 9/29/14, Aitor Cedres <ac...@pivotal.io> wrote:
> Hi Susheel,
>
> You have to set in your hadoop-env.sh and yarn-env.sh the variabkes:
>
> - HADOOP_PID_DIR
> - YARN_PID_DIR
>
> To point to some other directory (most common is /var/run/hadoop-hdfs
> hadoop-yarn)
>
> Hope it helps,
> Aitor
>
> On 29 September 2014 07:50, Susheel Kumar Gadalay <sk...@gmail.com>
> wrote:
>
>> How to redirect the storing of the following files from /tmp to some
>> other location.
>> hadoop-<os user>-namenode.pid
>> hadoop-<os user>-datanode.pid
>> yarn-<os user>-resourcemanager.pid
>> yarn-<os user>-nodemanager.pid
>>
>> In /tmp, these files are cleared by OS sometime back and I am unable
>> to shutdown by standard scripts stop-dfs.sh or stop-yarn.sh
>>
>> In core-site.xml I have given property hadoop.tmp.dir but still these
>> pid files are present in /tmp only,
>>
>
Re: Hadoop shutdown scripts failing
Posted by Aitor Cedres <ac...@pivotal.io>.
Hi Susheel,
You have to set in your hadoop-env.sh and yarn-env.sh the variabkes:
- HADOOP_PID_DIR
- YARN_PID_DIR
To point to some other directory (most common is /var/run/hadoop-hdfs
hadoop-yarn)
Hope it helps,
Aitor
On 29 September 2014 07:50, Susheel Kumar Gadalay <sk...@gmail.com>
wrote:
> How to redirect the storing of the following files from /tmp to some
> other location.
> hadoop-<os user>-namenode.pid
> hadoop-<os user>-datanode.pid
> yarn-<os user>-resourcemanager.pid
> yarn-<os user>-nodemanager.pid
>
> In /tmp, these files are cleared by OS sometime back and I am unable
> to shutdown by standard scripts stop-dfs.sh or stop-yarn.sh
>
> In core-site.xml I have given property hadoop.tmp.dir but still these
> pid files are present in /tmp only,
>
Re: Hadoop shutdown scripts failing
Posted by Aitor Cedres <ac...@pivotal.io>.
Hi Susheel,
You have to set in your hadoop-env.sh and yarn-env.sh the variabkes:
- HADOOP_PID_DIR
- YARN_PID_DIR
To point to some other directory (most common is /var/run/hadoop-hdfs
hadoop-yarn)
Hope it helps,
Aitor
On 29 September 2014 07:50, Susheel Kumar Gadalay <sk...@gmail.com>
wrote:
> How to redirect the storing of the following files from /tmp to some
> other location.
> hadoop-<os user>-namenode.pid
> hadoop-<os user>-datanode.pid
> yarn-<os user>-resourcemanager.pid
> yarn-<os user>-nodemanager.pid
>
> In /tmp, these files are cleared by OS sometime back and I am unable
> to shutdown by standard scripts stop-dfs.sh or stop-yarn.sh
>
> In core-site.xml I have given property hadoop.tmp.dir but still these
> pid files are present in /tmp only,
>
Re: Hadoop shutdown scripts failing
Posted by Aitor Cedres <ac...@pivotal.io>.
Hi Susheel,
You have to set in your hadoop-env.sh and yarn-env.sh the variabkes:
- HADOOP_PID_DIR
- YARN_PID_DIR
To point to some other directory (most common is /var/run/hadoop-hdfs
hadoop-yarn)
Hope it helps,
Aitor
On 29 September 2014 07:50, Susheel Kumar Gadalay <sk...@gmail.com>
wrote:
> How to redirect the storing of the following files from /tmp to some
> other location.
> hadoop-<os user>-namenode.pid
> hadoop-<os user>-datanode.pid
> yarn-<os user>-resourcemanager.pid
> yarn-<os user>-nodemanager.pid
>
> In /tmp, these files are cleared by OS sometime back and I am unable
> to shutdown by standard scripts stop-dfs.sh or stop-yarn.sh
>
> In core-site.xml I have given property hadoop.tmp.dir but still these
> pid files are present in /tmp only,
>
Re: Hadoop shutdown scripts failing
Posted by Aitor Cedres <ac...@pivotal.io>.
Hi Susheel,
You have to set in your hadoop-env.sh and yarn-env.sh the variabkes:
- HADOOP_PID_DIR
- YARN_PID_DIR
To point to some other directory (most common is /var/run/hadoop-hdfs
hadoop-yarn)
Hope it helps,
Aitor
On 29 September 2014 07:50, Susheel Kumar Gadalay <sk...@gmail.com>
wrote:
> How to redirect the storing of the following files from /tmp to some
> other location.
> hadoop-<os user>-namenode.pid
> hadoop-<os user>-datanode.pid
> yarn-<os user>-resourcemanager.pid
> yarn-<os user>-nodemanager.pid
>
> In /tmp, these files are cleared by OS sometime back and I am unable
> to shutdown by standard scripts stop-dfs.sh or stop-yarn.sh
>
> In core-site.xml I have given property hadoop.tmp.dir but still these
> pid files are present in /tmp only,
>