You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Rahul Bhattacharjee <ra...@gmail.com> on 2013/06/18 06:46:08 UTC
Environment variable representing classpath for AM launch
Hi,
Is ther's any environment variable (available in all nodes of an Yarn
cluster) which represents a java classpath containing all the core jars of
yarn. I was thinking to use that variable to setup the environment where to
run the application master.
Thanks,
Rahul
Re: Environment variable representing classpath for AM launch
Posted by Rahul Bhattacharjee <ra...@gmail.com>.
Thanks Devraj,
Yes , the default yarn site has this property already , I have not
overridden this. The $CLASSPATH environment should have the proper
classpath set with the locations from this property.I was under the
impression that setting $CLASSPATH to the environment of application
launch context should be enough.Its not working for me. Will look more into
it.
On Tue, Jun 18, 2013 at 10:50 AM, Devaraj k <de...@huawei.com> wrote:
> Hi Rahul,****
>
> ** **
>
> You can make use of the below configuration to set up the
> launch context for your application master. ****
>
> ** **
>
> <!-- Applications' Configuration-->****
>
> ****
>
> <property>****
>
> <description>CLASSPATH for YARN applications. A comma-separated list**
> **
>
> of CLASSPATH entries</description>****
>
> <name>yarn.application.classpath</name>****
>
> <value>
> $HADOOP_CONF_DIR,$HADOOP_COMMON_HOME/share/hadoop/common/*,$HADOOP_COMMON_HOME/share/hadoop/common/lib/*,$HADOOP_HDFS_HOME/share/hadoop/hdfs/*,$HADOOP_HDFS_HOME/share/hadoop/hdfs/lib/*,$HADOOP_YARN_HOME/share/hadoop/yarn/*,$HADOOP_YARN_HOME/share/hadoop/yarn/lib/*
> </value>****
>
> </property>****
>
> ** **
>
> Thanks****
>
> Devaraj K****
>
> ** **
>
> *From:* Rahul Bhattacharjee [mailto:rahul.rec.dgp@gmail.com]
> *Sent:* 18 June 2013 10:16
> *To:* user@hadoop.apache.org
> *Subject:* Environment variable representing classpath for AM launch****
>
> ** **
>
> Hi,****
>
> Is ther's any environment variable (available in all nodes of an Yarn
> cluster) which represents a java classpath containing all the core jars of
> yarn. I was thinking to use that variable to setup the environment where to
> run the application master.****
>
> Thanks,****
>
> Rahul****
>
Re: Environment variable representing classpath for AM launch
Posted by Rahul Bhattacharjee <ra...@gmail.com>.
Thanks Devraj,
Yes , the default yarn site has this property already , I have not
overridden this. The $CLASSPATH environment should have the proper
classpath set with the locations from this property.I was under the
impression that setting $CLASSPATH to the environment of application
launch context should be enough.Its not working for me. Will look more into
it.
On Tue, Jun 18, 2013 at 10:50 AM, Devaraj k <de...@huawei.com> wrote:
> Hi Rahul,****
>
> ** **
>
> You can make use of the below configuration to set up the
> launch context for your application master. ****
>
> ** **
>
> <!-- Applications' Configuration-->****
>
> ****
>
> <property>****
>
> <description>CLASSPATH for YARN applications. A comma-separated list**
> **
>
> of CLASSPATH entries</description>****
>
> <name>yarn.application.classpath</name>****
>
> <value>
> $HADOOP_CONF_DIR,$HADOOP_COMMON_HOME/share/hadoop/common/*,$HADOOP_COMMON_HOME/share/hadoop/common/lib/*,$HADOOP_HDFS_HOME/share/hadoop/hdfs/*,$HADOOP_HDFS_HOME/share/hadoop/hdfs/lib/*,$HADOOP_YARN_HOME/share/hadoop/yarn/*,$HADOOP_YARN_HOME/share/hadoop/yarn/lib/*
> </value>****
>
> </property>****
>
> ** **
>
> Thanks****
>
> Devaraj K****
>
> ** **
>
> *From:* Rahul Bhattacharjee [mailto:rahul.rec.dgp@gmail.com]
> *Sent:* 18 June 2013 10:16
> *To:* user@hadoop.apache.org
> *Subject:* Environment variable representing classpath for AM launch****
>
> ** **
>
> Hi,****
>
> Is ther's any environment variable (available in all nodes of an Yarn
> cluster) which represents a java classpath containing all the core jars of
> yarn. I was thinking to use that variable to setup the environment where to
> run the application master.****
>
> Thanks,****
>
> Rahul****
>
Re: Environment variable representing classpath for AM launch
Posted by Rahul Bhattacharjee <ra...@gmail.com>.
Thanks Devraj,
Yes , the default yarn site has this property already , I have not
overridden this. The $CLASSPATH environment should have the proper
classpath set with the locations from this property.I was under the
impression that setting $CLASSPATH to the environment of application
launch context should be enough.Its not working for me. Will look more into
it.
On Tue, Jun 18, 2013 at 10:50 AM, Devaraj k <de...@huawei.com> wrote:
> Hi Rahul,****
>
> ** **
>
> You can make use of the below configuration to set up the
> launch context for your application master. ****
>
> ** **
>
> <!-- Applications' Configuration-->****
>
> ****
>
> <property>****
>
> <description>CLASSPATH for YARN applications. A comma-separated list**
> **
>
> of CLASSPATH entries</description>****
>
> <name>yarn.application.classpath</name>****
>
> <value>
> $HADOOP_CONF_DIR,$HADOOP_COMMON_HOME/share/hadoop/common/*,$HADOOP_COMMON_HOME/share/hadoop/common/lib/*,$HADOOP_HDFS_HOME/share/hadoop/hdfs/*,$HADOOP_HDFS_HOME/share/hadoop/hdfs/lib/*,$HADOOP_YARN_HOME/share/hadoop/yarn/*,$HADOOP_YARN_HOME/share/hadoop/yarn/lib/*
> </value>****
>
> </property>****
>
> ** **
>
> Thanks****
>
> Devaraj K****
>
> ** **
>
> *From:* Rahul Bhattacharjee [mailto:rahul.rec.dgp@gmail.com]
> *Sent:* 18 June 2013 10:16
> *To:* user@hadoop.apache.org
> *Subject:* Environment variable representing classpath for AM launch****
>
> ** **
>
> Hi,****
>
> Is ther's any environment variable (available in all nodes of an Yarn
> cluster) which represents a java classpath containing all the core jars of
> yarn. I was thinking to use that variable to setup the environment where to
> run the application master.****
>
> Thanks,****
>
> Rahul****
>
Re: Environment variable representing classpath for AM launch
Posted by Rahul Bhattacharjee <ra...@gmail.com>.
Thanks Devraj,
Yes , the default yarn site has this property already , I have not
overridden this. The $CLASSPATH environment should have the proper
classpath set with the locations from this property.I was under the
impression that setting $CLASSPATH to the environment of application
launch context should be enough.Its not working for me. Will look more into
it.
On Tue, Jun 18, 2013 at 10:50 AM, Devaraj k <de...@huawei.com> wrote:
> Hi Rahul,****
>
> ** **
>
> You can make use of the below configuration to set up the
> launch context for your application master. ****
>
> ** **
>
> <!-- Applications' Configuration-->****
>
> ****
>
> <property>****
>
> <description>CLASSPATH for YARN applications. A comma-separated list**
> **
>
> of CLASSPATH entries</description>****
>
> <name>yarn.application.classpath</name>****
>
> <value>
> $HADOOP_CONF_DIR,$HADOOP_COMMON_HOME/share/hadoop/common/*,$HADOOP_COMMON_HOME/share/hadoop/common/lib/*,$HADOOP_HDFS_HOME/share/hadoop/hdfs/*,$HADOOP_HDFS_HOME/share/hadoop/hdfs/lib/*,$HADOOP_YARN_HOME/share/hadoop/yarn/*,$HADOOP_YARN_HOME/share/hadoop/yarn/lib/*
> </value>****
>
> </property>****
>
> ** **
>
> Thanks****
>
> Devaraj K****
>
> ** **
>
> *From:* Rahul Bhattacharjee [mailto:rahul.rec.dgp@gmail.com]
> *Sent:* 18 June 2013 10:16
> *To:* user@hadoop.apache.org
> *Subject:* Environment variable representing classpath for AM launch****
>
> ** **
>
> Hi,****
>
> Is ther's any environment variable (available in all nodes of an Yarn
> cluster) which represents a java classpath containing all the core jars of
> yarn. I was thinking to use that variable to setup the environment where to
> run the application master.****
>
> Thanks,****
>
> Rahul****
>
RE: Environment variable representing classpath for AM launch
Posted by Devaraj k <de...@huawei.com>.
Hi Rahul,
You can make use of the below configuration to set up the launch context for your application master.
<!-- Applications' Configuration-->
<property>
<description>CLASSPATH for YARN applications. A comma-separated list
of CLASSPATH entries</description>
<name>yarn.application.classpath</name>
<value>$HADOOP_CONF_DIR,$HADOOP_COMMON_HOME/share/hadoop/common/*,$HADOOP_COMMON_HOME/share/hadoop/common/lib/*,$HADOOP_HDFS_HOME/share/hadoop/hdfs/*,$HADOOP_HDFS_HOME/share/hadoop/hdfs/lib/*,$HADOOP_YARN_HOME/share/hadoop/yarn/*,$HADOOP_YARN_HOME/share/hadoop/yarn/lib/*</value>
</property>
Thanks
Devaraj K
From: Rahul Bhattacharjee [mailto:rahul.rec.dgp@gmail.com]
Sent: 18 June 2013 10:16
To: user@hadoop.apache.org
Subject: Environment variable representing classpath for AM launch
Hi,
Is ther's any environment variable (available in all nodes of an Yarn cluster) which represents a java classpath containing all the core jars of yarn. I was thinking to use that variable to setup the environment where to run the application master.
Thanks,
Rahul
RE: Environment variable representing classpath for AM launch
Posted by Devaraj k <de...@huawei.com>.
Hi Rahul,
You can make use of the below configuration to set up the launch context for your application master.
<!-- Applications' Configuration-->
<property>
<description>CLASSPATH for YARN applications. A comma-separated list
of CLASSPATH entries</description>
<name>yarn.application.classpath</name>
<value>$HADOOP_CONF_DIR,$HADOOP_COMMON_HOME/share/hadoop/common/*,$HADOOP_COMMON_HOME/share/hadoop/common/lib/*,$HADOOP_HDFS_HOME/share/hadoop/hdfs/*,$HADOOP_HDFS_HOME/share/hadoop/hdfs/lib/*,$HADOOP_YARN_HOME/share/hadoop/yarn/*,$HADOOP_YARN_HOME/share/hadoop/yarn/lib/*</value>
</property>
Thanks
Devaraj K
From: Rahul Bhattacharjee [mailto:rahul.rec.dgp@gmail.com]
Sent: 18 June 2013 10:16
To: user@hadoop.apache.org
Subject: Environment variable representing classpath for AM launch
Hi,
Is ther's any environment variable (available in all nodes of an Yarn cluster) which represents a java classpath containing all the core jars of yarn. I was thinking to use that variable to setup the environment where to run the application master.
Thanks,
Rahul
RE: Environment variable representing classpath for AM launch
Posted by Devaraj k <de...@huawei.com>.
Hi Rahul,
You can make use of the below configuration to set up the launch context for your application master.
<!-- Applications' Configuration-->
<property>
<description>CLASSPATH for YARN applications. A comma-separated list
of CLASSPATH entries</description>
<name>yarn.application.classpath</name>
<value>$HADOOP_CONF_DIR,$HADOOP_COMMON_HOME/share/hadoop/common/*,$HADOOP_COMMON_HOME/share/hadoop/common/lib/*,$HADOOP_HDFS_HOME/share/hadoop/hdfs/*,$HADOOP_HDFS_HOME/share/hadoop/hdfs/lib/*,$HADOOP_YARN_HOME/share/hadoop/yarn/*,$HADOOP_YARN_HOME/share/hadoop/yarn/lib/*</value>
</property>
Thanks
Devaraj K
From: Rahul Bhattacharjee [mailto:rahul.rec.dgp@gmail.com]
Sent: 18 June 2013 10:16
To: user@hadoop.apache.org
Subject: Environment variable representing classpath for AM launch
Hi,
Is ther's any environment variable (available in all nodes of an Yarn cluster) which represents a java classpath containing all the core jars of yarn. I was thinking to use that variable to setup the environment where to run the application master.
Thanks,
Rahul
RE: Environment variable representing classpath for AM launch
Posted by Devaraj k <de...@huawei.com>.
Hi Rahul,
You can make use of the below configuration to set up the launch context for your application master.
<!-- Applications' Configuration-->
<property>
<description>CLASSPATH for YARN applications. A comma-separated list
of CLASSPATH entries</description>
<name>yarn.application.classpath</name>
<value>$HADOOP_CONF_DIR,$HADOOP_COMMON_HOME/share/hadoop/common/*,$HADOOP_COMMON_HOME/share/hadoop/common/lib/*,$HADOOP_HDFS_HOME/share/hadoop/hdfs/*,$HADOOP_HDFS_HOME/share/hadoop/hdfs/lib/*,$HADOOP_YARN_HOME/share/hadoop/yarn/*,$HADOOP_YARN_HOME/share/hadoop/yarn/lib/*</value>
</property>
Thanks
Devaraj K
From: Rahul Bhattacharjee [mailto:rahul.rec.dgp@gmail.com]
Sent: 18 June 2013 10:16
To: user@hadoop.apache.org
Subject: Environment variable representing classpath for AM launch
Hi,
Is ther's any environment variable (available in all nodes of an Yarn cluster) which represents a java classpath containing all the core jars of yarn. I was thinking to use that variable to setup the environment where to run the application master.
Thanks,
Rahul