You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Andy Xue <an...@gmail.com> on 2012/09/04 09:41:39 UTC
Hadoop Streaming: Does not recognise PATH and CLASSPATH defined
Hi:
I wish to use Hadoop streaming to run a program which requires specific
PATH and CLASSPATH variables. I have set these two variables in both
"/etc/profile" and "~/.bashrc" on all slaves (and restarted these slaves).
However, when I run the hadoop streaming job, the program generates error
messages saying that these environment variables are not correctly set.
Does it mean that I did not set these environment variables in the correct
place? How should I define these environment variables?
I use Hadoop 1.0.3 and all machines are running Ubuntu 12.04
Thank you for your time and help. Have a great day.
Andy
Re: Hadoop Streaming: Does not recognise PATH and CLASSPATH defined
Posted by Narasingu Ramesh <ra...@gmail.com>.
Hi Andy,
Please specify the environment varibles in gedit .bashrc. you
can specify for the JAVA_HOME environment variables and configuration
hadoop-site.xml,hadoop-core.xml,and hadoop-default.xml files you can
specify which version hadoop you can use those things and then close
.bashrc and close terminal also finally you can open new terminal. It shows
the correct installations.
Thanks & Regards,
Ramesh.Narasingu
On Tue, Sep 4, 2012 at 1:11 PM, Andy Xue <an...@gmail.com> wrote:
> Hi:
>
> I wish to use Hadoop streaming to run a program which requires specific
> PATH and CLASSPATH variables. I have set these two variables in both
> "/etc/profile" and "~/.bashrc" on all slaves (and restarted these slaves).
> However, when I run the hadoop streaming job, the program generates error
> messages saying that these environment variables are not correctly set.
>
> Does it mean that I did not set these environment variables in the correct
> place? How should I define these environment variables?
> I use Hadoop 1.0.3 and all machines are running Ubuntu 12.04
>
> Thank you for your time and help. Have a great day.
>
> Andy
>
Re: Hadoop Streaming: Does not recognise PATH and CLASSPATH defined
Posted by Narasingu Ramesh <ra...@gmail.com>.
Hi Andy,
Please specify the environment varibles in gedit .bashrc. you
can specify for the JAVA_HOME environment variables and configuration
hadoop-site.xml,hadoop-core.xml,and hadoop-default.xml files you can
specify which version hadoop you can use those things and then close
.bashrc and close terminal also finally you can open new terminal. It shows
the correct installations.
Thanks & Regards,
Ramesh.Narasingu
On Tue, Sep 4, 2012 at 1:11 PM, Andy Xue <an...@gmail.com> wrote:
> Hi:
>
> I wish to use Hadoop streaming to run a program which requires specific
> PATH and CLASSPATH variables. I have set these two variables in both
> "/etc/profile" and "~/.bashrc" on all slaves (and restarted these slaves).
> However, when I run the hadoop streaming job, the program generates error
> messages saying that these environment variables are not correctly set.
>
> Does it mean that I did not set these environment variables in the correct
> place? How should I define these environment variables?
> I use Hadoop 1.0.3 and all machines are running Ubuntu 12.04
>
> Thank you for your time and help. Have a great day.
>
> Andy
>
Re: Hadoop Streaming: Does not recognise PATH and CLASSPATH defined
Posted by Narasingu Ramesh <ra...@gmail.com>.
Hi Andy,
Please specify the environment varibles in gedit .bashrc. you
can specify for the JAVA_HOME environment variables and configuration
hadoop-site.xml,hadoop-core.xml,and hadoop-default.xml files you can
specify which version hadoop you can use those things and then close
.bashrc and close terminal also finally you can open new terminal. It shows
the correct installations.
Thanks & Regards,
Ramesh.Narasingu
On Tue, Sep 4, 2012 at 1:11 PM, Andy Xue <an...@gmail.com> wrote:
> Hi:
>
> I wish to use Hadoop streaming to run a program which requires specific
> PATH and CLASSPATH variables. I have set these two variables in both
> "/etc/profile" and "~/.bashrc" on all slaves (and restarted these slaves).
> However, when I run the hadoop streaming job, the program generates error
> messages saying that these environment variables are not correctly set.
>
> Does it mean that I did not set these environment variables in the correct
> place? How should I define these environment variables?
> I use Hadoop 1.0.3 and all machines are running Ubuntu 12.04
>
> Thank you for your time and help. Have a great day.
>
> Andy
>
Re: Hadoop Streaming: Does not recognise PATH and CLASSPATH defined
Posted by Narasingu Ramesh <ra...@gmail.com>.
Hi Andy,
Please specify the environment varibles in gedit .bashrc. you
can specify for the JAVA_HOME environment variables and configuration
hadoop-site.xml,hadoop-core.xml,and hadoop-default.xml files you can
specify which version hadoop you can use those things and then close
.bashrc and close terminal also finally you can open new terminal. It shows
the correct installations.
Thanks & Regards,
Ramesh.Narasingu
On Tue, Sep 4, 2012 at 1:11 PM, Andy Xue <an...@gmail.com> wrote:
> Hi:
>
> I wish to use Hadoop streaming to run a program which requires specific
> PATH and CLASSPATH variables. I have set these two variables in both
> "/etc/profile" and "~/.bashrc" on all slaves (and restarted these slaves).
> However, when I run the hadoop streaming job, the program generates error
> messages saying that these environment variables are not correctly set.
>
> Does it mean that I did not set these environment variables in the correct
> place? How should I define these environment variables?
> I use Hadoop 1.0.3 and all machines are running Ubuntu 12.04
>
> Thank you for your time and help. Have a great day.
>
> Andy
>
Re: Hadoop Streaming: Does not recognise PATH and CLASSPATH defined
Posted by Narasingu Ramesh <ra...@gmail.com>.
Hi Andy,
Please try once other wise you can again download new hadoop
1.0.2 it is stable. you can set all environment variables in vi .bashrc or
gedt .bashrc you can set paths JAVA_HOME and HADOOP_HOME environment
variables and also set path.
Thanks & Regards,
Ramesh.Narasingu
On Tue, Sep 4, 2012 at 2:00 PM, Andy Xue <an...@gmail.com> wrote:
> Hi :
>
> Thank you, Narasingu and Rekha for your help.
> So there are no way for hadoop streaming to read an environment variable
> from the OS? Guess that I'll have to use the "-cmdenv" command to specify
> the PATH and CLASSPATH variables.
>
> Again, appreciate your help.
>
> Andy
>
>
>
> On 4 September 2012 18:13, Narasingu Ramesh <ra...@gmail.com>wrote:
>
>> Hi Rekha,
>> What I said means first he has set install java and then
>> pwd(present working directory) for JAVA_HOME directory and then set to
>> classpath for the hadoop installation.
>> Thanks & Regards,
>> Ramesh.Narasingu
>>
>>
>> On Tue, Sep 4, 2012 at 1:36 PM, Joshi, Rekha <Re...@intuit.com>wrote:
>>
>>> Hi Andy,
>>>
>>> If you are referring to HADOOP_CLASSPATH, that is env variable on your
>>> cluster or effected via config xml.But if you need your own environment
>>> variables for streaming you may use -cmdenv PATH= on your streaming
>>> command.Or if you have specific jars for the streaming process -libjars
>>> <application.jar> on command works.
>>>
>>> Thanks
>>> Rekha
>>>
>>> From: Andy Xue <an...@gmail.com>
>>> Reply-To: <us...@hadoop.apache.org>
>>> Date: Tue, 4 Sep 2012 17:41:39 +1000
>>> To: <us...@hadoop.apache.org>
>>> Subject: Hadoop Streaming: Does not recognise PATH and CLASSPATH defined
>>>
>>> Hi:
>>>
>>> I wish to use Hadoop streaming to run a program which requires
>>> specific PATH and CLASSPATH variables. I have set these two variables in
>>> both "/etc/profile" and "~/.bashrc" on all slaves (and restarted these
>>> slaves). However, when I run the hadoop streaming job, the program
>>> generates error messages saying that these environment variables are not
>>> correctly set.
>>>
>>> Does it mean that I did not set these environment variables in the
>>> correct place? How should I define these environment variables?
>>> I use Hadoop 1.0.3 and all machines are running Ubuntu 12.04
>>>
>>> Thank you for your time and help. Have a great day.
>>>
>>> Andy
>>>
>>
>>
>
Re: Hadoop Streaming: Does not recognise PATH and CLASSPATH defined
Posted by Narasingu Ramesh <ra...@gmail.com>.
Hi Andy,
Please try once other wise you can again download new hadoop
1.0.2 it is stable. you can set all environment variables in vi .bashrc or
gedt .bashrc you can set paths JAVA_HOME and HADOOP_HOME environment
variables and also set path.
Thanks & Regards,
Ramesh.Narasingu
On Tue, Sep 4, 2012 at 2:00 PM, Andy Xue <an...@gmail.com> wrote:
> Hi :
>
> Thank you, Narasingu and Rekha for your help.
> So there are no way for hadoop streaming to read an environment variable
> from the OS? Guess that I'll have to use the "-cmdenv" command to specify
> the PATH and CLASSPATH variables.
>
> Again, appreciate your help.
>
> Andy
>
>
>
> On 4 September 2012 18:13, Narasingu Ramesh <ra...@gmail.com>wrote:
>
>> Hi Rekha,
>> What I said means first he has set install java and then
>> pwd(present working directory) for JAVA_HOME directory and then set to
>> classpath for the hadoop installation.
>> Thanks & Regards,
>> Ramesh.Narasingu
>>
>>
>> On Tue, Sep 4, 2012 at 1:36 PM, Joshi, Rekha <Re...@intuit.com>wrote:
>>
>>> Hi Andy,
>>>
>>> If you are referring to HADOOP_CLASSPATH, that is env variable on your
>>> cluster or effected via config xml.But if you need your own environment
>>> variables for streaming you may use -cmdenv PATH= on your streaming
>>> command.Or if you have specific jars for the streaming process -libjars
>>> <application.jar> on command works.
>>>
>>> Thanks
>>> Rekha
>>>
>>> From: Andy Xue <an...@gmail.com>
>>> Reply-To: <us...@hadoop.apache.org>
>>> Date: Tue, 4 Sep 2012 17:41:39 +1000
>>> To: <us...@hadoop.apache.org>
>>> Subject: Hadoop Streaming: Does not recognise PATH and CLASSPATH defined
>>>
>>> Hi:
>>>
>>> I wish to use Hadoop streaming to run a program which requires
>>> specific PATH and CLASSPATH variables. I have set these two variables in
>>> both "/etc/profile" and "~/.bashrc" on all slaves (and restarted these
>>> slaves). However, when I run the hadoop streaming job, the program
>>> generates error messages saying that these environment variables are not
>>> correctly set.
>>>
>>> Does it mean that I did not set these environment variables in the
>>> correct place? How should I define these environment variables?
>>> I use Hadoop 1.0.3 and all machines are running Ubuntu 12.04
>>>
>>> Thank you for your time and help. Have a great day.
>>>
>>> Andy
>>>
>>
>>
>
Re: Hadoop Streaming: Does not recognise PATH and CLASSPATH defined
Posted by Narasingu Ramesh <ra...@gmail.com>.
Hi Andy,
Please try once other wise you can again download new hadoop
1.0.2 it is stable. you can set all environment variables in vi .bashrc or
gedt .bashrc you can set paths JAVA_HOME and HADOOP_HOME environment
variables and also set path.
Thanks & Regards,
Ramesh.Narasingu
On Tue, Sep 4, 2012 at 2:00 PM, Andy Xue <an...@gmail.com> wrote:
> Hi :
>
> Thank you, Narasingu and Rekha for your help.
> So there are no way for hadoop streaming to read an environment variable
> from the OS? Guess that I'll have to use the "-cmdenv" command to specify
> the PATH and CLASSPATH variables.
>
> Again, appreciate your help.
>
> Andy
>
>
>
> On 4 September 2012 18:13, Narasingu Ramesh <ra...@gmail.com>wrote:
>
>> Hi Rekha,
>> What I said means first he has set install java and then
>> pwd(present working directory) for JAVA_HOME directory and then set to
>> classpath for the hadoop installation.
>> Thanks & Regards,
>> Ramesh.Narasingu
>>
>>
>> On Tue, Sep 4, 2012 at 1:36 PM, Joshi, Rekha <Re...@intuit.com>wrote:
>>
>>> Hi Andy,
>>>
>>> If you are referring to HADOOP_CLASSPATH, that is env variable on your
>>> cluster or effected via config xml.But if you need your own environment
>>> variables for streaming you may use -cmdenv PATH= on your streaming
>>> command.Or if you have specific jars for the streaming process -libjars
>>> <application.jar> on command works.
>>>
>>> Thanks
>>> Rekha
>>>
>>> From: Andy Xue <an...@gmail.com>
>>> Reply-To: <us...@hadoop.apache.org>
>>> Date: Tue, 4 Sep 2012 17:41:39 +1000
>>> To: <us...@hadoop.apache.org>
>>> Subject: Hadoop Streaming: Does not recognise PATH and CLASSPATH defined
>>>
>>> Hi:
>>>
>>> I wish to use Hadoop streaming to run a program which requires
>>> specific PATH and CLASSPATH variables. I have set these two variables in
>>> both "/etc/profile" and "~/.bashrc" on all slaves (and restarted these
>>> slaves). However, when I run the hadoop streaming job, the program
>>> generates error messages saying that these environment variables are not
>>> correctly set.
>>>
>>> Does it mean that I did not set these environment variables in the
>>> correct place? How should I define these environment variables?
>>> I use Hadoop 1.0.3 and all machines are running Ubuntu 12.04
>>>
>>> Thank you for your time and help. Have a great day.
>>>
>>> Andy
>>>
>>
>>
>
Re: Hadoop Streaming: Does not recognise PATH and CLASSPATH defined
Posted by Narasingu Ramesh <ra...@gmail.com>.
Hi Andy,
Please try once other wise you can again download new hadoop
1.0.2 it is stable. you can set all environment variables in vi .bashrc or
gedt .bashrc you can set paths JAVA_HOME and HADOOP_HOME environment
variables and also set path.
Thanks & Regards,
Ramesh.Narasingu
On Tue, Sep 4, 2012 at 2:00 PM, Andy Xue <an...@gmail.com> wrote:
> Hi :
>
> Thank you, Narasingu and Rekha for your help.
> So there are no way for hadoop streaming to read an environment variable
> from the OS? Guess that I'll have to use the "-cmdenv" command to specify
> the PATH and CLASSPATH variables.
>
> Again, appreciate your help.
>
> Andy
>
>
>
> On 4 September 2012 18:13, Narasingu Ramesh <ra...@gmail.com>wrote:
>
>> Hi Rekha,
>> What I said means first he has set install java and then
>> pwd(present working directory) for JAVA_HOME directory and then set to
>> classpath for the hadoop installation.
>> Thanks & Regards,
>> Ramesh.Narasingu
>>
>>
>> On Tue, Sep 4, 2012 at 1:36 PM, Joshi, Rekha <Re...@intuit.com>wrote:
>>
>>> Hi Andy,
>>>
>>> If you are referring to HADOOP_CLASSPATH, that is env variable on your
>>> cluster or effected via config xml.But if you need your own environment
>>> variables for streaming you may use -cmdenv PATH= on your streaming
>>> command.Or if you have specific jars for the streaming process -libjars
>>> <application.jar> on command works.
>>>
>>> Thanks
>>> Rekha
>>>
>>> From: Andy Xue <an...@gmail.com>
>>> Reply-To: <us...@hadoop.apache.org>
>>> Date: Tue, 4 Sep 2012 17:41:39 +1000
>>> To: <us...@hadoop.apache.org>
>>> Subject: Hadoop Streaming: Does not recognise PATH and CLASSPATH defined
>>>
>>> Hi:
>>>
>>> I wish to use Hadoop streaming to run a program which requires
>>> specific PATH and CLASSPATH variables. I have set these two variables in
>>> both "/etc/profile" and "~/.bashrc" on all slaves (and restarted these
>>> slaves). However, when I run the hadoop streaming job, the program
>>> generates error messages saying that these environment variables are not
>>> correctly set.
>>>
>>> Does it mean that I did not set these environment variables in the
>>> correct place? How should I define these environment variables?
>>> I use Hadoop 1.0.3 and all machines are running Ubuntu 12.04
>>>
>>> Thank you for your time and help. Have a great day.
>>>
>>> Andy
>>>
>>
>>
>
Re: Hadoop Streaming: Does not recognise PATH and CLASSPATH defined
Posted by Andy Xue <an...@gmail.com>.
Hi :
Thank you, Narasingu and Rekha for your help.
So there are no way for hadoop streaming to read an environment variable
from the OS? Guess that I'll have to use the "-cmdenv" command to specify
the PATH and CLASSPATH variables.
Again, appreciate your help.
Andy
On 4 September 2012 18:13, Narasingu Ramesh <ra...@gmail.com>wrote:
> Hi Rekha,
> What I said means first he has set install java and then
> pwd(present working directory) for JAVA_HOME directory and then set to
> classpath for the hadoop installation.
> Thanks & Regards,
> Ramesh.Narasingu
>
>
> On Tue, Sep 4, 2012 at 1:36 PM, Joshi, Rekha <Re...@intuit.com>wrote:
>
>> Hi Andy,
>>
>> If you are referring to HADOOP_CLASSPATH, that is env variable on your
>> cluster or effected via config xml.But if you need your own environment
>> variables for streaming you may use -cmdenv PATH= on your streaming
>> command.Or if you have specific jars for the streaming process -libjars
>> <application.jar> on command works.
>>
>> Thanks
>> Rekha
>>
>> From: Andy Xue <an...@gmail.com>
>> Reply-To: <us...@hadoop.apache.org>
>> Date: Tue, 4 Sep 2012 17:41:39 +1000
>> To: <us...@hadoop.apache.org>
>> Subject: Hadoop Streaming: Does not recognise PATH and CLASSPATH defined
>>
>> Hi:
>>
>> I wish to use Hadoop streaming to run a program which requires specific
>> PATH and CLASSPATH variables. I have set these two variables in both
>> "/etc/profile" and "~/.bashrc" on all slaves (and restarted these slaves).
>> However, when I run the hadoop streaming job, the program generates error
>> messages saying that these environment variables are not correctly set.
>>
>> Does it mean that I did not set these environment variables in the
>> correct place? How should I define these environment variables?
>> I use Hadoop 1.0.3 and all machines are running Ubuntu 12.04
>>
>> Thank you for your time and help. Have a great day.
>>
>> Andy
>>
>
>
Re: Hadoop Streaming: Does not recognise PATH and CLASSPATH defined
Posted by Andy Xue <an...@gmail.com>.
Hi :
Thank you, Narasingu and Rekha for your help.
So there are no way for hadoop streaming to read an environment variable
from the OS? Guess that I'll have to use the "-cmdenv" command to specify
the PATH and CLASSPATH variables.
Again, appreciate your help.
Andy
On 4 September 2012 18:13, Narasingu Ramesh <ra...@gmail.com>wrote:
> Hi Rekha,
> What I said means first he has set install java and then
> pwd(present working directory) for JAVA_HOME directory and then set to
> classpath for the hadoop installation.
> Thanks & Regards,
> Ramesh.Narasingu
>
>
> On Tue, Sep 4, 2012 at 1:36 PM, Joshi, Rekha <Re...@intuit.com>wrote:
>
>> Hi Andy,
>>
>> If you are referring to HADOOP_CLASSPATH, that is env variable on your
>> cluster or effected via config xml.But if you need your own environment
>> variables for streaming you may use -cmdenv PATH= on your streaming
>> command.Or if you have specific jars for the streaming process -libjars
>> <application.jar> on command works.
>>
>> Thanks
>> Rekha
>>
>> From: Andy Xue <an...@gmail.com>
>> Reply-To: <us...@hadoop.apache.org>
>> Date: Tue, 4 Sep 2012 17:41:39 +1000
>> To: <us...@hadoop.apache.org>
>> Subject: Hadoop Streaming: Does not recognise PATH and CLASSPATH defined
>>
>> Hi:
>>
>> I wish to use Hadoop streaming to run a program which requires specific
>> PATH and CLASSPATH variables. I have set these two variables in both
>> "/etc/profile" and "~/.bashrc" on all slaves (and restarted these slaves).
>> However, when I run the hadoop streaming job, the program generates error
>> messages saying that these environment variables are not correctly set.
>>
>> Does it mean that I did not set these environment variables in the
>> correct place? How should I define these environment variables?
>> I use Hadoop 1.0.3 and all machines are running Ubuntu 12.04
>>
>> Thank you for your time and help. Have a great day.
>>
>> Andy
>>
>
>
Re: Hadoop Streaming: Does not recognise PATH and CLASSPATH defined
Posted by Andy Xue <an...@gmail.com>.
Hi :
Thank you, Narasingu and Rekha for your help.
So there are no way for hadoop streaming to read an environment variable
from the OS? Guess that I'll have to use the "-cmdenv" command to specify
the PATH and CLASSPATH variables.
Again, appreciate your help.
Andy
On 4 September 2012 18:13, Narasingu Ramesh <ra...@gmail.com>wrote:
> Hi Rekha,
> What I said means first he has set install java and then
> pwd(present working directory) for JAVA_HOME directory and then set to
> classpath for the hadoop installation.
> Thanks & Regards,
> Ramesh.Narasingu
>
>
> On Tue, Sep 4, 2012 at 1:36 PM, Joshi, Rekha <Re...@intuit.com>wrote:
>
>> Hi Andy,
>>
>> If you are referring to HADOOP_CLASSPATH, that is env variable on your
>> cluster or effected via config xml.But if you need your own environment
>> variables for streaming you may use -cmdenv PATH= on your streaming
>> command.Or if you have specific jars for the streaming process -libjars
>> <application.jar> on command works.
>>
>> Thanks
>> Rekha
>>
>> From: Andy Xue <an...@gmail.com>
>> Reply-To: <us...@hadoop.apache.org>
>> Date: Tue, 4 Sep 2012 17:41:39 +1000
>> To: <us...@hadoop.apache.org>
>> Subject: Hadoop Streaming: Does not recognise PATH and CLASSPATH defined
>>
>> Hi:
>>
>> I wish to use Hadoop streaming to run a program which requires specific
>> PATH and CLASSPATH variables. I have set these two variables in both
>> "/etc/profile" and "~/.bashrc" on all slaves (and restarted these slaves).
>> However, when I run the hadoop streaming job, the program generates error
>> messages saying that these environment variables are not correctly set.
>>
>> Does it mean that I did not set these environment variables in the
>> correct place? How should I define these environment variables?
>> I use Hadoop 1.0.3 and all machines are running Ubuntu 12.04
>>
>> Thank you for your time and help. Have a great day.
>>
>> Andy
>>
>
>
Re: Hadoop Streaming: Does not recognise PATH and CLASSPATH defined
Posted by Andy Xue <an...@gmail.com>.
Hi :
Thank you, Narasingu and Rekha for your help.
So there are no way for hadoop streaming to read an environment variable
from the OS? Guess that I'll have to use the "-cmdenv" command to specify
the PATH and CLASSPATH variables.
Again, appreciate your help.
Andy
On 4 September 2012 18:13, Narasingu Ramesh <ra...@gmail.com>wrote:
> Hi Rekha,
> What I said means first he has set install java and then
> pwd(present working directory) for JAVA_HOME directory and then set to
> classpath for the hadoop installation.
> Thanks & Regards,
> Ramesh.Narasingu
>
>
> On Tue, Sep 4, 2012 at 1:36 PM, Joshi, Rekha <Re...@intuit.com>wrote:
>
>> Hi Andy,
>>
>> If you are referring to HADOOP_CLASSPATH, that is env variable on your
>> cluster or effected via config xml.But if you need your own environment
>> variables for streaming you may use -cmdenv PATH= on your streaming
>> command.Or if you have specific jars for the streaming process -libjars
>> <application.jar> on command works.
>>
>> Thanks
>> Rekha
>>
>> From: Andy Xue <an...@gmail.com>
>> Reply-To: <us...@hadoop.apache.org>
>> Date: Tue, 4 Sep 2012 17:41:39 +1000
>> To: <us...@hadoop.apache.org>
>> Subject: Hadoop Streaming: Does not recognise PATH and CLASSPATH defined
>>
>> Hi:
>>
>> I wish to use Hadoop streaming to run a program which requires specific
>> PATH and CLASSPATH variables. I have set these two variables in both
>> "/etc/profile" and "~/.bashrc" on all slaves (and restarted these slaves).
>> However, when I run the hadoop streaming job, the program generates error
>> messages saying that these environment variables are not correctly set.
>>
>> Does it mean that I did not set these environment variables in the
>> correct place? How should I define these environment variables?
>> I use Hadoop 1.0.3 and all machines are running Ubuntu 12.04
>>
>> Thank you for your time and help. Have a great day.
>>
>> Andy
>>
>
>
Re: Hadoop Streaming: Does not recognise PATH and CLASSPATH defined
Posted by Narasingu Ramesh <ra...@gmail.com>.
Hi Rekha,
What I said means first he has set install java and then
pwd(present working directory) for JAVA_HOME directory and then set to
classpath for the hadoop installation.
Thanks & Regards,
Ramesh.Narasingu
On Tue, Sep 4, 2012 at 1:36 PM, Joshi, Rekha <Re...@intuit.com> wrote:
> Hi Andy,
>
> If you are referring to HADOOP_CLASSPATH, that is env variable on your
> cluster or effected via config xml.But if you need your own environment
> variables for streaming you may use -cmdenv PATH= on your streaming
> command.Or if you have specific jars for the streaming process -libjars
> <application.jar> on command works.
>
> Thanks
> Rekha
>
> From: Andy Xue <an...@gmail.com>
> Reply-To: <us...@hadoop.apache.org>
> Date: Tue, 4 Sep 2012 17:41:39 +1000
> To: <us...@hadoop.apache.org>
> Subject: Hadoop Streaming: Does not recognise PATH and CLASSPATH defined
>
> Hi:
>
> I wish to use Hadoop streaming to run a program which requires specific
> PATH and CLASSPATH variables. I have set these two variables in both
> "/etc/profile" and "~/.bashrc" on all slaves (and restarted these slaves).
> However, when I run the hadoop streaming job, the program generates error
> messages saying that these environment variables are not correctly set.
>
> Does it mean that I did not set these environment variables in the
> correct place? How should I define these environment variables?
> I use Hadoop 1.0.3 and all machines are running Ubuntu 12.04
>
> Thank you for your time and help. Have a great day.
>
> Andy
>
Re: Hadoop Streaming: Does not recognise PATH and CLASSPATH defined
Posted by Narasingu Ramesh <ra...@gmail.com>.
Hi Rekha,
What I said means first he has set install java and then
pwd(present working directory) for JAVA_HOME directory and then set to
classpath for the hadoop installation.
Thanks & Regards,
Ramesh.Narasingu
On Tue, Sep 4, 2012 at 1:36 PM, Joshi, Rekha <Re...@intuit.com> wrote:
> Hi Andy,
>
> If you are referring to HADOOP_CLASSPATH, that is env variable on your
> cluster or effected via config xml.But if you need your own environment
> variables for streaming you may use -cmdenv PATH= on your streaming
> command.Or if you have specific jars for the streaming process -libjars
> <application.jar> on command works.
>
> Thanks
> Rekha
>
> From: Andy Xue <an...@gmail.com>
> Reply-To: <us...@hadoop.apache.org>
> Date: Tue, 4 Sep 2012 17:41:39 +1000
> To: <us...@hadoop.apache.org>
> Subject: Hadoop Streaming: Does not recognise PATH and CLASSPATH defined
>
> Hi:
>
> I wish to use Hadoop streaming to run a program which requires specific
> PATH and CLASSPATH variables. I have set these two variables in both
> "/etc/profile" and "~/.bashrc" on all slaves (and restarted these slaves).
> However, when I run the hadoop streaming job, the program generates error
> messages saying that these environment variables are not correctly set.
>
> Does it mean that I did not set these environment variables in the
> correct place? How should I define these environment variables?
> I use Hadoop 1.0.3 and all machines are running Ubuntu 12.04
>
> Thank you for your time and help. Have a great day.
>
> Andy
>
Re: Hadoop Streaming: Does not recognise PATH and CLASSPATH defined
Posted by Narasingu Ramesh <ra...@gmail.com>.
Hi Rekha,
What I said means first he has set install java and then
pwd(present working directory) for JAVA_HOME directory and then set to
classpath for the hadoop installation.
Thanks & Regards,
Ramesh.Narasingu
On Tue, Sep 4, 2012 at 1:36 PM, Joshi, Rekha <Re...@intuit.com> wrote:
> Hi Andy,
>
> If you are referring to HADOOP_CLASSPATH, that is env variable on your
> cluster or effected via config xml.But if you need your own environment
> variables for streaming you may use -cmdenv PATH= on your streaming
> command.Or if you have specific jars for the streaming process -libjars
> <application.jar> on command works.
>
> Thanks
> Rekha
>
> From: Andy Xue <an...@gmail.com>
> Reply-To: <us...@hadoop.apache.org>
> Date: Tue, 4 Sep 2012 17:41:39 +1000
> To: <us...@hadoop.apache.org>
> Subject: Hadoop Streaming: Does not recognise PATH and CLASSPATH defined
>
> Hi:
>
> I wish to use Hadoop streaming to run a program which requires specific
> PATH and CLASSPATH variables. I have set these two variables in both
> "/etc/profile" and "~/.bashrc" on all slaves (and restarted these slaves).
> However, when I run the hadoop streaming job, the program generates error
> messages saying that these environment variables are not correctly set.
>
> Does it mean that I did not set these environment variables in the
> correct place? How should I define these environment variables?
> I use Hadoop 1.0.3 and all machines are running Ubuntu 12.04
>
> Thank you for your time and help. Have a great day.
>
> Andy
>
Re: Hadoop Streaming: Does not recognise PATH and CLASSPATH defined
Posted by Narasingu Ramesh <ra...@gmail.com>.
Hi Rekha,
What I said means first he has set install java and then
pwd(present working directory) for JAVA_HOME directory and then set to
classpath for the hadoop installation.
Thanks & Regards,
Ramesh.Narasingu
On Tue, Sep 4, 2012 at 1:36 PM, Joshi, Rekha <Re...@intuit.com> wrote:
> Hi Andy,
>
> If you are referring to HADOOP_CLASSPATH, that is env variable on your
> cluster or effected via config xml.But if you need your own environment
> variables for streaming you may use -cmdenv PATH= on your streaming
> command.Or if you have specific jars for the streaming process -libjars
> <application.jar> on command works.
>
> Thanks
> Rekha
>
> From: Andy Xue <an...@gmail.com>
> Reply-To: <us...@hadoop.apache.org>
> Date: Tue, 4 Sep 2012 17:41:39 +1000
> To: <us...@hadoop.apache.org>
> Subject: Hadoop Streaming: Does not recognise PATH and CLASSPATH defined
>
> Hi:
>
> I wish to use Hadoop streaming to run a program which requires specific
> PATH and CLASSPATH variables. I have set these two variables in both
> "/etc/profile" and "~/.bashrc" on all slaves (and restarted these slaves).
> However, when I run the hadoop streaming job, the program generates error
> messages saying that these environment variables are not correctly set.
>
> Does it mean that I did not set these environment variables in the
> correct place? How should I define these environment variables?
> I use Hadoop 1.0.3 and all machines are running Ubuntu 12.04
>
> Thank you for your time and help. Have a great day.
>
> Andy
>
Re: Hadoop Streaming: Does not recognise PATH and CLASSPATH defined
Posted by "Joshi, Rekha" <Re...@intuit.com>.
Hi Andy,
If you are referring to HADOOP_CLASSPATH, that is env variable on your cluster or effected via config xml.But if you need your own environment variables for streaming you may use -cmdenv PATH= on your streaming command.Or if you have specific jars for the streaming process -libjars <application.jar> on command works.
Thanks
Rekha
From: Andy Xue <an...@gmail.com>>
Reply-To: <us...@hadoop.apache.org>>
Date: Tue, 4 Sep 2012 17:41:39 +1000
To: <us...@hadoop.apache.org>>
Subject: Hadoop Streaming: Does not recognise PATH and CLASSPATH defined
Hi:
I wish to use Hadoop streaming to run a program which requires specific PATH and CLASSPATH variables. I have set these two variables in both "/etc/profile" and "~/.bashrc" on all slaves (and restarted these slaves). However, when I run the hadoop streaming job, the program generates error messages saying that these environment variables are not correctly set.
Does it mean that I did not set these environment variables in the correct place? How should I define these environment variables?
I use Hadoop 1.0.3 and all machines are running Ubuntu 12.04
Thank you for your time and help. Have a great day.
Andy
Re: Hadoop Streaming: Does not recognise PATH and CLASSPATH defined
Posted by "Joshi, Rekha" <Re...@intuit.com>.
Hi Andy,
If you are referring to HADOOP_CLASSPATH, that is env variable on your cluster or effected via config xml.But if you need your own environment variables for streaming you may use -cmdenv PATH= on your streaming command.Or if you have specific jars for the streaming process -libjars <application.jar> on command works.
Thanks
Rekha
From: Andy Xue <an...@gmail.com>>
Reply-To: <us...@hadoop.apache.org>>
Date: Tue, 4 Sep 2012 17:41:39 +1000
To: <us...@hadoop.apache.org>>
Subject: Hadoop Streaming: Does not recognise PATH and CLASSPATH defined
Hi:
I wish to use Hadoop streaming to run a program which requires specific PATH and CLASSPATH variables. I have set these two variables in both "/etc/profile" and "~/.bashrc" on all slaves (and restarted these slaves). However, when I run the hadoop streaming job, the program generates error messages saying that these environment variables are not correctly set.
Does it mean that I did not set these environment variables in the correct place? How should I define these environment variables?
I use Hadoop 1.0.3 and all machines are running Ubuntu 12.04
Thank you for your time and help. Have a great day.
Andy
Re: Hadoop Streaming: Does not recognise PATH and CLASSPATH defined
Posted by "Joshi, Rekha" <Re...@intuit.com>.
Hi Andy,
If you are referring to HADOOP_CLASSPATH, that is env variable on your cluster or effected via config xml.But if you need your own environment variables for streaming you may use -cmdenv PATH= on your streaming command.Or if you have specific jars for the streaming process -libjars <application.jar> on command works.
Thanks
Rekha
From: Andy Xue <an...@gmail.com>>
Reply-To: <us...@hadoop.apache.org>>
Date: Tue, 4 Sep 2012 17:41:39 +1000
To: <us...@hadoop.apache.org>>
Subject: Hadoop Streaming: Does not recognise PATH and CLASSPATH defined
Hi:
I wish to use Hadoop streaming to run a program which requires specific PATH and CLASSPATH variables. I have set these two variables in both "/etc/profile" and "~/.bashrc" on all slaves (and restarted these slaves). However, when I run the hadoop streaming job, the program generates error messages saying that these environment variables are not correctly set.
Does it mean that I did not set these environment variables in the correct place? How should I define these environment variables?
I use Hadoop 1.0.3 and all machines are running Ubuntu 12.04
Thank you for your time and help. Have a great day.
Andy
Re: Hadoop Streaming: Does not recognise PATH and CLASSPATH defined
Posted by "Joshi, Rekha" <Re...@intuit.com>.
Hi Andy,
If you are referring to HADOOP_CLASSPATH, that is env variable on your cluster or effected via config xml.But if you need your own environment variables for streaming you may use -cmdenv PATH= on your streaming command.Or if you have specific jars for the streaming process -libjars <application.jar> on command works.
Thanks
Rekha
From: Andy Xue <an...@gmail.com>>
Reply-To: <us...@hadoop.apache.org>>
Date: Tue, 4 Sep 2012 17:41:39 +1000
To: <us...@hadoop.apache.org>>
Subject: Hadoop Streaming: Does not recognise PATH and CLASSPATH defined
Hi:
I wish to use Hadoop streaming to run a program which requires specific PATH and CLASSPATH variables. I have set these two variables in both "/etc/profile" and "~/.bashrc" on all slaves (and restarted these slaves). However, when I run the hadoop streaming job, the program generates error messages saying that these environment variables are not correctly set.
Does it mean that I did not set these environment variables in the correct place? How should I define these environment variables?
I use Hadoop 1.0.3 and all machines are running Ubuntu 12.04
Thank you for your time and help. Have a great day.
Andy