You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by divya rai <di...@gmail.com> on 2013/12/03 06:34:45 UTC
Problem viewing a job in hadoop v2 web UI
Hi Team,
I have set up a one node cluster with hadoop-2.2.0. When i run sample
wordcount example I don't see it in web-UI on *<ip>:8088 *nor in jobHistory
though my job gets submitted successfully and I see the output file also
under the specified path.
Attached are the configuration files that I have edited.
It will be great if someone can guide me to what am I doing wrong and how
can fix that!
Thanks in advance!
Divya
Re: Problem viewing a job in hadoop v2 web UI
Posted by divya rai <di...@gmail.com>.
Thanks Nishan. Adding this property works fine!
On Tue, Dec 3, 2013 at 12:16 PM, nishan shetty <ni...@huawei.com>wrote:
> Hi Divya
>
>
>
> Please try using this property in client side
>
>
>
> <property>
>
> <name>mapreduce.framework.name</name>
>
> <value>yarn</value>
>
> </property>
>
>
>
> Regards
>
> Nishan
>
>
>
> *From:* divya rai [mailto:divya1343@gmail.com]
> *Sent:* 03 December 2013 11:05 AM
> *To:* user@hadoop.apache.org
> *Subject:* Problem viewing a job in hadoop v2 web UI
>
>
>
> Hi Team,
>
>
>
> I have set up a one node cluster with hadoop-2.2.0. When i run sample
> wordcount example I don't see it in web-UI on *<ip>:8088 *nor in
> jobHistory though my job gets submitted successfully and I see the output
> file also under the specified path.
>
> Attached are the configuration files that I have edited.
>
>
>
> It will be great if someone can guide me to what am I doing wrong and how
> can fix that!
>
>
>
> Thanks in advance!
>
> Divya
>
Re: Problem viewing a job in hadoop v2 web UI
Posted by divya rai <di...@gmail.com>.
Thanks Nishan. Adding this property works fine!
On Tue, Dec 3, 2013 at 12:16 PM, nishan shetty <ni...@huawei.com>wrote:
> Hi Divya
>
>
>
> Please try using this property in client side
>
>
>
> <property>
>
> <name>mapreduce.framework.name</name>
>
> <value>yarn</value>
>
> </property>
>
>
>
> Regards
>
> Nishan
>
>
>
> *From:* divya rai [mailto:divya1343@gmail.com]
> *Sent:* 03 December 2013 11:05 AM
> *To:* user@hadoop.apache.org
> *Subject:* Problem viewing a job in hadoop v2 web UI
>
>
>
> Hi Team,
>
>
>
> I have set up a one node cluster with hadoop-2.2.0. When i run sample
> wordcount example I don't see it in web-UI on *<ip>:8088 *nor in
> jobHistory though my job gets submitted successfully and I see the output
> file also under the specified path.
>
> Attached are the configuration files that I have edited.
>
>
>
> It will be great if someone can guide me to what am I doing wrong and how
> can fix that!
>
>
>
> Thanks in advance!
>
> Divya
>
Re: Problem viewing a job in hadoop v2 web UI
Posted by divya rai <di...@gmail.com>.
Thanks Nishan. Adding this property works fine!
On Tue, Dec 3, 2013 at 12:16 PM, nishan shetty <ni...@huawei.com>wrote:
> Hi Divya
>
>
>
> Please try using this property in client side
>
>
>
> <property>
>
> <name>mapreduce.framework.name</name>
>
> <value>yarn</value>
>
> </property>
>
>
>
> Regards
>
> Nishan
>
>
>
> *From:* divya rai [mailto:divya1343@gmail.com]
> *Sent:* 03 December 2013 11:05 AM
> *To:* user@hadoop.apache.org
> *Subject:* Problem viewing a job in hadoop v2 web UI
>
>
>
> Hi Team,
>
>
>
> I have set up a one node cluster with hadoop-2.2.0. When i run sample
> wordcount example I don't see it in web-UI on *<ip>:8088 *nor in
> jobHistory though my job gets submitted successfully and I see the output
> file also under the specified path.
>
> Attached are the configuration files that I have edited.
>
>
>
> It will be great if someone can guide me to what am I doing wrong and how
> can fix that!
>
>
>
> Thanks in advance!
>
> Divya
>
Re: Problem viewing a job in hadoop v2 web UI
Posted by divya rai <di...@gmail.com>.
Thanks Nishan. Adding this property works fine!
On Tue, Dec 3, 2013 at 12:16 PM, nishan shetty <ni...@huawei.com>wrote:
> Hi Divya
>
>
>
> Please try using this property in client side
>
>
>
> <property>
>
> <name>mapreduce.framework.name</name>
>
> <value>yarn</value>
>
> </property>
>
>
>
> Regards
>
> Nishan
>
>
>
> *From:* divya rai [mailto:divya1343@gmail.com]
> *Sent:* 03 December 2013 11:05 AM
> *To:* user@hadoop.apache.org
> *Subject:* Problem viewing a job in hadoop v2 web UI
>
>
>
> Hi Team,
>
>
>
> I have set up a one node cluster with hadoop-2.2.0. When i run sample
> wordcount example I don't see it in web-UI on *<ip>:8088 *nor in
> jobHistory though my job gets submitted successfully and I see the output
> file also under the specified path.
>
> Attached are the configuration files that I have edited.
>
>
>
> It will be great if someone can guide me to what am I doing wrong and how
> can fix that!
>
>
>
> Thanks in advance!
>
> Divya
>
RE: Problem viewing a job in hadoop v2 web UI
Posted by nishan shetty <ni...@huawei.com>.
Hi Divya
Please try using this property in client side
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
Regards
Nishan
From: divya rai [mailto:divya1343@gmail.com]
Sent: 03 December 2013 11:05 AM
To: user@hadoop.apache.org
Subject: Problem viewing a job in hadoop v2 web UI
Hi Team,
I have set up a one node cluster with hadoop-2.2.0. When i run sample wordcount example I don't see it in web-UI on <ip>:8088 nor in jobHistory though my job gets submitted successfully and I see the output file also under the specified path.
Attached are the configuration files that I have edited.
It will be great if someone can guide me to what am I doing wrong and how can fix that!
Thanks in advance!
Divya
RE: Problem viewing a job in hadoop v2 web UI
Posted by nishan shetty <ni...@huawei.com>.
Hi Divya
Please try using this property in client side
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
Regards
Nishan
From: divya rai [mailto:divya1343@gmail.com]
Sent: 03 December 2013 11:05 AM
To: user@hadoop.apache.org
Subject: Problem viewing a job in hadoop v2 web UI
Hi Team,
I have set up a one node cluster with hadoop-2.2.0. When i run sample wordcount example I don't see it in web-UI on <ip>:8088 nor in jobHistory though my job gets submitted successfully and I see the output file also under the specified path.
Attached are the configuration files that I have edited.
It will be great if someone can guide me to what am I doing wrong and how can fix that!
Thanks in advance!
Divya
RE: Problem viewing a job in hadoop v2 web UI
Posted by nishan shetty <ni...@huawei.com>.
Hi Divya
Please try using this property in client side
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
Regards
Nishan
From: divya rai [mailto:divya1343@gmail.com]
Sent: 03 December 2013 11:05 AM
To: user@hadoop.apache.org
Subject: Problem viewing a job in hadoop v2 web UI
Hi Team,
I have set up a one node cluster with hadoop-2.2.0. When i run sample wordcount example I don't see it in web-UI on <ip>:8088 nor in jobHistory though my job gets submitted successfully and I see the output file also under the specified path.
Attached are the configuration files that I have edited.
It will be great if someone can guide me to what am I doing wrong and how can fix that!
Thanks in advance!
Divya
RE: Problem viewing a job in hadoop v2 web UI
Posted by Vinayakumar B <vi...@huawei.com>.
Hi Divya,
1. I don't see it in web-UI on <ip>:8088
Did you re-started the RM ? RM shows only applications which are submitted after it started.
2. For Job History,
Your Job's staging directory might be different than that of jobhistory server. Make sure that for the JobHistory server staging directory is configured in mapred-site.xml not in yarn-site.xml. JobHistory server will not use yarn-site.xml. Also configure to absolute path in both JobHistory server's mapred-site.xml and Client's configurations.
Configuration name is "yarn.app.mapreduce.am.staging-dir"
After this you should be able to view the Job details in JobHistoryServer once the Job execution is over.
Thanks and Regards,
Vinayakumar B
From: Jian He [mailto:jhe@hortonworks.com]
Sent: 03 December 2013 12:07
To: user@hadoop.apache.org
Subject: Re: Problem viewing a job in hadoop v2 web UI
Can you try with 'yarn application' command ? there are a few options you can use to view the application status with that command.
Also don't forget click the 'ALL Applications' link on the web UI.
Thanks,
Jian
On Mon, Dec 2, 2013 at 9:34 PM, divya rai <di...@gmail.com>> wrote:
Hi Team,
I have set up a one node cluster with hadoop-2.2.0. When i run sample wordcount example I don't see it in web-UI on <ip>:8088 nor in jobHistory though my job gets submitted successfully and I see the output file also under the specified path.
Attached are the configuration files that I have edited.
It will be great if someone can guide me to what am I doing wrong and how can fix that!
Thanks in advance!
Divya
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
RE: Problem viewing a job in hadoop v2 web UI
Posted by Vinayakumar B <vi...@huawei.com>.
Hi Divya,
1. I don't see it in web-UI on <ip>:8088
Did you re-started the RM ? RM shows only applications which are submitted after it started.
2. For Job History,
Your Job's staging directory might be different than that of jobhistory server. Make sure that for the JobHistory server staging directory is configured in mapred-site.xml not in yarn-site.xml. JobHistory server will not use yarn-site.xml. Also configure to absolute path in both JobHistory server's mapred-site.xml and Client's configurations.
Configuration name is "yarn.app.mapreduce.am.staging-dir"
After this you should be able to view the Job details in JobHistoryServer once the Job execution is over.
Thanks and Regards,
Vinayakumar B
From: Jian He [mailto:jhe@hortonworks.com]
Sent: 03 December 2013 12:07
To: user@hadoop.apache.org
Subject: Re: Problem viewing a job in hadoop v2 web UI
Can you try with 'yarn application' command ? there are a few options you can use to view the application status with that command.
Also don't forget click the 'ALL Applications' link on the web UI.
Thanks,
Jian
On Mon, Dec 2, 2013 at 9:34 PM, divya rai <di...@gmail.com>> wrote:
Hi Team,
I have set up a one node cluster with hadoop-2.2.0. When i run sample wordcount example I don't see it in web-UI on <ip>:8088 nor in jobHistory though my job gets submitted successfully and I see the output file also under the specified path.
Attached are the configuration files that I have edited.
It will be great if someone can guide me to what am I doing wrong and how can fix that!
Thanks in advance!
Divya
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
RE: Problem viewing a job in hadoop v2 web UI
Posted by Vinayakumar B <vi...@huawei.com>.
Hi Divya,
1. I don't see it in web-UI on <ip>:8088
Did you re-started the RM ? RM shows only applications which are submitted after it started.
2. For Job History,
Your Job's staging directory might be different than that of jobhistory server. Make sure that for the JobHistory server staging directory is configured in mapred-site.xml not in yarn-site.xml. JobHistory server will not use yarn-site.xml. Also configure to absolute path in both JobHistory server's mapred-site.xml and Client's configurations.
Configuration name is "yarn.app.mapreduce.am.staging-dir"
After this you should be able to view the Job details in JobHistoryServer once the Job execution is over.
Thanks and Regards,
Vinayakumar B
From: Jian He [mailto:jhe@hortonworks.com]
Sent: 03 December 2013 12:07
To: user@hadoop.apache.org
Subject: Re: Problem viewing a job in hadoop v2 web UI
Can you try with 'yarn application' command ? there are a few options you can use to view the application status with that command.
Also don't forget click the 'ALL Applications' link on the web UI.
Thanks,
Jian
On Mon, Dec 2, 2013 at 9:34 PM, divya rai <di...@gmail.com>> wrote:
Hi Team,
I have set up a one node cluster with hadoop-2.2.0. When i run sample wordcount example I don't see it in web-UI on <ip>:8088 nor in jobHistory though my job gets submitted successfully and I see the output file also under the specified path.
Attached are the configuration files that I have edited.
It will be great if someone can guide me to what am I doing wrong and how can fix that!
Thanks in advance!
Divya
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
RE: Problem viewing a job in hadoop v2 web UI
Posted by Vinayakumar B <vi...@huawei.com>.
Hi Divya,
1. I don't see it in web-UI on <ip>:8088
Did you re-started the RM ? RM shows only applications which are submitted after it started.
2. For Job History,
Your Job's staging directory might be different than that of jobhistory server. Make sure that for the JobHistory server staging directory is configured in mapred-site.xml not in yarn-site.xml. JobHistory server will not use yarn-site.xml. Also configure to absolute path in both JobHistory server's mapred-site.xml and Client's configurations.
Configuration name is "yarn.app.mapreduce.am.staging-dir"
After this you should be able to view the Job details in JobHistoryServer once the Job execution is over.
Thanks and Regards,
Vinayakumar B
From: Jian He [mailto:jhe@hortonworks.com]
Sent: 03 December 2013 12:07
To: user@hadoop.apache.org
Subject: Re: Problem viewing a job in hadoop v2 web UI
Can you try with 'yarn application' command ? there are a few options you can use to view the application status with that command.
Also don't forget click the 'ALL Applications' link on the web UI.
Thanks,
Jian
On Mon, Dec 2, 2013 at 9:34 PM, divya rai <di...@gmail.com>> wrote:
Hi Team,
I have set up a one node cluster with hadoop-2.2.0. When i run sample wordcount example I don't see it in web-UI on <ip>:8088 nor in jobHistory though my job gets submitted successfully and I see the output file also under the specified path.
Attached are the configuration files that I have edited.
It will be great if someone can guide me to what am I doing wrong and how can fix that!
Thanks in advance!
Divya
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
Re: Problem viewing a job in hadoop v2 web UI
Posted by Jian He <jh...@hortonworks.com>.
Can you try with 'yarn application' command ? there are a few options you
can use to view the application status with that command.
Also don't forget click the 'ALL Applications' link on the web UI.
Thanks,
Jian
On Mon, Dec 2, 2013 at 9:34 PM, divya rai <di...@gmail.com> wrote:
> Hi Team,
>
> I have set up a one node cluster with hadoop-2.2.0. When i run sample
> wordcount example I don't see it in web-UI on *<ip>:8088 *nor in
> jobHistory though my job gets submitted successfully and I see the output
> file also under the specified path.
> Attached are the configuration files that I have edited.
>
> It will be great if someone can guide me to what am I doing wrong and how
> can fix that!
>
> Thanks in advance!
> Divya
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
RE: Problem viewing a job in hadoop v2 web UI
Posted by nishan shetty <ni...@huawei.com>.
Hi Divya
Please try using this property in client side
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
Regards
Nishan
From: divya rai [mailto:divya1343@gmail.com]
Sent: 03 December 2013 11:05 AM
To: user@hadoop.apache.org
Subject: Problem viewing a job in hadoop v2 web UI
Hi Team,
I have set up a one node cluster with hadoop-2.2.0. When i run sample wordcount example I don't see it in web-UI on <ip>:8088 nor in jobHistory though my job gets submitted successfully and I see the output file also under the specified path.
Attached are the configuration files that I have edited.
It will be great if someone can guide me to what am I doing wrong and how can fix that!
Thanks in advance!
Divya
Re: Problem viewing a job in hadoop v2 web UI
Posted by Jian He <jh...@hortonworks.com>.
Can you try with 'yarn application' command ? there are a few options you
can use to view the application status with that command.
Also don't forget click the 'ALL Applications' link on the web UI.
Thanks,
Jian
On Mon, Dec 2, 2013 at 9:34 PM, divya rai <di...@gmail.com> wrote:
> Hi Team,
>
> I have set up a one node cluster with hadoop-2.2.0. When i run sample
> wordcount example I don't see it in web-UI on *<ip>:8088 *nor in
> jobHistory though my job gets submitted successfully and I see the output
> file also under the specified path.
> Attached are the configuration files that I have edited.
>
> It will be great if someone can guide me to what am I doing wrong and how
> can fix that!
>
> Thanks in advance!
> Divya
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
RE: Problem viewing a job in hadoop v2 web UI
Posted by nishan shetty <ni...@huawei.com>.
Hi Divya
Please try using this property in client side
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
Regards
Nishan
From: divya rai [mailto:divya1343@gmail.com]
Sent: 03 December 2013 11:05 AM
To: user@hadoop.apache.org
Subject: Problem viewing a job in hadoop v2 web UI
Hi Team,
I have set up a one node cluster with hadoop-2.2.0. When i run sample wordcount example I don't see it in web-UI on <ip>:8088 nor in jobHistory though my job gets submitted successfully and I see the output file also under the specified path.
Attached are the configuration files that I have edited.
It will be great if someone can guide me to what am I doing wrong and how can fix that!
Thanks in advance!
Divya
RE: Problem viewing a job in hadoop v2 web UI
Posted by nishan shetty <ni...@huawei.com>.
Hi Divya
Please try using this property in client side
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
Regards
Nishan
From: divya rai [mailto:divya1343@gmail.com]
Sent: 03 December 2013 11:05 AM
To: user@hadoop.apache.org
Subject: Problem viewing a job in hadoop v2 web UI
Hi Team,
I have set up a one node cluster with hadoop-2.2.0. When i run sample wordcount example I don't see it in web-UI on <ip>:8088 nor in jobHistory though my job gets submitted successfully and I see the output file also under the specified path.
Attached are the configuration files that I have edited.
It will be great if someone can guide me to what am I doing wrong and how can fix that!
Thanks in advance!
Divya
Re: Problem viewing a job in hadoop v2 web UI
Posted by Jian He <jh...@hortonworks.com>.
Can you try with 'yarn application' command ? there are a few options you
can use to view the application status with that command.
Also don't forget click the 'ALL Applications' link on the web UI.
Thanks,
Jian
On Mon, Dec 2, 2013 at 9:34 PM, divya rai <di...@gmail.com> wrote:
> Hi Team,
>
> I have set up a one node cluster with hadoop-2.2.0. When i run sample
> wordcount example I don't see it in web-UI on *<ip>:8088 *nor in
> jobHistory though my job gets submitted successfully and I see the output
> file also under the specified path.
> Attached are the configuration files that I have edited.
>
> It will be great if someone can guide me to what am I doing wrong and how
> can fix that!
>
> Thanks in advance!
> Divya
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
RE: Problem viewing a job in hadoop v2 web UI
Posted by nishan shetty <ni...@huawei.com>.
Hi Divya
Please try using this property in client side
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
Regards
Nishan
From: divya rai [mailto:divya1343@gmail.com]
Sent: 03 December 2013 11:05 AM
To: user@hadoop.apache.org
Subject: Problem viewing a job in hadoop v2 web UI
Hi Team,
I have set up a one node cluster with hadoop-2.2.0. When i run sample wordcount example I don't see it in web-UI on <ip>:8088 nor in jobHistory though my job gets submitted successfully and I see the output file also under the specified path.
Attached are the configuration files that I have edited.
It will be great if someone can guide me to what am I doing wrong and how can fix that!
Thanks in advance!
Divya
RE: Problem viewing a job in hadoop v2 web UI
Posted by nishan shetty <ni...@huawei.com>.
Hi Divya
Please try using this property in client side
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
Regards
Nishan
From: divya rai [mailto:divya1343@gmail.com]
Sent: 03 December 2013 11:05 AM
To: user@hadoop.apache.org
Subject: Problem viewing a job in hadoop v2 web UI
Hi Team,
I have set up a one node cluster with hadoop-2.2.0. When i run sample wordcount example I don't see it in web-UI on <ip>:8088 nor in jobHistory though my job gets submitted successfully and I see the output file also under the specified path.
Attached are the configuration files that I have edited.
It will be great if someone can guide me to what am I doing wrong and how can fix that!
Thanks in advance!
Divya
Re: Problem viewing a job in hadoop v2 web UI
Posted by Jian He <jh...@hortonworks.com>.
Can you try with 'yarn application' command ? there are a few options you
can use to view the application status with that command.
Also don't forget click the 'ALL Applications' link on the web UI.
Thanks,
Jian
On Mon, Dec 2, 2013 at 9:34 PM, divya rai <di...@gmail.com> wrote:
> Hi Team,
>
> I have set up a one node cluster with hadoop-2.2.0. When i run sample
> wordcount example I don't see it in web-UI on *<ip>:8088 *nor in
> jobHistory though my job gets submitted successfully and I see the output
> file also under the specified path.
> Attached are the configuration files that I have edited.
>
> It will be great if someone can guide me to what am I doing wrong and how
> can fix that!
>
> Thanks in advance!
> Divya
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.