You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Jane Wayne <ja...@gmail.com> on 2014/03/06 22:11:20 UTC
are the job and task tracker monitor webpages gone now in hadoop v2.3.0
i recently made the switch from hadoop 0.20.x to hadoop 2.3.0 (yes, big
leap). i was wondering if there is a way to view my jobs now via a web UI?
i used to be able to do this by accessing the following URL
http://hadoop-cluster:50030/jobtracker.jsp
however, there is no more job tracker monitoring page here.
furthermore, i am confused about MapReduce as an application running on top
of YARN. so the documentation says MapReduce is just an application running
on YARN. if that is true, how come i do not see MapReduce as an application
on the ResourceManager web UI?
http://hadoop-cluster:8088/cluster/apps
is this because MapReduce is NOT a long-running app? meaning, a MapReduce
job will only show up as an app in YARN when it is running? (please bear
with me, i'm still adjusting to this new design).
any help/pointer is appreciated.
Re: are the job and task tracker monitor webpages gone now in hadoop v2.3.0
Posted by Jane Wayne <ja...@gmail.com>.
ok, the reason why hadoop jobs were not showing up was because i did not
enable mapreduce to be run as a yarn application.
On Thu, Mar 6, 2014 at 11:45 PM, Jane Wayne <ja...@gmail.com>wrote:
> when i go to the job history server
>
> http://hadoop-cluster:19888/jobhistory
>
> i see no map reduce job there. i ran 3 simple mr jobs successfully. i
> verified by the console output and hdfs output directory.
>
> all i see on the UI is: No data available in table.
>
> any ideas?
>
> unless there is a JobHistoryServer just for MapReduce.. where is that?
>
>
> On Thu, Mar 6, 2014 at 7:14 PM, Vinod Kumar Vavilapalli <
> vinodkv@apache.org> wrote:
>
>>
>> Yes. JobTracker and TaskTracker are gone from all the 2.x release lines.
>>
>> MapReduce is an application on top of YARN. That is per job - launches,
>> starts and finishes after it is done with its work. Once it is done, you
>> can go look at it in the MapReduce specific JobHistoryServer.
>>
>> +Vinod
>>
>> On Mar 6, 2014, at 1:11 PM, Jane Wayne <ja...@gmail.com> wrote:
>>
>> > i recently made the switch from hadoop 0.20.x to hadoop 2.3.0 (yes, big
>> > leap). i was wondering if there is a way to view my jobs now via a web
>> UI?
>> > i used to be able to do this by accessing the following URL
>> >
>> > http://hadoop-cluster:50030/jobtracker.jsp
>> >
>> > however, there is no more job tracker monitoring page here.
>> >
>> > furthermore, i am confused about MapReduce as an application running on
>> top
>> > of YARN. so the documentation says MapReduce is just an application
>> running
>> > on YARN. if that is true, how come i do not see MapReduce as an
>> application
>> > on the ResourceManager web UI?
>> >
>> > http://hadoop-cluster:8088/cluster/apps
>> >
>> > is this because MapReduce is NOT a long-running app? meaning, a
>> MapReduce
>> > job will only show up as an app in YARN when it is running? (please bear
>> > with me, i'm still adjusting to this new design).
>> >
>> > any help/pointer is appreciated.
>>
>>
>> --
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity
>> to
>> which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified
>> that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender
>> immediately
>> and delete it from your system. Thank You.
>>
>
>
Re: are the job and task tracker monitor webpages gone now in hadoop v2.3.0
Posted by Jane Wayne <ja...@gmail.com>.
when i go to the job history server
http://hadoop-cluster:19888/jobhistory
i see no map reduce job there. i ran 3 simple mr jobs successfully. i
verified by the console output and hdfs output directory.
all i see on the UI is: No data available in table.
any ideas?
unless there is a JobHistoryServer just for MapReduce.. where is that?
On Thu, Mar 6, 2014 at 7:14 PM, Vinod Kumar Vavilapalli
<vi...@apache.org>wrote:
>
> Yes. JobTracker and TaskTracker are gone from all the 2.x release lines.
>
> MapReduce is an application on top of YARN. That is per job - launches,
> starts and finishes after it is done with its work. Once it is done, you
> can go look at it in the MapReduce specific JobHistoryServer.
>
> +Vinod
>
> On Mar 6, 2014, at 1:11 PM, Jane Wayne <ja...@gmail.com> wrote:
>
> > i recently made the switch from hadoop 0.20.x to hadoop 2.3.0 (yes, big
> > leap). i was wondering if there is a way to view my jobs now via a web
> UI?
> > i used to be able to do this by accessing the following URL
> >
> > http://hadoop-cluster:50030/jobtracker.jsp
> >
> > however, there is no more job tracker monitoring page here.
> >
> > furthermore, i am confused about MapReduce as an application running on
> top
> > of YARN. so the documentation says MapReduce is just an application
> running
> > on YARN. if that is true, how come i do not see MapReduce as an
> application
> > on the ResourceManager web UI?
> >
> > http://hadoop-cluster:8088/cluster/apps
> >
> > is this because MapReduce is NOT a long-running app? meaning, a MapReduce
> > job will only show up as an app in YARN when it is running? (please bear
> > with me, i'm still adjusting to this new design).
> >
> > any help/pointer is appreciated.
>
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>
Re: are the job and task tracker monitor webpages gone now in hadoop v2.3.0
Posted by Vinod Kumar Vavilapalli <vi...@apache.org>.
Yes. JobTracker and TaskTracker are gone from all the 2.x release lines.
MapReduce is an application on top of YARN. That is per job - launches, starts and finishes after it is done with its work. Once it is done, you can go look at it in the MapReduce specific JobHistoryServer.
+Vinod
On Mar 6, 2014, at 1:11 PM, Jane Wayne <ja...@gmail.com> wrote:
> i recently made the switch from hadoop 0.20.x to hadoop 2.3.0 (yes, big
> leap). i was wondering if there is a way to view my jobs now via a web UI?
> i used to be able to do this by accessing the following URL
>
> http://hadoop-cluster:50030/jobtracker.jsp
>
> however, there is no more job tracker monitoring page here.
>
> furthermore, i am confused about MapReduce as an application running on top
> of YARN. so the documentation says MapReduce is just an application running
> on YARN. if that is true, how come i do not see MapReduce as an application
> on the ResourceManager web UI?
>
> http://hadoop-cluster:8088/cluster/apps
>
> is this because MapReduce is NOT a long-running app? meaning, a MapReduce
> job will only show up as an app in YARN when it is running? (please bear
> with me, i'm still adjusting to this new design).
>
> any help/pointer is appreciated.
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.