You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by James Hammerton <ja...@mendeley.com> on 2010/05/17 11:06:06 UTC
Incorrect dates on job tracker history
Hi,
According to the job tracker history viewer on our Hadoop setup, all of our
recent jobs were run on Wed May 05 15:58:58 UTC 2010. When you click on the
individual jobs you get the correct times at which they ran. In fact, the
history viewer seems to allocate the date at which the job tracker was
(re)started to all jobs run since the restart.
Is this a bug or a config issue?
James
--
James Hammerton | Senior Data Mining Engineer
www.mendeley.com/profiles/james-hammerton
Mendeley Limited | London, UK | www.mendeley.com
Registered in England and Wales | Company Number 6419015
Re: Incorrect dates on job tracker history
Posted by James Hammerton <ja...@mendeley.com>.
Version: 0.20.1+169.68
Regards,
James
On Mon, May 17, 2010 at 1:55 PM, Ted Yu <yu...@gmail.com> wrote:
> Which version of hadoop are you using ?
>
> Thanks
>
> On Monday, May 17, 2010, James Hammerton <ja...@mendeley.com>
> wrote:
> > Hi,
> >
> > According to the job tracker history viewer on our Hadoop setup, all of
> our recent jobs were run on Wed May 05 15:58:58 UTC 2010. When you click on
> the individual jobs you get the correct times at which they ran. In fact,
> the history viewer seems to allocate the date at which the job tracker was
> (re)started to all jobs run since the restart.
> >
> > Is this a bug or a config issue?
> >
> > James
> > --
> > James Hammerton | Senior Data Mining Engineer
> > www.mendeley.com/profiles/james-hammerton
> >
> > Mendeley Limited | London, UK | www.mendeley.com
> > Registered in England and Wales | Company Number 6419015
> >
> >
> >
> >
>
--
James Hammerton | Senior Data Mining Engineer
www.mendeley.com/profiles/james-hammerton
Mendeley Limited | London, UK | www.mendeley.com
Registered in England and Wales | Company Number 6419015
Re: Incorrect dates on job tracker history
Posted by Ted Yu <yu...@gmail.com>.
Which version of hadoop are you using ?
Thanks
On Monday, May 17, 2010, James Hammerton <ja...@mendeley.com> wrote:
> Hi,
>
> According to the job tracker history viewer on our Hadoop setup, all of our recent jobs were run on Wed May 05 15:58:58 UTC 2010. When you click on the individual jobs you get the correct times at which they ran. In fact, the history viewer seems to allocate the date at which the job tracker was (re)started to all jobs run since the restart.
>
> Is this a bug or a config issue?
>
> James
> --
> James Hammerton | Senior Data Mining Engineer
> www.mendeley.com/profiles/james-hammerton
>
> Mendeley Limited | London, UK | www.mendeley.com
> Registered in England and Wales | Company Number 6419015
>
>
>
>
Re: Incorrect dates on job tracker history
Posted by Ted Yu <yu...@gmail.com>.
I didn't find an existing JIRA so I logged MAPREDUCE-1796
On Mon, May 17, 2010 at 6:44 PM, Hemanth Yamijala <yh...@gmail.com>wrote:
> James,
>
> > According to the job tracker history viewer on our Hadoop setup, all of
> our
> > recent jobs were run on Wed May 05 15:58:58 UTC 2010. When you click on
> the
> > individual jobs you get the correct times at which they ran. In fact, the
> > history viewer seems to allocate the date at which the job tracker was
> > (re)started to all jobs run since the restart.
> >
> > Is this a bug or a config issue?
> >
>
> This has been the behavior of the History viewer for long that it
> shows the timestamp when the JobTracker restarted rather than Job
> start time. There has been lot of feedback to fix this usability
> issue. I don't know if later versions address this, or a JIRA exists
> to fix it.
>
> Thanks
> Hemanth
>
> > James
> >
> > --
> > James Hammerton | Senior Data Mining Engineer
> > www.mendeley.com/profiles/james-hammerton
> >
> > Mendeley Limited | London, UK | www.mendeley.com
> > Registered in England and Wales | Company Number 6419015
> >
> >
> >
> >
>
Re: Incorrect dates on job tracker history
Posted by James Hammerton <ja...@mendeley.com>.
Thanks for arranging that.
James
On Tue, May 18, 2010 at 4:07 AM, Amareshwari Sri Ramadasu <
amarsri@yahoo-inc.com> wrote:
> The issue is being tracked at
> https://issues.apache.org/jira/browse/MAPREDUCE-1541.
>
> Thanks
> Amareshwari
>
>
>
> On 5/18/10 7:14 AM, "Hemanth Yamijala" <yh...@gmail.com> wrote:
>
> James,
>
> > According to the job tracker history viewer on our Hadoop setup, all of
> our
> > recent jobs were run on Wed May 05 15:58:58 UTC 2010. When you click on
> the
> > individual jobs you get the correct times at which they ran. In fact, the
> > history viewer seems to allocate the date at which the job tracker was
> > (re)started to all jobs run since the restart.
> >
> > Is this a bug or a config issue?
> >
>
> This has been the behavior of the History viewer for long that it
> shows the timestamp when the JobTracker restarted rather than Job
> start time. There has been lot of feedback to fix this usability
> issue. I don't know if later versions address this, or a JIRA exists
> to fix it.
>
> Thanks
> Hemanth
>
> > James
> >
> > --
> > James Hammerton | Senior Data Mining Engineer
> > www.mendeley.com/profiles/james-hammerton
> >
> > Mendeley Limited | London, UK | www.mendeley.com
> > Registered in England and Wales | Company Number 6419015
> >
> >
> >
> >
>
>
--
James Hammerton | Senior Data Mining Engineer
www.mendeley.com/profiles/james-hammerton
Mendeley Limited | London, UK | www.mendeley.com
Registered in England and Wales | Company Number 6419015
Re: Incorrect dates on job tracker history
Posted by Amareshwari Sri Ramadasu <am...@yahoo-inc.com>.
The issue is being tracked at https://issues.apache.org/jira/browse/MAPREDUCE-1541.
Thanks
Amareshwari
On 5/18/10 7:14 AM, "Hemanth Yamijala" <yh...@gmail.com> wrote:
James,
> According to the job tracker history viewer on our Hadoop setup, all of our
> recent jobs were run on Wed May 05 15:58:58 UTC 2010. When you click on the
> individual jobs you get the correct times at which they ran. In fact, the
> history viewer seems to allocate the date at which the job tracker was
> (re)started to all jobs run since the restart.
>
> Is this a bug or a config issue?
>
This has been the behavior of the History viewer for long that it
shows the timestamp when the JobTracker restarted rather than Job
start time. There has been lot of feedback to fix this usability
issue. I don't know if later versions address this, or a JIRA exists
to fix it.
Thanks
Hemanth
> James
>
> --
> James Hammerton | Senior Data Mining Engineer
> www.mendeley.com/profiles/james-hammerton
>
> Mendeley Limited | London, UK | www.mendeley.com
> Registered in England and Wales | Company Number 6419015
>
>
>
>
Re: Incorrect dates on job tracker history
Posted by Hemanth Yamijala <yh...@gmail.com>.
James,
> According to the job tracker history viewer on our Hadoop setup, all of our
> recent jobs were run on Wed May 05 15:58:58 UTC 2010. When you click on the
> individual jobs you get the correct times at which they ran. In fact, the
> history viewer seems to allocate the date at which the job tracker was
> (re)started to all jobs run since the restart.
>
> Is this a bug or a config issue?
>
This has been the behavior of the History viewer for long that it
shows the timestamp when the JobTracker restarted rather than Job
start time. There has been lot of feedback to fix this usability
issue. I don't know if later versions address this, or a JIRA exists
to fix it.
Thanks
Hemanth
> James
>
> --
> James Hammerton | Senior Data Mining Engineer
> www.mendeley.com/profiles/james-hammerton
>
> Mendeley Limited | London, UK | www.mendeley.com
> Registered in England and Wales | Company Number 6419015
>
>
>
>