You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Mapred Learn <ma...@gmail.com> on 2011/06/24 19:19:56 UTC

how to identify inputsplit that a mapper is failing on ?

Hi,
One of the mappers in my job is failing and I cannot find out the input
split that it is failing on. How can I find this info ?

Thanks,
-JJ

Re: how to identify inputsplit that a mapper is failing on ?

Posted by Mapred Learn <ma...@gmail.com>.
Hi Ian,
i think input split locations on WebGUI are the block locations in the
cluster where input file is distributed while uploading to HDFS, not the
physical split being processed by the mapper.


On Fri, Jun 24, 2011 at 10:37 AM, Mapred Learn <ma...@gmail.com>wrote:

> Hi Ian,
> I do not see the split in mapper GUI
> I was avoiding logging in from mapper but looks like only option
>
> Thanks for the response !
>
> Sent from my iPhone
>
> On Jun 24, 2011, at 10:28 AM, Ian Wrigley <ia...@cloudera.com> wrote:
>
> > Hi
> >
> > On Jun 24, 2011, at 10:19 AM, Mapred Learn wrote:
> >
> >> Hi,
> >> One of the mappers in my job is failing and I cannot find out the input
> split that it is failing on. How can I find this info ?
> >
> > Usually the Mapper's status in the Web UI will display the input split
> that it is working on; otherwise you could log this from each Mapper.
> >
> > Regards
> >
> > Ian.
> >
> >
> > ---
> > Ian Wrigley
> > Senior Instructor
> > Cloudera, Inc
> > Cell: (323) 819-4075
> >
> >
> >
> >
>

Re: how to identify inputsplit that a mapper is failing on ?

Posted by Mapred Learn <ma...@gmail.com>.
Hi Ian,
I do not see the split in mapper GUI 
I was avoiding logging in from mapper but looks like only option

Thanks for the response !

Sent from my iPhone

On Jun 24, 2011, at 10:28 AM, Ian Wrigley <ia...@cloudera.com> wrote:

> Hi
> 
> On Jun 24, 2011, at 10:19 AM, Mapred Learn wrote:
> 
>> Hi,
>> One of the mappers in my job is failing and I cannot find out the input split that it is failing on. How can I find this info ?
> 
> Usually the Mapper's status in the Web UI will display the input split that it is working on; otherwise you could log this from each Mapper.
> 
> Regards
> 
> Ian.
> 
> 
> --- 
> Ian Wrigley
> Senior Instructor
> Cloudera, Inc
> Cell: (323) 819-4075
> 
> 
> 
>