You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-user@hadoop.apache.org by senthilselvan <sn...@gmail.com> on 2013/12/02 19:37:52 UTC
Re: Decomishining a node
Hi,
I have override the InputFormat and set the isspitable to return false. What
I am seeing is in the log, I could see three map jobs. How is it possible?
My entire file has to go one mapper only as I set the issplitable false?
Thanks
Re: Decomishining a node
Posted by rtejac <rt...@gmail.com>.
May be your "issplittable to false" is being overwritten.
On Dec 3, 2013, at 10:06 AM, Adam Kawa <ka...@gmail.com> wrote:
>
> I have override the InputFormat and set the isspitable to return false.
> My entire file has to go one mapper only as I set the issplitable false?
>
> Yes.
>
> 1) Could you double-check that you have only 1 input file in the input directory.
> 2) Did you configure your job to use your custom InputFormat (instead of the default one)?
>
Re: Decomishining a node
Posted by rtejac <rt...@gmail.com>.
May be your "issplittable to false" is being overwritten.
On Dec 3, 2013, at 10:06 AM, Adam Kawa <ka...@gmail.com> wrote:
>
> I have override the InputFormat and set the isspitable to return false.
> My entire file has to go one mapper only as I set the issplitable false?
>
> Yes.
>
> 1) Could you double-check that you have only 1 input file in the input directory.
> 2) Did you configure your job to use your custom InputFormat (instead of the default one)?
>
Re: Decomishining a node
Posted by rtejac <rt...@gmail.com>.
May be your "issplittable to false" is being overwritten.
On Dec 3, 2013, at 10:06 AM, Adam Kawa <ka...@gmail.com> wrote:
>
> I have override the InputFormat and set the isspitable to return false.
> My entire file has to go one mapper only as I set the issplitable false?
>
> Yes.
>
> 1) Could you double-check that you have only 1 input file in the input directory.
> 2) Did you configure your job to use your custom InputFormat (instead of the default one)?
>
Re: Decomishining a node
Posted by rtejac <rt...@gmail.com>.
May be your "issplittable to false" is being overwritten.
On Dec 3, 2013, at 10:06 AM, Adam Kawa <ka...@gmail.com> wrote:
>
> I have override the InputFormat and set the isspitable to return false.
> My entire file has to go one mapper only as I set the issplitable false?
>
> Yes.
>
> 1) Could you double-check that you have only 1 input file in the input directory.
> 2) Did you configure your job to use your custom InputFormat (instead of the default one)?
>
Re: Decomishining a node
Posted by Adam Kawa <ka...@gmail.com>.
> I have override the InputFormat and set the isspitable to return false.
> My entire file has to go one mapper only as I set the issplitable false?
>
Yes.
1) Could you double-check that you have only 1 input file in the input
directory.
2) Did you configure your job to use your custom InputFormat (instead of
the default one)?
Re: Decomishining a node
Posted by Adam Kawa <ka...@gmail.com>.
> I have override the InputFormat and set the isspitable to return false.
> My entire file has to go one mapper only as I set the issplitable false?
>
Yes.
1) Could you double-check that you have only 1 input file in the input
directory.
2) Did you configure your job to use your custom InputFormat (instead of
the default one)?
Re: Decomishining a node
Posted by Adam Kawa <ka...@gmail.com>.
> I have override the InputFormat and set the isspitable to return false.
> My entire file has to go one mapper only as I set the issplitable false?
>
Yes.
1) Could you double-check that you have only 1 input file in the input
directory.
2) Did you configure your job to use your custom InputFormat (instead of
the default one)?
Re: Decomishining a node
Posted by Adam Kawa <ka...@gmail.com>.
> I have override the InputFormat and set the isspitable to return false.
> My entire file has to go one mapper only as I set the issplitable false?
>
Yes.
1) Could you double-check that you have only 1 input file in the input
directory.
2) Did you configure your job to use your custom InputFormat (instead of
the default one)?