You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Bibudh Lahiri <bi...@gmail.com> on 2011/07/19 23:53:23 UTC

Bad file descriptor with MultipleInputs

Hi,
   I am using MultipleInputs.addInputPath to connect the output of two map
jobs with one reduce job. I've specified the inputformat to be
TextInputFormat, and getting a "bad file descriptor" error. When I ran the
map jobs separately with the reduce job (slightly diff version), it was
fine. The files that these map jobs should read also look alright - these
are outputs of previous reduce jobs in the chain. Any suggestions? Should I
use a different input format? I saw KeyValueInputFormat has become
deprecated.

   Thanks
              Bibudh

-- 
Bibudh Lahiri
Senior Analytics Engineer, Kikin Inc
132 Crosby Street, New York, NY 10012
http://www.kikin.com
PhD candidate, Dept. of Electrical and Computer Engg.
Iowa State University
http://home.eng.iastate.edu/~bibudh/

Re: Bad file descriptor with MultipleInputs

Posted by Harsh J <ha...@cloudera.com>.
Bibudh,

Could you post the exact/entire stacktrace, and your client
configuration files? (You can use a service like pastebin.com or paste
inline into the mail itself, since the list does not allow
attachments)

On a light hearted note, here's some humor meanwhile: http://imgur.com/jacoj ;)

On Wed, Jul 20, 2011 at 3:23 AM, Bibudh Lahiri <bi...@gmail.com> wrote:
> Hi,
>   I am using MultipleInputs.addInputPath to connect the output of two map
> jobs with one reduce job. I've specified the inputformat to be
> TextInputFormat, and getting a "bad file descriptor" error. When I ran the
> map jobs separately with the reduce job (slightly diff version), it was
> fine. The files that these map jobs should read also look alright - these
> are outputs of previous reduce jobs in the chain. Any suggestions? Should I
> use a different input format? I saw KeyValueInputFormat has become
> deprecated.
>
>   Thanks
>              Bibudh
>
> --
> Bibudh Lahiri
> Senior Analytics Engineer, Kikin Inc
> 132 Crosby Street, New York, NY 10012
> http://www.kikin.com
> PhD candidate, Dept. of Electrical and Computer Engg.
> Iowa State University
> http://home.eng.iastate.edu/~bibudh/
>



-- 
Harsh J