You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Bibudh Lahiri <bi...@gmail.com> on 2011/07/19 23:53:23 UTC
Bad file descriptor with MultipleInputs
Hi,
I am using MultipleInputs.addInputPath to connect the output of two map
jobs with one reduce job. I've specified the inputformat to be
TextInputFormat, and getting a "bad file descriptor" error. When I ran the
map jobs separately with the reduce job (slightly diff version), it was
fine. The files that these map jobs should read also look alright - these
are outputs of previous reduce jobs in the chain. Any suggestions? Should I
use a different input format? I saw KeyValueInputFormat has become
deprecated.
Thanks
Bibudh
--
Bibudh Lahiri
Senior Analytics Engineer, Kikin Inc
132 Crosby Street, New York, NY 10012
http://www.kikin.com
PhD candidate, Dept. of Electrical and Computer Engg.
Iowa State University
http://home.eng.iastate.edu/~bibudh/
Re: Bad file descriptor with MultipleInputs
Posted by Harsh J <ha...@cloudera.com>.
Bibudh,
Could you post the exact/entire stacktrace, and your client
configuration files? (You can use a service like pastebin.com or paste
inline into the mail itself, since the list does not allow
attachments)
On a light hearted note, here's some humor meanwhile: http://imgur.com/jacoj ;)
On Wed, Jul 20, 2011 at 3:23 AM, Bibudh Lahiri <bi...@gmail.com> wrote:
> Hi,
> I am using MultipleInputs.addInputPath to connect the output of two map
> jobs with one reduce job. I've specified the inputformat to be
> TextInputFormat, and getting a "bad file descriptor" error. When I ran the
> map jobs separately with the reduce job (slightly diff version), it was
> fine. The files that these map jobs should read also look alright - these
> are outputs of previous reduce jobs in the chain. Any suggestions? Should I
> use a different input format? I saw KeyValueInputFormat has become
> deprecated.
>
> Thanks
> Bibudh
>
> --
> Bibudh Lahiri
> Senior Analytics Engineer, Kikin Inc
> 132 Crosby Street, New York, NY 10012
> http://www.kikin.com
> PhD candidate, Dept. of Electrical and Computer Engg.
> Iowa State University
> http://home.eng.iastate.edu/~bibudh/
>
--
Harsh J