You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-user@hadoop.apache.org by Mohamed Riadh Trad <Mo...@inria.fr> on 2011/02/25 00:01:32 UTC

WholeFileInputFormat

Dear All,

Has anyone wrote the WholeFileInputFormat with the hadoop 0.20.2 api?

Best Regards,

Trad Mohamed Riadh, M.Sc, Ing.
PhD. student
INRIA-TELECOM PARISTECH 

Office: 11-15
Phone: (33)-1 39 63 59 33
Fax: (33)-1 39 63 56 74
Email: riadh.trad@inria.fr
Home page: http://www-rocq.inria.fr/who/Mohamed.Trad/

Re: WholeFileInputFormat

Posted by Harsh J <qw...@gmail.com>.

Hi,

On Fri, Feb 25, 2011 at 4:31 AM, Mohamed Riadh Trad
<Mo...@inria.fr> wrote:
> Dear All,
> Has anyone wrote the WholeFileInputFormat with the hadoop 0.20.2 api?

1. Create new class extending FileInputFormat<K, V> (or its other derivatives)
2. Override isSplitable to return false.
3. Provide a record reader according to your needs, if necessary.
3. Done.

Here's a series of gists I could find for reference (authored by Sam
Ritchie, no idea on the license): https://gist.github.com/808035

-- 
Harsh J
www.harshj.com