You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-user@hadoop.apache.org by Blade Liu <ha...@gmail.com> on 2014/10/08 04:08:37 UTC

Setting NLinesInputFormat with varaible values in MapReduce

Hi folks,

There are several input files to feed into mapper, each of which has
similar format(N is variable in each file)

N,
line1,
line2,
...
lineN

A common practice is to set a fixed value of N
(mapreduce.input.linesinputformat.linespermap). So how to let mapper read
each input file of variable N lines?

Many thanks for your tips.

Cheers,
Blade