You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Viswanathan J <ja...@gmail.com> on 2014/03/08 11:00:29 UTC
Hadoop2 LZO issue with pig
Hi,
Getting this issue in hadoop 2.x with pig,
java.lang.Exception: java.lang.RuntimeException: java.io.IOException: No
codec for fileCaused by: java.io.IOException: No codec for file 2590 at
com.twitter.elephantbird.mapreduce.input.MultiInputFormat.determineFileFormat(MultiInputFormat.java:176)2591
at
com.twitter.elephantbird.mapreduce.input.MultiInputFormat.createRecordReader(MultiInputFormat.java:88)2592
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigRecordReader.initNextRecordReader(PigRecordReader.java:256)
Have copied the native lib folder accordingly, but facing issue. Is there
any changes to do in hadoop conf or lib folder?
Please help.
Re: Hadoop2 LZO issue with pig
Posted by Bing Jiang <ji...@gmail.com>.
you need to register necessary jar which contains
com.twitter.elephantbird.mapreduce.input.MultiInputFormat.class ...
2014-03-08 18:00 GMT+08:00 Viswanathan J <ja...@gmail.com>:
> Hi,
>
> Getting this issue in hadoop 2.x with pig,
>
> java.lang.Exception: java.lang.RuntimeException: java.io.IOException: No
> codec for fileCaused by: java.io.IOException: No codec for file 2590 at
> com.twitter.elephantbird.mapreduce.input.MultiInputFormat.determineFileFormat(MultiInputFormat.java:176)2591
> at
> com.twitter.elephantbird.mapreduce.input.MultiInputFormat.createRecordReader(MultiInputFormat.java:88)2592
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigRecordReader.initNextRecordReader(PigRecordReader.java:256)
>
> Have copied the native lib folder accordingly, but facing issue. Is there
> any changes to do in hadoop conf or lib folder?
>
> Please help.
>
--
Bing Jiang
Focus on distributed computing, HDFS/HBase
Re: Hadoop2 LZO issue with pig
Posted by Bing Jiang <ji...@gmail.com>.
you need to register necessary jar which contains
com.twitter.elephantbird.mapreduce.input.MultiInputFormat.class ...
2014-03-08 18:00 GMT+08:00 Viswanathan J <ja...@gmail.com>:
> Hi,
>
> Getting this issue in hadoop 2.x with pig,
>
> java.lang.Exception: java.lang.RuntimeException: java.io.IOException: No
> codec for fileCaused by: java.io.IOException: No codec for file 2590 at
> com.twitter.elephantbird.mapreduce.input.MultiInputFormat.determineFileFormat(MultiInputFormat.java:176)2591
> at
> com.twitter.elephantbird.mapreduce.input.MultiInputFormat.createRecordReader(MultiInputFormat.java:88)2592
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigRecordReader.initNextRecordReader(PigRecordReader.java:256)
>
> Have copied the native lib folder accordingly, but facing issue. Is there
> any changes to do in hadoop conf or lib folder?
>
> Please help.
>
--
Bing Jiang
Focus on distributed computing, HDFS/HBase
Re: Hadoop2 LZO issue with pig
Posted by Bing Jiang <ji...@gmail.com>.
you need to register necessary jar which contains
com.twitter.elephantbird.mapreduce.input.MultiInputFormat.class ...
2014-03-08 18:00 GMT+08:00 Viswanathan J <ja...@gmail.com>:
> Hi,
>
> Getting this issue in hadoop 2.x with pig,
>
> java.lang.Exception: java.lang.RuntimeException: java.io.IOException: No
> codec for fileCaused by: java.io.IOException: No codec for file 2590 at
> com.twitter.elephantbird.mapreduce.input.MultiInputFormat.determineFileFormat(MultiInputFormat.java:176)2591
> at
> com.twitter.elephantbird.mapreduce.input.MultiInputFormat.createRecordReader(MultiInputFormat.java:88)2592
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigRecordReader.initNextRecordReader(PigRecordReader.java:256)
>
> Have copied the native lib folder accordingly, but facing issue. Is there
> any changes to do in hadoop conf or lib folder?
>
> Please help.
>
--
Bing Jiang
Focus on distributed computing, HDFS/HBase
Re: Hadoop2 LZO issue with pig
Posted by Bing Jiang <ji...@gmail.com>.
you need to register necessary jar which contains
com.twitter.elephantbird.mapreduce.input.MultiInputFormat.class ...
2014-03-08 18:00 GMT+08:00 Viswanathan J <ja...@gmail.com>:
> Hi,
>
> Getting this issue in hadoop 2.x with pig,
>
> java.lang.Exception: java.lang.RuntimeException: java.io.IOException: No
> codec for fileCaused by: java.io.IOException: No codec for file 2590 at
> com.twitter.elephantbird.mapreduce.input.MultiInputFormat.determineFileFormat(MultiInputFormat.java:176)2591
> at
> com.twitter.elephantbird.mapreduce.input.MultiInputFormat.createRecordReader(MultiInputFormat.java:88)2592
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigRecordReader.initNextRecordReader(PigRecordReader.java:256)
>
> Have copied the native lib folder accordingly, but facing issue. Is there
> any changes to do in hadoop conf or lib folder?
>
> Please help.
>
--
Bing Jiang
Focus on distributed computing, HDFS/HBase