You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@pig.apache.org by Bradford Stephens <br...@gmail.com> on 2011/09/28 02:26:15 UTC
"Compression Code Not Found" -- disabling on .7
Hello,
I've getting this error when running a pig job. I want to disable LZO
so it doesn't try to load and fail.
How do I do that?
This is a totally stock installation I did from downloading from the
Apache site.
Errors below:
2011-09-28 00:18:50,964 [main] INFO
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- 100% complete
2011-09-28 00:18:50,972 [main] ERROR
org.apache.pig.tools.pigstats.SimplePigStats - ERROR 2997: Unable to
recreate exception from backend error:
org.apache.pig.backend.executionengine.ExecException: ERROR 2118:
Compression codec com.hadoop.compression.lzo.LzoCodec not found.
2011-09-28 00:18:50,972 [main] ERROR
org.apache.pig.tools.pigstats.PigStatsUtil - 1 map reduce job(s)
failed!
rg.apache.pig.backend.executionengine.ExecException: ERROR 2118:
Compression codec com.hadoop.compression.lzo.LzoCodec not found.
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:281)
--
Bradford Stephens,
CEO and Founder, Drawn to Scale
http://drawntoscale.com
(530) 763-DATA
http://www.drawntoscale.com -- Spire, the "Heroku for Big Data"
Re: "Compression Code Not Found" -- disabling on .7
Posted by Neil Kodner <nk...@gmail.com>.
Have you tried adding
$HADOOP_HOME/lib/hadoop-lzo-*.jar to your PIG_CLASSPATH? I don't know if
that's the definitive solution but it's worked for me.
On Wed, Sep 28, 2011 at 3:42 PM, Dmitriy Ryaboy <dv...@gmail.com> wrote:
> Pig doesn't know anything about lzo off the bat. So you aren't using a
> stock
> installation (is your hadoop conf referencing lzo?)
>
> The pig script you are running would help us debug your pig script.
>
> D
>
> On Tue, Sep 27, 2011 at 5:31 PM, Bradford Stephens <
> bradfordstephens@gmail.com> wrote:
>
> > Actually, I'm using .9
> >
> > On Tue, Sep 27, 2011 at 5:26 PM, Bradford Stephens
> > <br...@gmail.com> wrote:
> > > Hello,
> > >
> > > I've getting this error when running a pig job. I want to disable LZO
> > > so it doesn't try to load and fail.
> > >
> > > How do I do that?
> > >
> > > This is a totally stock installation I did from downloading from the
> > > Apache site.
> > >
> > > Errors below:
> > >
> > > 2011-09-28 00:18:50,964 [main] INFO
> > >
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
> > > - 100% complete
> > > 2011-09-28 00:18:50,972 [main] ERROR
> > > org.apache.pig.tools.pigstats.SimplePigStats - ERROR 2997: Unable to
> > > recreate exception from backend error:
> > > org.apache.pig.backend.executionengine.ExecException: ERROR 2118:
> > > Compression codec com.hadoop.compression.lzo.LzoCodec not found.
> > > 2011-09-28 00:18:50,972 [main] ERROR
> > > org.apache.pig.tools.pigstats.PigStatsUtil - 1 map reduce job(s)
> > > failed!
> > >
> > > rg.apache.pig.backend.executionengine.ExecException: ERROR 2118:
> > > Compression codec com.hadoop.compression.lzo.LzoCodec not found.
> > > at
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:281)
> > >
> > > --
> > > Bradford Stephens,
> > > CEO and Founder, Drawn to Scale
> > > http://drawntoscale.com
> > > (530) 763-DATA
> > >
> > > http://www.drawntoscale.com -- Spire, the "Heroku for Big Data"
> > >
> >
> >
> >
> > --
> > Bradford Stephens,
> > CEO and Founder, Drawn to Scale
> > http://drawntoscale.com
> > (530) 763-DATA
> >
> > http://www.drawntoscale.com -- Spire, the "Heroku for Big Data"
> >
>
Re: "Compression Code Not Found" -- disabling on .7
Posted by Dmitriy Ryaboy <dv...@gmail.com>.
Pig doesn't know anything about lzo off the bat. So you aren't using a stock
installation (is your hadoop conf referencing lzo?)
The pig script you are running would help us debug your pig script.
D
On Tue, Sep 27, 2011 at 5:31 PM, Bradford Stephens <
bradfordstephens@gmail.com> wrote:
> Actually, I'm using .9
>
> On Tue, Sep 27, 2011 at 5:26 PM, Bradford Stephens
> <br...@gmail.com> wrote:
> > Hello,
> >
> > I've getting this error when running a pig job. I want to disable LZO
> > so it doesn't try to load and fail.
> >
> > How do I do that?
> >
> > This is a totally stock installation I did from downloading from the
> > Apache site.
> >
> > Errors below:
> >
> > 2011-09-28 00:18:50,964 [main] INFO
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
> > - 100% complete
> > 2011-09-28 00:18:50,972 [main] ERROR
> > org.apache.pig.tools.pigstats.SimplePigStats - ERROR 2997: Unable to
> > recreate exception from backend error:
> > org.apache.pig.backend.executionengine.ExecException: ERROR 2118:
> > Compression codec com.hadoop.compression.lzo.LzoCodec not found.
> > 2011-09-28 00:18:50,972 [main] ERROR
> > org.apache.pig.tools.pigstats.PigStatsUtil - 1 map reduce job(s)
> > failed!
> >
> > rg.apache.pig.backend.executionengine.ExecException: ERROR 2118:
> > Compression codec com.hadoop.compression.lzo.LzoCodec not found.
> > at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:281)
> >
> > --
> > Bradford Stephens,
> > CEO and Founder, Drawn to Scale
> > http://drawntoscale.com
> > (530) 763-DATA
> >
> > http://www.drawntoscale.com -- Spire, the "Heroku for Big Data"
> >
>
>
>
> --
> Bradford Stephens,
> CEO and Founder, Drawn to Scale
> http://drawntoscale.com
> (530) 763-DATA
>
> http://www.drawntoscale.com -- Spire, the "Heroku for Big Data"
>
Re: "Compression Code Not Found" -- disabling on .7
Posted by Bradford Stephens <br...@gmail.com>.
Actually, I'm using .9
On Tue, Sep 27, 2011 at 5:26 PM, Bradford Stephens
<br...@gmail.com> wrote:
> Hello,
>
> I've getting this error when running a pig job. I want to disable LZO
> so it doesn't try to load and fail.
>
> How do I do that?
>
> This is a totally stock installation I did from downloading from the
> Apache site.
>
> Errors below:
>
> 2011-09-28 00:18:50,964 [main] INFO
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
> - 100% complete
> 2011-09-28 00:18:50,972 [main] ERROR
> org.apache.pig.tools.pigstats.SimplePigStats - ERROR 2997: Unable to
> recreate exception from backend error:
> org.apache.pig.backend.executionengine.ExecException: ERROR 2118:
> Compression codec com.hadoop.compression.lzo.LzoCodec not found.
> 2011-09-28 00:18:50,972 [main] ERROR
> org.apache.pig.tools.pigstats.PigStatsUtil - 1 map reduce job(s)
> failed!
>
> rg.apache.pig.backend.executionengine.ExecException: ERROR 2118:
> Compression codec com.hadoop.compression.lzo.LzoCodec not found.
> at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:281)
>
> --
> Bradford Stephens,
> CEO and Founder, Drawn to Scale
> http://drawntoscale.com
> (530) 763-DATA
>
> http://www.drawntoscale.com -- Spire, the "Heroku for Big Data"
>
--
Bradford Stephens,
CEO and Founder, Drawn to Scale
http://drawntoscale.com
(530) 763-DATA
http://www.drawntoscale.com -- Spire, the "Heroku for Big Data"