You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@pig.apache.org by Adinath Kamode <ad...@gmail.com> on 2018/04/27 10:48:53 UTC
Pig Error : Could not find or load main class 1600 Error
Hello All,
I have configured Pig 0.17 as well as 0.16 on Hadoop 2.6 till 3.0 , but
everytime getting error "Could not find or load main class 1600 error" even
for simple DUmp command. I enabled DEBUG level logging but could not
figure out what 1600 mean. Nothing there on Net.
Setup works fine on LOCAL mode.
This is Ubuntu machine with Java 8.
Please help.
Thanks,
Adinath
Re: Pig Error : Could not find or load main class 1600 Error
Posted by Koji Noguchi <kn...@oath.com.INVALID>.
Hi Adinath,
Maybe your cluster is misconfigured with bad mapred-site.xml.
Can you try adding
set mapreduce.map.java.opts -Xmx1024m
set mapreduce.reduce.java.opts -Xmx1024m
in your pig script? If that doesn't work, let's take this offline.
Please reply to me and Adam.
Koji
On Wed, May 2, 2018 at 7:49 AM, Adam Szita <sz...@cloudera.com> wrote:
> You can also make the pig launch script echo out all the supplied options
> it would start the JVM with by using:
>
> pig -printCmdDebug
>
> Adam
>
> On 2 May 2018 at 13:34, Adinath Kamode <ad...@gmail.com> wrote:
>
> > Hello Koji,
> > I am not passing anything explicitly to PIG_OPTS. I echoed values of
> > PIG_OPTS. Below is output.
> >
> > [ADINATH] Java Home is /usr/lib/jvm/java-8-oracle
> > [ADINATH] HADOOP HOME /home/adinath/hadoop/hadoop-3.0.0
> > [ADINATH HADOOP_PREFIX /home/adinath/hadoop/hadoop-3.0.0
> > [ADINATH] PIG_OPTS are :
> > -Dpig.log.dir=/home/adinath/hadoop/pig-0.17.0/logs
> -Dpig.log.file=pig.log
> > -Dpig.home.dir=/home/adinath/hadoop/pig-0.17.0
> >
> > Steps to produce issue :
> > 1. Put sample Text File to HDFS, Confirmed that file is available and
> > accessible using hadoop command.
> > 2. adinath = load '/pig/student.txt' as (roll: chararray);
> > 3. Dump adinath;
> >
> > That's all.
> >
> > student.txt is as below.
> > Adinath
> > Sonali
> > Ramesh
> > John
> >
> >
> >
> >
> > On Tue, May 1, 2018 at 9:01 PM, Koji Noguchi <kn...@oath.com.invalid>
> > wrote:
> >
> > > Hi Adinath,
> > >
> > > It seems like you're passing invalid jvm options. (most likely with
> > space)
> > > Can you share your script or PIG_OPTS where you may be setting the jvm
> > > options for the tasks?
> > >
> > > Koji
> > >
> > >
> > > On Mon, Apr 30, 2018 at 2:59 AM, Adinath Kamode <
> > adinath.kamode@gmail.com>
> > > wrote:
> > >
> > > >
> > > > ---------- Forwarded message ----------
> > > > From: Adinath Kamode <ad...@gmail.com>
> > > > Date: Mon, Apr 30, 2018 at 12:17 PM
> > > > Subject: Re: Pig Error : Could not find or load main class 1600 Error
> > > > To:
> > > >
> > > > user@pig.apache.org
> > > >
> > > >
> > > > Thanks Koji,
> > > > I am attaching screenshot of error as well as steps to reproduce this
> > > > issue. It is simple Dump command, I am running.
> > > > Attaching all logs.
> > > >
> > > > On Sat, Apr 28, 2018 at 1:27 AM, Koji Noguchi
> > <knoguchi@oath.com.invalid
> > > >
> > > > wrote:
> > > >
> > > >> Hi Adinath,
> > > >>
> > > >> Anything set inside PIG_OPTS?
> > > >> If not, I'll need detail steps to reproduce your error.
> > > >>
> > > >> Koji
> > > >>
> > > >> On Fri, Apr 27, 2018 at 6:48 AM, Adinath Kamode <
> > > adinath.kamode@gmail.com
> > > >> >
> > > >> wrote:
> > > >>
> > > >> > Hello All,
> > > >> > I have configured Pig 0.17 as well as 0.16 on Hadoop 2.6 till 3.0
> ,
> > > but
> > > >> > everytime getting error "Could not find or load main class 1600
> > error"
> > > >> even
> > > >> > for simple DUmp command. I enabled DEBUG level logging but could
> > not
> > > >> > figure out what 1600 mean. Nothing there on Net.
> > > >> > Setup works fine on LOCAL mode.
> > > >> > This is Ubuntu machine with Java 8.
> > > >> >
> > > >> > Please help.
> > > >> >
> > > >> > Thanks,
> > > >> > Adinath
> > > >> >
> > > >>
> > > >
> > > >
> > > >
> > >
> >
>
Re: Pig Error : Could not find or load main class 1600 Error
Posted by Adam Szita <sz...@cloudera.com>.
You can also make the pig launch script echo out all the supplied options
it would start the JVM with by using:
pig -printCmdDebug
Adam
On 2 May 2018 at 13:34, Adinath Kamode <ad...@gmail.com> wrote:
> Hello Koji,
> I am not passing anything explicitly to PIG_OPTS. I echoed values of
> PIG_OPTS. Below is output.
>
> [ADINATH] Java Home is /usr/lib/jvm/java-8-oracle
> [ADINATH] HADOOP HOME /home/adinath/hadoop/hadoop-3.0.0
> [ADINATH HADOOP_PREFIX /home/adinath/hadoop/hadoop-3.0.0
> [ADINATH] PIG_OPTS are :
> -Dpig.log.dir=/home/adinath/hadoop/pig-0.17.0/logs -Dpig.log.file=pig.log
> -Dpig.home.dir=/home/adinath/hadoop/pig-0.17.0
>
> Steps to produce issue :
> 1. Put sample Text File to HDFS, Confirmed that file is available and
> accessible using hadoop command.
> 2. adinath = load '/pig/student.txt' as (roll: chararray);
> 3. Dump adinath;
>
> That's all.
>
> student.txt is as below.
> Adinath
> Sonali
> Ramesh
> John
>
>
>
>
> On Tue, May 1, 2018 at 9:01 PM, Koji Noguchi <kn...@oath.com.invalid>
> wrote:
>
> > Hi Adinath,
> >
> > It seems like you're passing invalid jvm options. (most likely with
> space)
> > Can you share your script or PIG_OPTS where you may be setting the jvm
> > options for the tasks?
> >
> > Koji
> >
> >
> > On Mon, Apr 30, 2018 at 2:59 AM, Adinath Kamode <
> adinath.kamode@gmail.com>
> > wrote:
> >
> > >
> > > ---------- Forwarded message ----------
> > > From: Adinath Kamode <ad...@gmail.com>
> > > Date: Mon, Apr 30, 2018 at 12:17 PM
> > > Subject: Re: Pig Error : Could not find or load main class 1600 Error
> > > To:
> > >
> > > user@pig.apache.org
> > >
> > >
> > > Thanks Koji,
> > > I am attaching screenshot of error as well as steps to reproduce this
> > > issue. It is simple Dump command, I am running.
> > > Attaching all logs.
> > >
> > > On Sat, Apr 28, 2018 at 1:27 AM, Koji Noguchi
> <knoguchi@oath.com.invalid
> > >
> > > wrote:
> > >
> > >> Hi Adinath,
> > >>
> > >> Anything set inside PIG_OPTS?
> > >> If not, I'll need detail steps to reproduce your error.
> > >>
> > >> Koji
> > >>
> > >> On Fri, Apr 27, 2018 at 6:48 AM, Adinath Kamode <
> > adinath.kamode@gmail.com
> > >> >
> > >> wrote:
> > >>
> > >> > Hello All,
> > >> > I have configured Pig 0.17 as well as 0.16 on Hadoop 2.6 till 3.0 ,
> > but
> > >> > everytime getting error "Could not find or load main class 1600
> error"
> > >> even
> > >> > for simple DUmp command. I enabled DEBUG level logging but could
> not
> > >> > figure out what 1600 mean. Nothing there on Net.
> > >> > Setup works fine on LOCAL mode.
> > >> > This is Ubuntu machine with Java 8.
> > >> >
> > >> > Please help.
> > >> >
> > >> > Thanks,
> > >> > Adinath
> > >> >
> > >>
> > >
> > >
> > >
> >
>
Re: Pig Error : Could not find or load main class 1600 Error
Posted by Adinath Kamode <ad...@gmail.com>.
Hello Koji,
I am not passing anything explicitly to PIG_OPTS. I echoed values of
PIG_OPTS. Below is output.
[ADINATH] Java Home is /usr/lib/jvm/java-8-oracle
[ADINATH] HADOOP HOME /home/adinath/hadoop/hadoop-3.0.0
[ADINATH HADOOP_PREFIX /home/adinath/hadoop/hadoop-3.0.0
[ADINATH] PIG_OPTS are :
-Dpig.log.dir=/home/adinath/hadoop/pig-0.17.0/logs -Dpig.log.file=pig.log
-Dpig.home.dir=/home/adinath/hadoop/pig-0.17.0
Steps to produce issue :
1. Put sample Text File to HDFS, Confirmed that file is available and
accessible using hadoop command.
2. adinath = load '/pig/student.txt' as (roll: chararray);
3. Dump adinath;
That's all.
student.txt is as below.
Adinath
Sonali
Ramesh
John
On Tue, May 1, 2018 at 9:01 PM, Koji Noguchi <kn...@oath.com.invalid>
wrote:
> Hi Adinath,
>
> It seems like you're passing invalid jvm options. (most likely with space)
> Can you share your script or PIG_OPTS where you may be setting the jvm
> options for the tasks?
>
> Koji
>
>
> On Mon, Apr 30, 2018 at 2:59 AM, Adinath Kamode <ad...@gmail.com>
> wrote:
>
> >
> > ---------- Forwarded message ----------
> > From: Adinath Kamode <ad...@gmail.com>
> > Date: Mon, Apr 30, 2018 at 12:17 PM
> > Subject: Re: Pig Error : Could not find or load main class 1600 Error
> > To:
> >
> > user@pig.apache.org
> >
> >
> > Thanks Koji,
> > I am attaching screenshot of error as well as steps to reproduce this
> > issue. It is simple Dump command, I am running.
> > Attaching all logs.
> >
> > On Sat, Apr 28, 2018 at 1:27 AM, Koji Noguchi <knoguchi@oath.com.invalid
> >
> > wrote:
> >
> >> Hi Adinath,
> >>
> >> Anything set inside PIG_OPTS?
> >> If not, I'll need detail steps to reproduce your error.
> >>
> >> Koji
> >>
> >> On Fri, Apr 27, 2018 at 6:48 AM, Adinath Kamode <
> adinath.kamode@gmail.com
> >> >
> >> wrote:
> >>
> >> > Hello All,
> >> > I have configured Pig 0.17 as well as 0.16 on Hadoop 2.6 till 3.0 ,
> but
> >> > everytime getting error "Could not find or load main class 1600 error"
> >> even
> >> > for simple DUmp command. I enabled DEBUG level logging but could not
> >> > figure out what 1600 mean. Nothing there on Net.
> >> > Setup works fine on LOCAL mode.
> >> > This is Ubuntu machine with Java 8.
> >> >
> >> > Please help.
> >> >
> >> > Thanks,
> >> > Adinath
> >> >
> >>
> >
> >
> >
>
Re: Pig Error : Could not find or load main class 1600 Error
Posted by Koji Noguchi <kn...@oath.com.INVALID>.
Hi Adinath,
It seems like you're passing invalid jvm options. (most likely with space)
Can you share your script or PIG_OPTS where you may be setting the jvm
options for the tasks?
Koji
On Mon, Apr 30, 2018 at 2:59 AM, Adinath Kamode <ad...@gmail.com>
wrote:
>
> ---------- Forwarded message ----------
> From: Adinath Kamode <ad...@gmail.com>
> Date: Mon, Apr 30, 2018 at 12:17 PM
> Subject: Re: Pig Error : Could not find or load main class 1600 Error
> To:
>
> user@pig.apache.org
>
>
> Thanks Koji,
> I am attaching screenshot of error as well as steps to reproduce this
> issue. It is simple Dump command, I am running.
> Attaching all logs.
>
> On Sat, Apr 28, 2018 at 1:27 AM, Koji Noguchi <kn...@oath.com.invalid>
> wrote:
>
>> Hi Adinath,
>>
>> Anything set inside PIG_OPTS?
>> If not, I'll need detail steps to reproduce your error.
>>
>> Koji
>>
>> On Fri, Apr 27, 2018 at 6:48 AM, Adinath Kamode <adinath.kamode@gmail.com
>> >
>> wrote:
>>
>> > Hello All,
>> > I have configured Pig 0.17 as well as 0.16 on Hadoop 2.6 till 3.0 , but
>> > everytime getting error "Could not find or load main class 1600 error"
>> even
>> > for simple DUmp command. I enabled DEBUG level logging but could not
>> > figure out what 1600 mean. Nothing there on Net.
>> > Setup works fine on LOCAL mode.
>> > This is Ubuntu machine with Java 8.
>> >
>> > Please help.
>> >
>> > Thanks,
>> > Adinath
>> >
>>
>
>
>
Fwd: Pig Error : Could not find or load main class 1600 Error
Posted by Adinath Kamode <ad...@gmail.com>.
---------- Forwarded message ----------
From: Adinath Kamode <ad...@gmail.com>
Date: Mon, Apr 30, 2018 at 12:17 PM
Subject: Re: Pig Error : Could not find or load main class 1600 Error
To:
user@pig.apache.org
Thanks Koji,
I am attaching screenshot of error as well as steps to reproduce this
issue. It is simple Dump command, I am running.
Attaching all logs.
On Sat, Apr 28, 2018 at 1:27 AM, Koji Noguchi <kn...@oath.com.invalid>
wrote:
> Hi Adinath,
>
> Anything set inside PIG_OPTS?
> If not, I'll need detail steps to reproduce your error.
>
> Koji
>
> On Fri, Apr 27, 2018 at 6:48 AM, Adinath Kamode <ad...@gmail.com>
> wrote:
>
> > Hello All,
> > I have configured Pig 0.17 as well as 0.16 on Hadoop 2.6 till 3.0 , but
> > everytime getting error "Could not find or load main class 1600 error"
> even
> > for simple DUmp command. I enabled DEBUG level logging but could not
> > figure out what 1600 mean. Nothing there on Net.
> > Setup works fine on LOCAL mode.
> > This is Ubuntu machine with Java 8.
> >
> > Please help.
> >
> > Thanks,
> > Adinath
> >
>
Re: Pig Error : Could not find or load main class 1600 Error
Posted by Koji Noguchi <kn...@oath.com.INVALID>.
Hi Adinath,
Anything set inside PIG_OPTS?
If not, I'll need detail steps to reproduce your error.
Koji
On Fri, Apr 27, 2018 at 6:48 AM, Adinath Kamode <ad...@gmail.com>
wrote:
> Hello All,
> I have configured Pig 0.17 as well as 0.16 on Hadoop 2.6 till 3.0 , but
> everytime getting error "Could not find or load main class 1600 error" even
> for simple DUmp command. I enabled DEBUG level logging but could not
> figure out what 1600 mean. Nothing there on Net.
> Setup works fine on LOCAL mode.
> This is Ubuntu machine with Java 8.
>
> Please help.
>
> Thanks,
> Adinath
>