You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@pig.apache.org by Koji Noguchi <kn...@oath.com.INVALID> on 2018/05/01 15:31:13 UTC
Re: Pig Error : Could not find or load main class 1600 Error
Hi Adinath,
It seems like you're passing invalid jvm options. (most likely with space)
Can you share your script or PIG_OPTS where you may be setting the jvm
options for the tasks?
Koji
On Mon, Apr 30, 2018 at 2:59 AM, Adinath Kamode <ad...@gmail.com>
wrote:
>
> ---------- Forwarded message ----------
> From: Adinath Kamode <ad...@gmail.com>
> Date: Mon, Apr 30, 2018 at 12:17 PM
> Subject: Re: Pig Error : Could not find or load main class 1600 Error
> To:
>
> user@pig.apache.org
>
>
> Thanks Koji,
> I am attaching screenshot of error as well as steps to reproduce this
> issue. It is simple Dump command, I am running.
> Attaching all logs.
>
> On Sat, Apr 28, 2018 at 1:27 AM, Koji Noguchi <kn...@oath.com.invalid>
> wrote:
>
>> Hi Adinath,
>>
>> Anything set inside PIG_OPTS?
>> If not, I'll need detail steps to reproduce your error.
>>
>> Koji
>>
>> On Fri, Apr 27, 2018 at 6:48 AM, Adinath Kamode <adinath.kamode@gmail.com
>> >
>> wrote:
>>
>> > Hello All,
>> > I have configured Pig 0.17 as well as 0.16 on Hadoop 2.6 till 3.0 , but
>> > everytime getting error "Could not find or load main class 1600 error"
>> even
>> > for simple DUmp command. I enabled DEBUG level logging but could not
>> > figure out what 1600 mean. Nothing there on Net.
>> > Setup works fine on LOCAL mode.
>> > This is Ubuntu machine with Java 8.
>> >
>> > Please help.
>> >
>> > Thanks,
>> > Adinath
>> >
>>
>
>
>
Re: Pig Error : Could not find or load main class 1600 Error
Posted by Koji Noguchi <kn...@oath.com.INVALID>.
Hi Adinath,
Maybe your cluster is misconfigured with bad mapred-site.xml.
Can you try adding
set mapreduce.map.java.opts -Xmx1024m
set mapreduce.reduce.java.opts -Xmx1024m
in your pig script? If that doesn't work, let's take this offline.
Please reply to me and Adam.
Koji
On Wed, May 2, 2018 at 7:49 AM, Adam Szita <sz...@cloudera.com> wrote:
> You can also make the pig launch script echo out all the supplied options
> it would start the JVM with by using:
>
> pig -printCmdDebug
>
> Adam
>
> On 2 May 2018 at 13:34, Adinath Kamode <ad...@gmail.com> wrote:
>
> > Hello Koji,
> > I am not passing anything explicitly to PIG_OPTS. I echoed values of
> > PIG_OPTS. Below is output.
> >
> > [ADINATH] Java Home is /usr/lib/jvm/java-8-oracle
> > [ADINATH] HADOOP HOME /home/adinath/hadoop/hadoop-3.0.0
> > [ADINATH HADOOP_PREFIX /home/adinath/hadoop/hadoop-3.0.0
> > [ADINATH] PIG_OPTS are :
> > -Dpig.log.dir=/home/adinath/hadoop/pig-0.17.0/logs
> -Dpig.log.file=pig.log
> > -Dpig.home.dir=/home/adinath/hadoop/pig-0.17.0
> >
> > Steps to produce issue :
> > 1. Put sample Text File to HDFS, Confirmed that file is available and
> > accessible using hadoop command.
> > 2. adinath = load '/pig/student.txt' as (roll: chararray);
> > 3. Dump adinath;
> >
> > That's all.
> >
> > student.txt is as below.
> > Adinath
> > Sonali
> > Ramesh
> > John
> >
> >
> >
> >
> > On Tue, May 1, 2018 at 9:01 PM, Koji Noguchi <kn...@oath.com.invalid>
> > wrote:
> >
> > > Hi Adinath,
> > >
> > > It seems like you're passing invalid jvm options. (most likely with
> > space)
> > > Can you share your script or PIG_OPTS where you may be setting the jvm
> > > options for the tasks?
> > >
> > > Koji
> > >
> > >
> > > On Mon, Apr 30, 2018 at 2:59 AM, Adinath Kamode <
> > adinath.kamode@gmail.com>
> > > wrote:
> > >
> > > >
> > > > ---------- Forwarded message ----------
> > > > From: Adinath Kamode <ad...@gmail.com>
> > > > Date: Mon, Apr 30, 2018 at 12:17 PM
> > > > Subject: Re: Pig Error : Could not find or load main class 1600 Error
> > > > To:
> > > >
> > > > user@pig.apache.org
> > > >
> > > >
> > > > Thanks Koji,
> > > > I am attaching screenshot of error as well as steps to reproduce this
> > > > issue. It is simple Dump command, I am running.
> > > > Attaching all logs.
> > > >
> > > > On Sat, Apr 28, 2018 at 1:27 AM, Koji Noguchi
> > <knoguchi@oath.com.invalid
> > > >
> > > > wrote:
> > > >
> > > >> Hi Adinath,
> > > >>
> > > >> Anything set inside PIG_OPTS?
> > > >> If not, I'll need detail steps to reproduce your error.
> > > >>
> > > >> Koji
> > > >>
> > > >> On Fri, Apr 27, 2018 at 6:48 AM, Adinath Kamode <
> > > adinath.kamode@gmail.com
> > > >> >
> > > >> wrote:
> > > >>
> > > >> > Hello All,
> > > >> > I have configured Pig 0.17 as well as 0.16 on Hadoop 2.6 till 3.0
> ,
> > > but
> > > >> > everytime getting error "Could not find or load main class 1600
> > error"
> > > >> even
> > > >> > for simple DUmp command. I enabled DEBUG level logging but could
> > not
> > > >> > figure out what 1600 mean. Nothing there on Net.
> > > >> > Setup works fine on LOCAL mode.
> > > >> > This is Ubuntu machine with Java 8.
> > > >> >
> > > >> > Please help.
> > > >> >
> > > >> > Thanks,
> > > >> > Adinath
> > > >> >
> > > >>
> > > >
> > > >
> > > >
> > >
> >
>
Re: Pig Error : Could not find or load main class 1600 Error
Posted by Adam Szita <sz...@cloudera.com>.
You can also make the pig launch script echo out all the supplied options
it would start the JVM with by using:
pig -printCmdDebug
Adam
On 2 May 2018 at 13:34, Adinath Kamode <ad...@gmail.com> wrote:
> Hello Koji,
> I am not passing anything explicitly to PIG_OPTS. I echoed values of
> PIG_OPTS. Below is output.
>
> [ADINATH] Java Home is /usr/lib/jvm/java-8-oracle
> [ADINATH] HADOOP HOME /home/adinath/hadoop/hadoop-3.0.0
> [ADINATH HADOOP_PREFIX /home/adinath/hadoop/hadoop-3.0.0
> [ADINATH] PIG_OPTS are :
> -Dpig.log.dir=/home/adinath/hadoop/pig-0.17.0/logs -Dpig.log.file=pig.log
> -Dpig.home.dir=/home/adinath/hadoop/pig-0.17.0
>
> Steps to produce issue :
> 1. Put sample Text File to HDFS, Confirmed that file is available and
> accessible using hadoop command.
> 2. adinath = load '/pig/student.txt' as (roll: chararray);
> 3. Dump adinath;
>
> That's all.
>
> student.txt is as below.
> Adinath
> Sonali
> Ramesh
> John
>
>
>
>
> On Tue, May 1, 2018 at 9:01 PM, Koji Noguchi <kn...@oath.com.invalid>
> wrote:
>
> > Hi Adinath,
> >
> > It seems like you're passing invalid jvm options. (most likely with
> space)
> > Can you share your script or PIG_OPTS where you may be setting the jvm
> > options for the tasks?
> >
> > Koji
> >
> >
> > On Mon, Apr 30, 2018 at 2:59 AM, Adinath Kamode <
> adinath.kamode@gmail.com>
> > wrote:
> >
> > >
> > > ---------- Forwarded message ----------
> > > From: Adinath Kamode <ad...@gmail.com>
> > > Date: Mon, Apr 30, 2018 at 12:17 PM
> > > Subject: Re: Pig Error : Could not find or load main class 1600 Error
> > > To:
> > >
> > > user@pig.apache.org
> > >
> > >
> > > Thanks Koji,
> > > I am attaching screenshot of error as well as steps to reproduce this
> > > issue. It is simple Dump command, I am running.
> > > Attaching all logs.
> > >
> > > On Sat, Apr 28, 2018 at 1:27 AM, Koji Noguchi
> <knoguchi@oath.com.invalid
> > >
> > > wrote:
> > >
> > >> Hi Adinath,
> > >>
> > >> Anything set inside PIG_OPTS?
> > >> If not, I'll need detail steps to reproduce your error.
> > >>
> > >> Koji
> > >>
> > >> On Fri, Apr 27, 2018 at 6:48 AM, Adinath Kamode <
> > adinath.kamode@gmail.com
> > >> >
> > >> wrote:
> > >>
> > >> > Hello All,
> > >> > I have configured Pig 0.17 as well as 0.16 on Hadoop 2.6 till 3.0 ,
> > but
> > >> > everytime getting error "Could not find or load main class 1600
> error"
> > >> even
> > >> > for simple DUmp command. I enabled DEBUG level logging but could
> not
> > >> > figure out what 1600 mean. Nothing there on Net.
> > >> > Setup works fine on LOCAL mode.
> > >> > This is Ubuntu machine with Java 8.
> > >> >
> > >> > Please help.
> > >> >
> > >> > Thanks,
> > >> > Adinath
> > >> >
> > >>
> > >
> > >
> > >
> >
>
Re: Pig Error : Could not find or load main class 1600 Error
Posted by Adinath Kamode <ad...@gmail.com>.
Hello Koji,
I am not passing anything explicitly to PIG_OPTS. I echoed values of
PIG_OPTS. Below is output.
[ADINATH] Java Home is /usr/lib/jvm/java-8-oracle
[ADINATH] HADOOP HOME /home/adinath/hadoop/hadoop-3.0.0
[ADINATH HADOOP_PREFIX /home/adinath/hadoop/hadoop-3.0.0
[ADINATH] PIG_OPTS are :
-Dpig.log.dir=/home/adinath/hadoop/pig-0.17.0/logs -Dpig.log.file=pig.log
-Dpig.home.dir=/home/adinath/hadoop/pig-0.17.0
Steps to produce issue :
1. Put sample Text File to HDFS, Confirmed that file is available and
accessible using hadoop command.
2. adinath = load '/pig/student.txt' as (roll: chararray);
3. Dump adinath;
That's all.
student.txt is as below.
Adinath
Sonali
Ramesh
John
On Tue, May 1, 2018 at 9:01 PM, Koji Noguchi <kn...@oath.com.invalid>
wrote:
> Hi Adinath,
>
> It seems like you're passing invalid jvm options. (most likely with space)
> Can you share your script or PIG_OPTS where you may be setting the jvm
> options for the tasks?
>
> Koji
>
>
> On Mon, Apr 30, 2018 at 2:59 AM, Adinath Kamode <ad...@gmail.com>
> wrote:
>
> >
> > ---------- Forwarded message ----------
> > From: Adinath Kamode <ad...@gmail.com>
> > Date: Mon, Apr 30, 2018 at 12:17 PM
> > Subject: Re: Pig Error : Could not find or load main class 1600 Error
> > To:
> >
> > user@pig.apache.org
> >
> >
> > Thanks Koji,
> > I am attaching screenshot of error as well as steps to reproduce this
> > issue. It is simple Dump command, I am running.
> > Attaching all logs.
> >
> > On Sat, Apr 28, 2018 at 1:27 AM, Koji Noguchi <knoguchi@oath.com.invalid
> >
> > wrote:
> >
> >> Hi Adinath,
> >>
> >> Anything set inside PIG_OPTS?
> >> If not, I'll need detail steps to reproduce your error.
> >>
> >> Koji
> >>
> >> On Fri, Apr 27, 2018 at 6:48 AM, Adinath Kamode <
> adinath.kamode@gmail.com
> >> >
> >> wrote:
> >>
> >> > Hello All,
> >> > I have configured Pig 0.17 as well as 0.16 on Hadoop 2.6 till 3.0 ,
> but
> >> > everytime getting error "Could not find or load main class 1600 error"
> >> even
> >> > for simple DUmp command. I enabled DEBUG level logging but could not
> >> > figure out what 1600 mean. Nothing there on Net.
> >> > Setup works fine on LOCAL mode.
> >> > This is Ubuntu machine with Java 8.
> >> >
> >> > Please help.
> >> >
> >> > Thanks,
> >> > Adinath
> >> >
> >>
> >
> >
> >
>