You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-dev@hadoop.apache.org by Ravi Prakash <ra...@gmail.com> on 2011/09/23 17:37:17 UTC
Jobs not running after MAPREDUCE-2880
Hi Arun/Vinod,
After commit d4dca4eabf83a97d158f1e1caa4801020679d5e2
Date: Wed Sep 21 18:52:27 2011 +0000
MAPREDUCE-2880. svn merge -c r1173783 --ignore-ancestry ../../trunk/
git-svn-id:
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@117379213f79535-47bb-0310-9956-ffa450edef68
My mapreduce jobs are failing
2011-09-23 10:27:08,534 INFO ipc.HadoopYarnRPC
(HadoopYarnProtoRPC.java:getProxy(49)) - Creating a HadoopYarnProtoRpc proxy
for protocol interface org.apache.hadoop.mapreduce.v2.api.MRClientProtocol
2011-09-23 10:27:08,634 INFO mapreduce.Job
(Job.java:monitorAndPrintJob(1209)) - Running job: job_1316791524705_0002
2011-09-23 10:27:09,653 INFO mapreduce.Job
(Job.java:monitorAndPrintJob(1229)) - map 0% reduce 0%
2011-09-23 10:27:16,739 INFO mapreduce.Job
(Job.java:monitorAndPrintJob(1242)) - Job job_1316791524705_0002 failed with
state FAILED
2011-09-23 10:27:16,786 INFO mapreduce.Job
(Job.java:monitorAndPrintJob(1246)) - Counters: 0
Digging into the stderr logs: I see this single line
Exception in thread "main" java.lang.NoClassDefFoundError:
org/apache/hadoop/mapreduce/v2/app/MRAppMaster
What do I need to add to my environment / config so that the magic happens
again?
Thanks
Ravi.
Re: Jobs not running after MAPREDUCE-2880
Posted by Ravi Prakash <ra...@gmail.com>.
Thank Vinod,
Filed https://issues.apache.org/jira/browse/MAPREDUCE-3087
Regards
Ravi.
On Sun, Sep 25, 2011 at 9:51 AM, Vinod Kumar Vavilapalli <
vinodkv@hortonworks.com> wrote:
> Ravi, the mailing list gulps in any attachments. Can you create a ticket
> and
> attach your logs there? That helps for better tracking of the issue too.
>
> Thanks,
> +Vinod
>
>
> On Sat, Sep 24, 2011 at 1:09 AM, Ravi Prakash <ra...@gmail.com>
> wrote:
>
> > Hi Arun,
> >
> > Unsecure single node.
> >
> > I'm attaching the classpath I grepped | sort | uniq from the two task.sh
> > files I got (one from the working version and the other from the
> notworking
> > version). Looks like the classpath which worked had some other jars not
> > present in the new classpath.
> >
> > I'm guessing as part of the simplification for CLASSPATH maybe we missed
> > something that was being included earlier?
> >
> > Thanks
> > Ravi
> >
> >
> >
> > On Fri, Sep 23, 2011 at 12:18 PM, Arun Murthy <ac...@hortonworks.com>
> wrote:
> >
> >> This is secure mode or unsecured? Cluster or single node? Tx
> >>
> >> Sent from my iPhone
> >>
> >> On Sep 23, 2011, at 8:37 AM, Ravi Prakash <ra...@gmail.com> wrote:
> >>
> >> > Hi Arun/Vinod,
> >> >
> >> > After commit d4dca4eabf83a97d158f1e1caa4801020679d5e2
> >> > Date: Wed Sep 21 18:52:27 2011 +0000
> >> > MAPREDUCE-2880. svn merge -c r1173783 --ignore-ancestry ../../trunk/
> >> > git-svn-id:
> >> >
> >>
> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@117379213f79535-47bb-0310-9956-ffa450edef68
> >> >
> >> > My mapreduce jobs are failing
> >> > 2011-09-23 10:27:08,534 INFO ipc.HadoopYarnRPC
> >> > (HadoopYarnProtoRPC.java:getProxy(49)) - Creating a HadoopYarnProtoRpc
> >> proxy
> >> > for protocol interface
> >> org.apache.hadoop.mapreduce.v2.api.MRClientProtocol
> >> > 2011-09-23 10:27:08,634 INFO mapreduce.Job
> >> > (Job.java:monitorAndPrintJob(1209)) - Running job:
> >> job_1316791524705_0002
> >> > 2011-09-23 10:27:09,653 INFO mapreduce.Job
> >> > (Job.java:monitorAndPrintJob(1229)) - map 0% reduce 0%
> >> > 2011-09-23 10:27:16,739 INFO mapreduce.Job
> >> > (Job.java:monitorAndPrintJob(1242)) - Job job_1316791524705_0002
> failed
> >> with
> >> > state FAILED
> >> > 2011-09-23 10:27:16,786 INFO mapreduce.Job
> >> > (Job.java:monitorAndPrintJob(1246)) - Counters: 0
> >> >
> >> > Digging into the stderr logs: I see this single line
> >> > Exception in thread "main" java.lang.NoClassDefFoundError:
> >> > org/apache/hadoop/mapreduce/v2/app/MRAppMaster
> >> >
> >> > What do I need to add to my environment / config so that the magic
> >> happens
> >> > again?
> >> >
> >> > Thanks
> >> > Ravi.
> >>
> >
> >
>
Re: Jobs not running after MAPREDUCE-2880
Posted by Vinod Kumar Vavilapalli <vi...@hortonworks.com>.
Ravi, the mailing list gulps in any attachments. Can you create a ticket and
attach your logs there? That helps for better tracking of the issue too.
Thanks,
+Vinod
On Sat, Sep 24, 2011 at 1:09 AM, Ravi Prakash <ra...@gmail.com> wrote:
> Hi Arun,
>
> Unsecure single node.
>
> I'm attaching the classpath I grepped | sort | uniq from the two task.sh
> files I got (one from the working version and the other from the notworking
> version). Looks like the classpath which worked had some other jars not
> present in the new classpath.
>
> I'm guessing as part of the simplification for CLASSPATH maybe we missed
> something that was being included earlier?
>
> Thanks
> Ravi
>
>
>
> On Fri, Sep 23, 2011 at 12:18 PM, Arun Murthy <ac...@hortonworks.com> wrote:
>
>> This is secure mode or unsecured? Cluster or single node? Tx
>>
>> Sent from my iPhone
>>
>> On Sep 23, 2011, at 8:37 AM, Ravi Prakash <ra...@gmail.com> wrote:
>>
>> > Hi Arun/Vinod,
>> >
>> > After commit d4dca4eabf83a97d158f1e1caa4801020679d5e2
>> > Date: Wed Sep 21 18:52:27 2011 +0000
>> > MAPREDUCE-2880. svn merge -c r1173783 --ignore-ancestry ../../trunk/
>> > git-svn-id:
>> >
>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@117379213f79535-47bb-0310-9956-ffa450edef68
>> >
>> > My mapreduce jobs are failing
>> > 2011-09-23 10:27:08,534 INFO ipc.HadoopYarnRPC
>> > (HadoopYarnProtoRPC.java:getProxy(49)) - Creating a HadoopYarnProtoRpc
>> proxy
>> > for protocol interface
>> org.apache.hadoop.mapreduce.v2.api.MRClientProtocol
>> > 2011-09-23 10:27:08,634 INFO mapreduce.Job
>> > (Job.java:monitorAndPrintJob(1209)) - Running job:
>> job_1316791524705_0002
>> > 2011-09-23 10:27:09,653 INFO mapreduce.Job
>> > (Job.java:monitorAndPrintJob(1229)) - map 0% reduce 0%
>> > 2011-09-23 10:27:16,739 INFO mapreduce.Job
>> > (Job.java:monitorAndPrintJob(1242)) - Job job_1316791524705_0002 failed
>> with
>> > state FAILED
>> > 2011-09-23 10:27:16,786 INFO mapreduce.Job
>> > (Job.java:monitorAndPrintJob(1246)) - Counters: 0
>> >
>> > Digging into the stderr logs: I see this single line
>> > Exception in thread "main" java.lang.NoClassDefFoundError:
>> > org/apache/hadoop/mapreduce/v2/app/MRAppMaster
>> >
>> > What do I need to add to my environment / config so that the magic
>> happens
>> > again?
>> >
>> > Thanks
>> > Ravi.
>>
>
>
Re: Jobs not running after MAPREDUCE-2880
Posted by Ravi Prakash <ra...@gmail.com>.
Hi Arun,
Unsecure single node.
I'm attaching the classpath I grepped | sort | uniq from the two task.sh
files I got (one from the working version and the other from the notworking
version). Looks like the classpath which worked had some other jars not
present in the new classpath.
I'm guessing as part of the simplification for CLASSPATH maybe we missed
something that was being included earlier?
Thanks
Ravi
On Fri, Sep 23, 2011 at 12:18 PM, Arun Murthy <ac...@hortonworks.com> wrote:
> This is secure mode or unsecured? Cluster or single node? Tx
>
> Sent from my iPhone
>
> On Sep 23, 2011, at 8:37 AM, Ravi Prakash <ra...@gmail.com> wrote:
>
> > Hi Arun/Vinod,
> >
> > After commit d4dca4eabf83a97d158f1e1caa4801020679d5e2
> > Date: Wed Sep 21 18:52:27 2011 +0000
> > MAPREDUCE-2880. svn merge -c r1173783 --ignore-ancestry ../../trunk/
> > git-svn-id:
> >
> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@117379213f79535-47bb-0310-9956-ffa450edef68
> >
> > My mapreduce jobs are failing
> > 2011-09-23 10:27:08,534 INFO ipc.HadoopYarnRPC
> > (HadoopYarnProtoRPC.java:getProxy(49)) - Creating a HadoopYarnProtoRpc
> proxy
> > for protocol interface
> org.apache.hadoop.mapreduce.v2.api.MRClientProtocol
> > 2011-09-23 10:27:08,634 INFO mapreduce.Job
> > (Job.java:monitorAndPrintJob(1209)) - Running job: job_1316791524705_0002
> > 2011-09-23 10:27:09,653 INFO mapreduce.Job
> > (Job.java:monitorAndPrintJob(1229)) - map 0% reduce 0%
> > 2011-09-23 10:27:16,739 INFO mapreduce.Job
> > (Job.java:monitorAndPrintJob(1242)) - Job job_1316791524705_0002 failed
> with
> > state FAILED
> > 2011-09-23 10:27:16,786 INFO mapreduce.Job
> > (Job.java:monitorAndPrintJob(1246)) - Counters: 0
> >
> > Digging into the stderr logs: I see this single line
> > Exception in thread "main" java.lang.NoClassDefFoundError:
> > org/apache/hadoop/mapreduce/v2/app/MRAppMaster
> >
> > What do I need to add to my environment / config so that the magic
> happens
> > again?
> >
> > Thanks
> > Ravi.
>
Re: Jobs not running after MAPREDUCE-2880
Posted by Arun Murthy <ac...@hortonworks.com>.
This is secure mode or unsecured? Cluster or single node? Tx
Sent from my iPhone
On Sep 23, 2011, at 8:37 AM, Ravi Prakash <ra...@gmail.com> wrote:
> Hi Arun/Vinod,
>
> After commit d4dca4eabf83a97d158f1e1caa4801020679d5e2
> Date: Wed Sep 21 18:52:27 2011 +0000
> MAPREDUCE-2880. svn merge -c r1173783 --ignore-ancestry ../../trunk/
> git-svn-id:
> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@117379213f79535-47bb-0310-9956-ffa450edef68
>
> My mapreduce jobs are failing
> 2011-09-23 10:27:08,534 INFO ipc.HadoopYarnRPC
> (HadoopYarnProtoRPC.java:getProxy(49)) - Creating a HadoopYarnProtoRpc proxy
> for protocol interface org.apache.hadoop.mapreduce.v2.api.MRClientProtocol
> 2011-09-23 10:27:08,634 INFO mapreduce.Job
> (Job.java:monitorAndPrintJob(1209)) - Running job: job_1316791524705_0002
> 2011-09-23 10:27:09,653 INFO mapreduce.Job
> (Job.java:monitorAndPrintJob(1229)) - map 0% reduce 0%
> 2011-09-23 10:27:16,739 INFO mapreduce.Job
> (Job.java:monitorAndPrintJob(1242)) - Job job_1316791524705_0002 failed with
> state FAILED
> 2011-09-23 10:27:16,786 INFO mapreduce.Job
> (Job.java:monitorAndPrintJob(1246)) - Counters: 0
>
> Digging into the stderr logs: I see this single line
> Exception in thread "main" java.lang.NoClassDefFoundError:
> org/apache/hadoop/mapreduce/v2/app/MRAppMaster
>
> What do I need to add to my environment / config so that the magic happens
> again?
>
> Thanks
> Ravi.