You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Arun C Murthy <ac...@hortonworks.com> on 2011/12/09 08:14:58 UTC
Re: Not able to post a job in Hadoop 0.23.0
Moving to mapreduce-user@, bcc common-user@.
Can you see any errors in the logs? Typically this happens when you have no NodeManagers.
Check the 'nodes' link and then RM logs.
Arun
On Nov 29, 2011, at 8:36 PM, Nitin Khandelwal wrote:
> HI ,
>
> I have successfully setup Hadoop 0.23.0 in a single m/c. When i post a job,
> it gets posted successfully (i can see the job in UI), but the job is never
> "ASSIGNED" and waits forever.
> Here are details of what i see for that Job in UI
>
>
> Name: random-writer State: ACCEPTED FinalStatus: UNDEFINED
> Started: 30-Nov-2011
> 10:08:55 Elapsed: 49sec Tracking URL:
> UNASSIGNED<http://192.168.0.93:8900/cluster/app/application_1322627869620_0001#>
> Diagnostics:
> AM container logs: AM not yet registered with RM Cluster ID: 1322627869620
> ResourceManager state: STARTED ResourceManager started on: 30-Nov-2011
> 10:07:49 ResourceManager version: 0.23.0 from
> 722cd694fc4ab6d040c0a34f9fb5b476e330ee60 by hortonmu source checksum
> 4975bf112aa7faa5673f604045ced798 on Thu Nov 3 09:07:31 UTC 2011 Hadoop
> version: 0.23.0 from d4fee83ec1462ab9824add6449320617caa7c605 by hortonmu
> source checksum 4e42b2d96c899a98a8ab8c7cc23f27ae on Thu Nov 3 08:59:12 UTC
> 2011
> Can some one tell where am i going wrong??
>
> Thanks,
> --
> Nitin Khandelwal
Re: Not able to post a job in Hadoop 0.23.0
Posted by Nitin Khandelwal <ni...@germinait.com>.
CC : mapreduce-user
On 9 December 2011 13:14, Nitin Khandelwal
<ni...@germinait.com>wrote:
> Hi Arun,
> Thanks for your reply.
>
>
> There is one NodeManager running ; Following is the NodeManager UI :
>
> Rack
> Node State
> Node Address
> Node HTTP Address
> Health-status
> Last health-update
> Health-report
> Containers
> Mem Used
> Mem Avail
> /default-rack RUNNING germinait93:50033 germinait93:9999 Healthy 9-Dec-2011
> 13:03:33 Healthy 0 0 KB 1 GB
> Also, I get to see only following Logs relevant to the job posting :
>
> 2011-12-09 13:10:57,300 INFO fifo.FifoScheduler (FifoScheduler.java:
> addApplication(288)) - Application Submission:
> application_1323416004722_0002 from minal.kothari, currently
> active: 1
> 2011-12-09 13:10:57,300 INFO attempt.RMAppAttemptImpl
> (RMAppAttemptImpl.java:handle(464)) - Processing event for
> appattempt_1323416004722_0002_000001 of type APP_ACCEPTED
> 2011-12-09 13:10:57,317 INFO attempt.RMAppAttemptImpl
> (RMAppAttemptImpl.java:handle(476)) - appattempt_1323416004722_0002_000001
> State change from SUBMITTED to SCHEDULED
> 2011-12-09 13:10:57,318 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(416))
> - Processing event for application_1323416004722_0002 of type APP_ACCEPTED
> 2011-12-09 13:10:57,318 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(428))
> - application_1323416004722_0002 State change from SUBMITTED to ACCEPTED
> 2011-12-09 13:10:57,320 INFO resourcemanager.RMAuditLogger
> (RMAuditLogger.java:logSuccess(140)) - USER=minal.kothari IP=192.168.0.93
> OPERATION=Submit Application Request
> TARGET=ClientRMService RESULT=SUCCESS
> APPID=application_1323416004722_0002
>
>
> Please let me know if you need some other logs .
>
> Thanks,
> Nitin
>
>
>
>
> On 9 December 2011 12:44, Arun C Murthy <ac...@hortonworks.com> wrote:
>
>> Moving to mapreduce-user@, bcc common-user@.
>>
>> Can you see any errors in the logs? Typically this happens when you have
>> no NodeManagers.
>>
>> Check the 'nodes' link and then RM logs.
>>
>> Arun
>>
>> On Nov 29, 2011, at 8:36 PM, Nitin Khandelwal wrote:
>>
>> > HI ,
>> >
>> > I have successfully setup Hadoop 0.23.0 in a single m/c. When i post a
>> job,
>> > it gets posted successfully (i can see the job in UI), but the job is
>> never
>> > "ASSIGNED" and waits forever.
>> > Here are details of what i see for that Job in UI
>> >
>> >
>> > Name: random-writer State: ACCEPTED FinalStatus: UNDEFINED
>> > Started: 30-Nov-2011
>> > 10:08:55 Elapsed: 49sec Tracking URL:
>> > UNASSIGNED<
>> http://192.168.0.93:8900/cluster/app/application_1322627869620_0001#>
>> > Diagnostics:
>> > AM container logs: AM not yet registered with RM Cluster ID:
>> 1322627869620
>> > ResourceManager state: STARTED ResourceManager started on: 30-Nov-2011
>> > 10:07:49 ResourceManager version: 0.23.0 from
>> > 722cd694fc4ab6d040c0a34f9fb5b476e330ee60 by hortonmu source checksum
>> > 4975bf112aa7faa5673f604045ced798 on Thu Nov 3 09:07:31 UTC 2011 Hadoop
>> > version: 0.23.0 from d4fee83ec1462ab9824add6449320617caa7c605 by
>> hortonmu
>> > source checksum 4e42b2d96c899a98a8ab8c7cc23f27ae on Thu Nov 3 08:59:12
>> UTC
>> > 2011
>> > Can some one tell where am i going wrong??
>> >
>> > Thanks,
>> > --
>> > Nitin Khandelwal
>>
>>
>
>
> --
>
>
> Nitin Khandelwal
>
>
>
--
Nitin Khandelwal
Re: Not able to post a job in Hadoop 0.23.0
Posted by Nitin Khandelwal <ni...@germinait.com>.
CC : mapreduce-user
On 9 December 2011 13:14, Nitin Khandelwal
<ni...@germinait.com>wrote:
> Hi Arun,
> Thanks for your reply.
>
>
> There is one NodeManager running ; Following is the NodeManager UI :
>
> Rack
> Node State
> Node Address
> Node HTTP Address
> Health-status
> Last health-update
> Health-report
> Containers
> Mem Used
> Mem Avail
> /default-rack RUNNING germinait93:50033 germinait93:9999 Healthy 9-Dec-2011
> 13:03:33 Healthy 0 0 KB 1 GB
> Also, I get to see only following Logs relevant to the job posting :
>
> 2011-12-09 13:10:57,300 INFO fifo.FifoScheduler (FifoScheduler.java:
> addApplication(288)) - Application Submission:
> application_1323416004722_0002 from minal.kothari, currently
> active: 1
> 2011-12-09 13:10:57,300 INFO attempt.RMAppAttemptImpl
> (RMAppAttemptImpl.java:handle(464)) - Processing event for
> appattempt_1323416004722_0002_000001 of type APP_ACCEPTED
> 2011-12-09 13:10:57,317 INFO attempt.RMAppAttemptImpl
> (RMAppAttemptImpl.java:handle(476)) - appattempt_1323416004722_0002_000001
> State change from SUBMITTED to SCHEDULED
> 2011-12-09 13:10:57,318 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(416))
> - Processing event for application_1323416004722_0002 of type APP_ACCEPTED
> 2011-12-09 13:10:57,318 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(428))
> - application_1323416004722_0002 State change from SUBMITTED to ACCEPTED
> 2011-12-09 13:10:57,320 INFO resourcemanager.RMAuditLogger
> (RMAuditLogger.java:logSuccess(140)) - USER=minal.kothari IP=192.168.0.93
> OPERATION=Submit Application Request
> TARGET=ClientRMService RESULT=SUCCESS
> APPID=application_1323416004722_0002
>
>
> Please let me know if you need some other logs .
>
> Thanks,
> Nitin
>
>
>
>
> On 9 December 2011 12:44, Arun C Murthy <ac...@hortonworks.com> wrote:
>
>> Moving to mapreduce-user@, bcc common-user@.
>>
>> Can you see any errors in the logs? Typically this happens when you have
>> no NodeManagers.
>>
>> Check the 'nodes' link and then RM logs.
>>
>> Arun
>>
>> On Nov 29, 2011, at 8:36 PM, Nitin Khandelwal wrote:
>>
>> > HI ,
>> >
>> > I have successfully setup Hadoop 0.23.0 in a single m/c. When i post a
>> job,
>> > it gets posted successfully (i can see the job in UI), but the job is
>> never
>> > "ASSIGNED" and waits forever.
>> > Here are details of what i see for that Job in UI
>> >
>> >
>> > Name: random-writer State: ACCEPTED FinalStatus: UNDEFINED
>> > Started: 30-Nov-2011
>> > 10:08:55 Elapsed: 49sec Tracking URL:
>> > UNASSIGNED<
>> http://192.168.0.93:8900/cluster/app/application_1322627869620_0001#>
>> > Diagnostics:
>> > AM container logs: AM not yet registered with RM Cluster ID:
>> 1322627869620
>> > ResourceManager state: STARTED ResourceManager started on: 30-Nov-2011
>> > 10:07:49 ResourceManager version: 0.23.0 from
>> > 722cd694fc4ab6d040c0a34f9fb5b476e330ee60 by hortonmu source checksum
>> > 4975bf112aa7faa5673f604045ced798 on Thu Nov 3 09:07:31 UTC 2011 Hadoop
>> > version: 0.23.0 from d4fee83ec1462ab9824add6449320617caa7c605 by
>> hortonmu
>> > source checksum 4e42b2d96c899a98a8ab8c7cc23f27ae on Thu Nov 3 08:59:12
>> UTC
>> > 2011
>> > Can some one tell where am i going wrong??
>> >
>> > Thanks,
>> > --
>> > Nitin Khandelwal
>>
>>
>
>
> --
>
>
> Nitin Khandelwal
>
>
>
--
Nitin Khandelwal
Re: Not able to post a job in Hadoop 0.23.0
Posted by Nitin Khandelwal <ni...@germinait.com>.
Hi Arun,
Thanks for your reply.
There is one NodeManager running ; Following is the NodeManager UI :
Rack
Node State
Node Address
Node HTTP Address
Health-status
Last health-update
Health-report
Containers
Mem Used
Mem Avail
/default-rack RUNNING germinait93:50033 germinait93:9999 Healthy 9-Dec-2011
13:03:33 Healthy 0 0 KB 1 GB
Also, I get to see only following Logs relevant to the job posting :
2011-12-09 13:10:57,300 INFO fifo.FifoScheduler (FifoScheduler.java:
addApplication(288)) - Application Submission:
application_1323416004722_0002 from minal.kothari, currently
active: 1
2011-12-09 13:10:57,300 INFO attempt.RMAppAttemptImpl
(RMAppAttemptImpl.java:handle(464)) - Processing event for
appattempt_1323416004722_0002_000001 of type APP_ACCEPTED
2011-12-09 13:10:57,317 INFO attempt.RMAppAttemptImpl
(RMAppAttemptImpl.java:handle(476)) - appattempt_1323416004722_0002_000001
State change from SUBMITTED to SCHEDULED
2011-12-09 13:10:57,318 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(416))
- Processing event for application_1323416004722_0002 of type APP_ACCEPTED
2011-12-09 13:10:57,318 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(428))
- application_1323416004722_0002 State change from SUBMITTED to ACCEPTED
2011-12-09 13:10:57,320 INFO resourcemanager.RMAuditLogger
(RMAuditLogger.java:logSuccess(140)) - USER=minal.kothari IP=192.168.0.93
OPERATION=Submit Application Request
TARGET=ClientRMService RESULT=SUCCESS APPID=application_1323416004722_0002
Please let me know if you need some other logs .
Thanks,
Nitin
On 9 December 2011 12:44, Arun C Murthy <ac...@hortonworks.com> wrote:
> Moving to mapreduce-user@, bcc common-user@.
>
> Can you see any errors in the logs? Typically this happens when you have
> no NodeManagers.
>
> Check the 'nodes' link and then RM logs.
>
> Arun
>
> On Nov 29, 2011, at 8:36 PM, Nitin Khandelwal wrote:
>
> > HI ,
> >
> > I have successfully setup Hadoop 0.23.0 in a single m/c. When i post a
> job,
> > it gets posted successfully (i can see the job in UI), but the job is
> never
> > "ASSIGNED" and waits forever.
> > Here are details of what i see for that Job in UI
> >
> >
> > Name: random-writer State: ACCEPTED FinalStatus: UNDEFINED
> > Started: 30-Nov-2011
> > 10:08:55 Elapsed: 49sec Tracking URL:
> > UNASSIGNED<
> http://192.168.0.93:8900/cluster/app/application_1322627869620_0001#>
> > Diagnostics:
> > AM container logs: AM not yet registered with RM Cluster ID:
> 1322627869620
> > ResourceManager state: STARTED ResourceManager started on: 30-Nov-2011
> > 10:07:49 ResourceManager version: 0.23.0 from
> > 722cd694fc4ab6d040c0a34f9fb5b476e330ee60 by hortonmu source checksum
> > 4975bf112aa7faa5673f604045ced798 on Thu Nov 3 09:07:31 UTC 2011 Hadoop
> > version: 0.23.0 from d4fee83ec1462ab9824add6449320617caa7c605 by hortonmu
> > source checksum 4e42b2d96c899a98a8ab8c7cc23f27ae on Thu Nov 3 08:59:12
> UTC
> > 2011
> > Can some one tell where am i going wrong??
> >
> > Thanks,
> > --
> > Nitin Khandelwal
>
>
--
Nitin Khandelwal