You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "stack (JIRA)" <ji...@apache.org> on 2014/12/29 23:27:13 UTC

[jira] [Resolved] (MAPREDUCE-5721) RM occur exception while unregistering

     [ https://issues.apache.org/jira/browse/MAPREDUCE-5721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

stack resolved MAPREDUCE-5721.
------------------------------
    Resolution: Not a Problem

Configuration issue. Resolving as 'not a problem'.

> RM occur exception while unregistering
> --------------------------------------
>
>                 Key: MAPREDUCE-5721
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5721
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: resourcemanager
>    Affects Versions: 2.2.0
>         Environment: rhel 5.8_x86 ;jrockit 1.6.0_31-R28.2.3-4.1.0;hadoop 2.2.0
>            Reporter: chillon_m
>
> when i run WORDCOUNT EXAMPLES,it occur.
> [hadoop@namenode0 ~]$ hadoop jar hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar wordcount /wordcount-input /wordcount-output
> 14/01/10 14:42:58 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
> 14/01/10 14:43:01 INFO client.RMProxy: Connecting to ResourceManager at namenode0/192.168.0.133:8032
> 14/01/10 14:43:03 INFO input.FileInputFormat: Total input paths to process : 2
> 14/01/10 14:43:03 INFO mapreduce.JobSubmitter: number of splits:2
> 14/01/10 14:43:03 INFO Configuration.deprecation: user.name is deprecated. Instead, use mapreduce.job.user.name
> 14/01/10 14:43:03 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
> 14/01/10 14:43:03 INFO Configuration.deprecation: mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
> 14/01/10 14:43:03 INFO Configuration.deprecation: mapreduce.combine.class is deprecated. Instead, use mapreduce.job.combine.class
> 14/01/10 14:43:03 INFO Configuration.deprecation: mapreduce.map.class is deprecated. Instead, use mapreduce.job.map.class
> 14/01/10 14:43:03 INFO Configuration.deprecation: mapred.job.name is deprecated. Instead, use mapreduce.job.name
> 14/01/10 14:43:03 INFO Configuration.deprecation: mapreduce.reduce.class is deprecated. Instead, use mapreduce.job.reduce.class
> 14/01/10 14:43:03 INFO Configuration.deprecation: mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
> 14/01/10 14:43:03 INFO Configuration.deprecation: mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
> 14/01/10 14:43:03 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
> 14/01/10 14:43:03 INFO Configuration.deprecation: mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
> 14/01/10 14:43:03 INFO Configuration.deprecation: mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
> 14/01/10 14:43:03 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1389336130986_0001
> 14/01/10 14:43:05 INFO impl.YarnClientImpl: Submitted application application_1389336130986_0001 to ResourceManager at namenode0/192.168.0.133:8032
> 14/01/10 14:43:05 INFO mapreduce.Job: The url to track the job: http://namenode0:8088/proxy/application_1389336130986_0001/
> 14/01/10 14:43:05 INFO mapreduce.Job: Running job: job_1389336130986_0001
> 14/01/10 14:43:16 INFO mapreduce.Job: Job job_1389336130986_0001 running in uber mode : false
> 14/01/10 14:43:16 INFO mapreduce.Job:  map 0% reduce 0%
> 14/01/10 14:44:20 INFO mapreduce.Job:  map 50% reduce 0%
> 14/01/10 14:44:34 INFO mapreduce.Job:  map 100% reduce 0%
> 14/01/10 14:44:51 INFO mapreduce.Job:  map 100% reduce 100%
> 14/01/10 14:44:58 INFO ipc.Client: Retrying connect to server: datanode0.hadoop/192.168.0.134:43052. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=3, sleepTime=1 SECONDS)
> 14/01/10 14:44:59 INFO ipc.Client: Retrying connect to server: datanode0.hadoop/192.168.0.134:43052. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=3, sleepTime=1 SECONDS)
> 14/01/10 14:45:00 INFO ipc.Client: Retrying connect to server: datanode0.hadoop/192.168.0.134:43052. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=3, sleepTime=1 SECONDS)
> 14/01/10 14:45:01 INFO ipc.Client: Retrying connect to server: datanode0.hadoop/192.168.0.134:43052. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=3, sleepTime=1 SECONDS)
> 14/01/10 14:45:02 INFO ipc.Client: Retrying connect to server: datanode0.hadoop/192.168.0.134:43052. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=3, sleepTime=1 SECONDS)
> 14/01/10 14:45:03 INFO ipc.Client: Retrying connect to server: datanode0.hadoop/192.168.0.134:43052. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=3, sleepTime=1 SECONDS)
> 14/01/10 14:45:17 INFO mapreduce.Job:  map 0% reduce 0%
> 14/01/10 14:45:17 INFO mapreduce.Job: Job job_1389336130986_0001 failed with state FAILED due to: Application application_1389336130986_0001 failed 2 times due to AM Container for appattempt_1389336130986_0001_000002 exited with  exitCode: 1 due to: Exception from container-launch: 
> org.apache.hadoop.util.Shell$ExitCodeException: 
>         at org.apache.hadoop.util.Shell.runCommand(Shell.java:464)
>         at org.apache.hadoop.util.Shell.run(Shell.java:380)
>         at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:590)
>         at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
>         at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283)
>         at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79)
>         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:139)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:909)
>         at java.lang.Thread.run(Thread.java:662)
> .Failing this attempt.. Failing the application.
> 14/01/10 14:45:17 INFO mapreduce.Job: Counters: 0
> [hadoop@namenode0 ~]$ 
> LOGS
> Hadoop:
> 2014-01-10 16:21:45,987 WARN org.apache.hadoop.hdfs.StateChange: DIR* FSDirectory.unprotectedRenameTo: failed to rename /mr-history/tmp/hadoop/job_1389341658181_0001.summary_tmp to /mr-history/tmp/hadoop/job_1389341658181_0001.summary because destination exists
> 2014-01-10 16:21:45,988 INFO BlockStateChange: BLOCK* addStoredBlock: blockMap updated: 192.168.0.135:50010 is added to blk_1073742140_1320 size 76810
> 2014-01-10 16:21:46,000 WARN org.apache.hadoop.hdfs.StateChange: DIR* FSDirectory.unprotectedRenameTo: failed to rename /mr-history/tmp/hadoop/job_1389341658181_0001_conf.xml_tmp to /mr-history/tmp/hadoop/job_1389341658181_0001_conf.xml because destination exists
> 2014-01-10 16:21:46,005 WARN org.apache.hadoop.hdfs.StateChange: DIR* FSDirectory.unprotectedRenameTo: failed to rename /mr-history/tmp/hadoop/job_1389341658181_0001-1389341978991-hadoop-word+count-1389342072969-2-1-SUCCEEDED-default.jhist_tmp to /mr-history/tmp/hadoop/job_1389341658181_0001-1389341978991-hadoop-word+count-1389342072969-2-1-SUCCEEDED-default.jhist because destination exists
> 2014-01-10 16:21:46,005 INFO org.apache.hadoop.hdfs.server.namenode.EditLogFileOutputStream: Nothing to flush
> 2014-01-10 16:21:46,152 INFO BlockStateChange: BLOCK* addToInvalidates: blk_1073742126_1306 192.168.0.135:50010 192.168.0.134:50010 
> 2014-01-10 16:21:46,153 INFO BlockStateChange: BLOCK* addToInvalidates: blk_1073742127_1307 192.168.0.135:50010 192.168.0.134:50010 
> 2014-01-10 16:21:46,153 INFO BlockStateChange: BLOCK* addToInvalidates: blk_1073742128_1308 192.168.0.135:50010 192.168.0.134:50010 
> 2014-01-10 16:21:46,153 INFO BlockStateChange: BLOCK* addToInvalidates: blk_1073742129_1309 192.168.0.135:50010 192.168.0.134:50010 
> 2014-01-10 16:21:46,153 INFO BlockStateChange: BLOCK* addToInvalidates: blk_1073742131_1311 192.168.0.134:50010 192.168.0.135:50010 
> 2014-01-10 16:21:46,153 INFO BlockStateChange: BLOCK* addToInvalidates: blk_1073742130_1310 192.168.0.134:50010 192.168.0.135:50010 
> 2014-01-10 16:21:46,153 INFO BlockStateChange: BLOCK* addToInvalidates: blk_1073742137_1317 192.168.0.135:50010 192.168.0.134:50010 
> 2014-01-10 16:21:46,153 INFO BlockStateChange: BLOCK* addToInvalidates: blk_1073742136_1316 192.168.0.135:50010 192.168.0.134:50010 
> 2014-01-10 16:21:48,901 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* InvalidateBlocks: ask 192.168.0.134:50010 to delete [blk_1073742128_1308, blk_1073742129_1309, blk_1073742130_1310, blk_1073742131_1311, blk_1073742136_1316, blk_1073742137_1317, blk_1073742126_1306, blk_1073742127_1307]
> 2014-01-10 16:21:51,904 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* InvalidateBlocks: ask 192.168.0.135:50010 to delete [blk_1073742128_1308, blk_1073742129_1309, blk_1073742130_1310, blk_1073742131_1311, blk_1073742136_1316, blk_1073742137_1317, blk_1073742126_1306, blk_1073742127_1307]
> RM:
> 2014-01-10 16:21:47,006 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application appattempt_1389341658181_0001_000002 released container container_1389341658181_0001_02_000001 on node: host: datanode1.hadoop:56467 #containers=0 available=8192 used=0 with event: FINISHED
> 2014-01-10 16:21:47,006 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Unregistering app attempt : appattempt_1389341658181_0001_000002
> 2014-01-10 16:21:47,006 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1389341658181_0001_000002 State change from RUNNING to FAILED
> 2014-01-10 16:21:47,007 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Application application_1389341658181_0001 failed 2 times due to AM Container for appattempt_1389341658181_0001_000002 exited with  exitCode: 1 due to: Exception from container-launch: 
> org.apache.hadoop.util.Shell$ExitCodeException: 
> 	at org.apache.hadoop.util.Shell.runCommand(Shell.java:464)
> 	at org.apache.hadoop.util.Shell.run(Shell.java:380)
> 	at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:590)
> 	at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
> 	at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283)
> 	at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79)
> 	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> 	at java.util.concurrent.FutureTask.run(FutureTask.java:139)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:909)
> 	at java.lang.Thread.run(Thread.java:662)
> .Failing this attempt.. Failing the application.
> 2014-01-10 16:21:47,010 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1389341658181_0001 State change from RUNNING to FAILED
> 2014-01-10 16:21:47,012 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Removing info for app: application_1389341658181_0001
> 2014-01-10 16:21:47,016 WARN org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hadoop	OPERATION=Application Finished - Failed	TARGET=RMAppManager	RESULT=FAILURE	DESCRIPTION=App failed with state: FAILED	PERMISSIONS=Application application_1389341658181_0001 failed 2 times due to AM Container for appattempt_1389341658181_0001_000002 exited with  exitCode: 1 due to: Exception from container-launch: 
> org.apache.hadoop.util.Shell$ExitCodeException: 
> 	at org.apache.hadoop.util.Shell.runCommand(Shell.java:464)
> 	at org.apache.hadoop.util.Shell.run(Shell.java:380)
> 	at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:590)
> 	at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
> 	at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283)
> 	at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79)
> 	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> 	at java.util.concurrent.FutureTask.run(FutureTask.java:139)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:909)
> 	at java.lang.Thread.run(Thread.java:662)
> .Failing this attempt.. Failing the application.	APPID=application_1389341658181_0001
> 2014-01-10 16:21:47,019 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1389341658181_0001,name=word count,user=hadoop,queue=default,state=FAILED,trackingUrl=namenode0:8088/cluster/app/application_1389341658181_0001,appMasterHost=,startTime=1389341979049,finishTime=1389342107008,finalStatus=FAILED
> 2014-01-10 16:21:47,021 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Cleaning master appattempt_1389341658181_0001_000002
> 2014-01-10 16:21:47,012 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application appattempt_1389341658181_0001_000002 is done. finalState=FAILED
> 2014-01-10 16:21:47,022 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: Application application_1389341658181_0001 requests cleared
> 2014-01-10 16:21:47,022 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application removed - appId: application_1389341658181_0001 user: hadoop queue: default #user-pending-applications: 0 #user-active-applications: 0 #queue-pending-applications: 0 #queue-active-applications: 0
> 2014-01-10 16:21:47,022 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Application removed - appId: application_1389341658181_0001 user: hadoop leaf-queue of parent: root #applications: 0
> datanode0-syslog:
> 2014-01-10 16:21:09,369 INFO [Socket Reader #1 for port 39047] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1389341658181_0001 (auth:SIMPLE)
> 2014-01-10 16:21:09,405 INFO [IPC Server handler 11 on 39047] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1389341658181_0001_r_000004 asked for a task
> 2014-01-10 16:21:09,405 INFO [IPC Server handler 11 on 39047] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1389341658181_0001_r_000004 given task: attempt_1389341658181_0001_r_000000_0
> 2014-01-10 16:21:10,012 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed container container_1389341658181_0001_01_000002
> 2014-01-10 16:21:10,012 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:0 AssignedReds:1 CompletedMaps:2 CompletedReds:0 ContAlloc:3 ContRel:0 HostLocal:2 RackLocal:0
> 2014-01-10 16:21:10,012 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1389341658181_0001_m_000000_0: Container killed by the ApplicationMaster.
> Container killed on request. Exit code is 143
> 2014-01-10 16:21:10,578 INFO [IPC Server handler 12 on 39047] org.apache.hadoop.mapred.TaskAttemptListenerImpl: MapCompletionEvents request from attempt_1389341658181_0001_r_000000_0. startIndex 0 maxEvents 10000
> 2014-01-10 16:21:11,593 INFO [IPC Server handler 13 on 39047] org.apache.hadoop.mapred.TaskAttemptListenerImpl: MapCompletionEvents request from attempt_1389341658181_0001_r_000000_0. startIndex 2 maxEvents 10000
> 2014-01-10 16:21:12,003 INFO [IPC Server handler 14 on 39047] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Status update from attempt_1389341658181_0001_r_000000_0
> 2014-01-10 16:21:12,003 INFO [IPC Server handler 14 on 39047] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1389341658181_0001_r_000000_0 is : 0.0
> 2014-01-10 16:21:12,077 INFO [IPC Server handler 15 on 39047] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Status update from attempt_1389341658181_0001_r_000000_0
> 2014-01-10 16:21:12,077 INFO [IPC Server handler 15 on 39047] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1389341658181_0001_r_000000_0 is : 0.0
> 2014-01-10 16:21:12,698 INFO [IPC Server handler 16 on 39047] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit-pending state update from attempt_1389341658181_0001_r_000000_0
> 2014-01-10 16:21:12,699 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1389341658181_0001_r_000000_0 TaskAttempt Transitioned from RUNNING to COMMIT_PENDING
> 2014-01-10 16:21:12,700 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: attempt_1389341658181_0001_r_000000_0 given a go for committing the task output.
> 2014-01-10 16:21:12,702 INFO [IPC Server handler 16 on 39047] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit go/no-go request from attempt_1389341658181_0001_r_000000_0
> 2014-01-10 16:21:12,703 INFO [IPC Server handler 16 on 39047] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Result of canCommit for attempt_1389341658181_0001_r_000000_0:true
> 2014-01-10 16:21:12,776 INFO [IPC Server handler 18 on 39047] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Status update from attempt_1389341658181_0001_r_000000_0
> 2014-01-10 16:21:12,777 INFO [IPC Server handler 18 on 39047] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1389341658181_0001_r_000000_0 is : 1.0
> 2014-01-10 16:21:12,779 INFO [IPC Server handler 18 on 39047] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Done acknowledgement from attempt_1389341658181_0001_r_000000_0
> 2014-01-10 16:21:12,780 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1389341658181_0001_r_000000_0 TaskAttempt Transitioned from COMMIT_PENDING to SUCCESS_CONTAINER_CLEANUP
> 2014-01-10 16:21:12,785 INFO [ContainerLauncher #5] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_1389341658181_0001_01_000004 taskAttempt attempt_1389341658181_0001_r_000000_0
> 2014-01-10 16:21:12,785 INFO [ContainerLauncher #5] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1389341658181_0001_r_000000_0
> 2014-01-10 16:21:12,867 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1389341658181_0001_r_000000_0 TaskAttempt Transitioned from SUCCESS_CONTAINER_CLEANUP to SUCCEEDED
> 2014-01-10 16:21:12,867 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task succeeded with attempt attempt_1389341658181_0001_r_000000_0
> 2014-01-10 16:21:12,867 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1389341658181_0001_r_000000 Task Transitioned from RUNNING to SUCCEEDED
> 2014-01-10 16:21:12,867 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed Tasks: 3
> 2014-01-10 16:21:12,867 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1389341658181_0001Job Transitioned from RUNNING to COMMITTING
> 2014-01-10 16:21:12,870 INFO [CommitterEvent Processor #1] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: JOB_COMMIT
> 2014-01-10 16:21:12,974 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Calling handler for JobFinishedEvent 
> 2014-01-10 16:21:12,976 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1389341658181_0001Job Transitioned from COMMITTING to SUCCEEDED
> 2014-01-10 16:21:12,978 INFO [Thread-69] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: We are finishing cleanly so this is the last retry
> 2014-01-10 16:21:12,978 INFO [Thread-69] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify RMCommunicator isAMLastRetry: true
> 2014-01-10 16:21:12,979 INFO [Thread-69] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: RMCommunicator notified that shouldUnregistered is: true
> 2014-01-10 16:21:12,979 INFO [Thread-69] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify JHEH isAMLastRetry: true
> 2014-01-10 16:21:12,979 INFO [Thread-69] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: JobHistoryEventHandler notified that forceJobCompletion is true
> 2014-01-10 16:21:12,979 INFO [Thread-69] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Calling stop for all the services
> 2014-01-10 16:21:12,983 INFO [Thread-69] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping JobHistoryEventHandler. Size of the outstanding queue size is 1
> 2014-01-10 16:21:13,021 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:0 AssignedReds:1 CompletedMaps:2 CompletedReds:1 ContAlloc:3 ContRel:0 HostLocal:2 RackLocal:0
> 2014-01-10 16:21:13,094 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying hdfs://namenode0:9000/tmp/hadoop-yarn/staging/hadoop/.staging/job_1389341658181_0001/job_1389341658181_0001_1.jhist to hdfs://namenode0:9000/mr-history/tmp/hadoop/job_1389341658181_0001-1389341978991-hadoop-word+count-1389342072969-2-1-SUCCEEDED-default.jhist_tmp
> 2014-01-10 16:21:13,140 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to done location: hdfs://namenode0:9000/mr-history/tmp/hadoop/job_1389341658181_0001-1389341978991-hadoop-word+count-1389342072969-2-1-SUCCEEDED-default.jhist_tmp
> 2014-01-10 16:21:13,143 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying hdfs://namenode0:9000/tmp/hadoop-yarn/staging/hadoop/.staging/job_1389341658181_0001/job_1389341658181_0001_1_conf.xml to hdfs://namenode0:9000/mr-history/tmp/hadoop/job_1389341658181_0001_conf.xml_tmp
> 2014-01-10 16:21:13,210 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to done location: hdfs://namenode0:9000/mr-history/tmp/hadoop/job_1389341658181_0001_conf.xml_tmp
> 2014-01-10 16:21:13,214 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://namenode0:9000/mr-history/tmp/hadoop/job_1389341658181_0001.summary_tmp to hdfs://namenode0:9000/mr-history/tmp/hadoop/job_1389341658181_0001.summary
> 2014-01-10 16:21:13,215 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://namenode0:9000/mr-history/tmp/hadoop/job_1389341658181_0001_conf.xml_tmp to hdfs://namenode0:9000/mr-history/tmp/hadoop/job_1389341658181_0001_conf.xml
> 2014-01-10 16:21:13,216 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://namenode0:9000/mr-history/tmp/hadoop/job_1389341658181_0001-1389341978991-hadoop-word+count-1389342072969-2-1-SUCCEEDED-default.jhist_tmp to hdfs://namenode0:9000/mr-history/tmp/hadoop/job_1389341658181_0001-1389341978991-hadoop-word+count-1389342072969-2-1-SUCCEEDED-default.jhist
> 2014-01-10 16:21:13,219 INFO [Thread-69] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopped JobHistoryEventHandler. super.stop()
> 2014-01-10 16:21:13,226 INFO [Thread-69] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Setting job diagnostics to 
> 2014-01-10 16:21:13,229 ERROR [Thread-69] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Exception while unregistering 
> java.lang.NullPointerException
> 	at org.apache.hadoop.mapreduce.v2.util.MRWebAppUtil.getApplicationWebURLOnJHSWithoutScheme(MRWebAppUtil.java:133)
> 	at org.apache.hadoop.mapreduce.v2.util.MRWebAppUtil.getApplicationWebURLOnJHSWithScheme(MRWebAppUtil.java:148)
> 	at org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator.doUnregistration(RMCommunicator.java:207)
> 	at org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator.unregister(RMCommunicator.java:177)
> 	at org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator.serviceStop(RMCommunicator.java:250)
> 	at org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.serviceStop(RMContainerAllocator.java:255)
> 	at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:221)
> 	at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:52)
> 	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter.serviceStop(MRAppMaster.java:817)
> 	at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:221)
> 	at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:52)
> 	at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:80)
> 	at org.apache.hadoop.service.CompositeService.stop(CompositeService.java:159)
> 	at org.apache.hadoop.service.CompositeService.serviceStop(CompositeService.java:132)
> 	at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:221)
> 	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.shutDownJob(MRAppMaster.java:548)
> 	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler$1.run(MRAppMaster.java:599)
> 2014-01-10 16:21:13,234 INFO [Thread-69] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Final Stats: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:0 AssignedReds:1 CompletedMaps:2 CompletedReds:1 ContAlloc:3 ContRel:0 HostLocal:2 RackLocal:0
> 2014-01-10 16:21:13,234 INFO [Thread-69] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Skipping cleaning up the staging dir. assuming AM will be retried.
> 2014-01-10 16:21:13,235 INFO [Thread-69] org.apache.hadoop.ipc.Server: Stopping server on 39047
> 2014-01-10 16:21:13,241 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: Stopping IPC Server Responder
> 2014-01-10 16:21:13,242 INFO [TaskHeartbeatHandler PingChecker] org.apache.hadoop.mapreduce.v2.app.TaskHeartbeatHandler: TaskHeartbeatHandler thread interrupted
> 2014-01-10 16:21:13,243 INFO [IPC Server listener on 39047] org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 39047
> 2014-01-10 16:21:18,243 INFO [Thread-69] org.apache.hadoop.ipc.Server: Stopping server on 41351
> 2014-01-10 16:21:18,272 INFO [Thread-69] org.mortbay.log: Stopped SelectChannelConnector@0.0.0.0:0
> 2014-01-10 16:21:18,274 INFO [IPC Server listener on 41351] org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 41351
> 2014-01-10 16:21:18,275 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: Stopping IPC Server Responder
> 2014-01-10 16:21:18,378 INFO [Thread-69] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Exiting MR AppMaster..GoodBye!
> 2014-01-10 16:21:18,390 INFO [Thread-1] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster received a signal. Signaling RMCommunicator and JobHistoryEventHandler.
> 2014-01-10 16:21:18,390 INFO [Thread-1] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: RMCommunicator notified that iSignalled is: true
> 2014-01-10 16:21:18,390 INFO [Thread-1] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify RMCommunicator isAMLastRetry: false
> 2014-01-10 16:21:18,390 INFO [Thread-1] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: RMCommunicator notified that shouldUnregistered is: false
> 2014-01-10 16:21:18,390 INFO [Thread-1] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify JHEH isAMLastRetry: false
> 2014-01-10 16:21:18,390 INFO [Thread-1] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: JobHistoryEventHandler notified that forceJobCompletion is false
> datanode1-syslog:
> 014-01-10 16:21:39,815 INFO [Main Thread] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Will not try to recover. recoveryEnabled: true recoverySupportedByCommitter: false numReduceTasks: 1 shuffleKeyValidForRecovery: true ApplicationAttemptID: 2
> 2014-01-10 16:21:39,871 INFO [Main Thread] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Previous history file is at hdfs://namenode0:9000/tmp/hadoop-yarn/staging/hadoop/.staging/job_1389341658181_0001/job_1389341658181_0001_1.jhist
> 2014-01-10 16:21:41,503 INFO [Main Thread] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.JobFinishEvent$Type for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler
> 2014-01-10 16:21:41,752 INFO [Main Thread] org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties
> 2014-01-10 16:21:42,641 INFO [Main Thread] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).
> 2014-01-10 16:21:42,641 INFO [Main Thread] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MRAppMaster metrics system started
> 2014-01-10 16:21:42,777 INFO [Main Thread] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: nodeBlacklistingEnabled:true
> 2014-01-10 16:21:42,777 INFO [Main Thread] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: maxTaskFailuresPerNode is 3
> 2014-01-10 16:21:42,777 INFO [Main Thread] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: blacklistDisablePercent is 33
> 2014-01-10 16:21:42,896 INFO [Main Thread] org.apache.hadoop.yarn.client.RMProxy: Connecting to ResourceManager at namenode0/192.168.0.133:8030
> 2014-01-10 16:21:43,123 INFO [Main Thread] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: maxContainerCapability: 8192
> 2014-01-10 16:21:43,183 INFO [Main Thread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryCopyService: History file is at hdfs://namenode0:9000/tmp/hadoop-yarn/staging/hadoop/.staging/job_1389341658181_0001/job_1389341658181_0001_1.jhist
> 2014-01-10 16:21:43,413 ERROR [Main Thread] org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:hadoop (auth:SIMPLE) cause:java.io.IOException: Was asked to shut down.
> 2014-01-10 16:21:43,414 FATAL [Main Thread] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Error starting MRAppMaster
> java.io.IOException: Was asked to shut down.
> 	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$1.run(MRAppMaster.java:1447)
> 	at javax.security.auth.Subject.doAs(Subject.java:396)
> 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)
> 	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1452)
> 	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1374)
> 2014-01-10 16:21:43,454 INFO [Thread-1] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster received a signal. Signaling RMCommunicator and JobHistoryEventHandler.
> 2014-01-10 16:21:43,455 INFO [Thread-1] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: RMCommunicator notified that iSignalled is: true
> 2014-01-10 16:21:43,456 INFO [Thread-1] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify RMCommunicator isAMLastRetry: true
> 2014-01-10 16:21:43,457 INFO [Thread-1] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: RMCommunicator notified that shouldUnregistered is: true
> 2014-01-10 16:21:43,457 INFO [Thread-1] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify JHEH isAMLastRetry: true
> 2014-01-10 16:21:43,457 INFO [Thread-1] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: JobHistoryEventHandler notified that forceJobCompletion is true
> 2014-01-10 16:21:43,470 INFO [Thread-1] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping JobHistoryEventHandler. Size of the outstanding queue size is 17
> 2014-01-10 16:21:43,543 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Event Writer setup for JobId: job_1389341658181_0001, File: hdfs://namenode0:9000/tmp/hadoop-yarn/staging/hadoop/.staging/job_1389341658181_0001/job_1389341658181_0001_2.jhist
> 2014-01-10 16:21:43,657 INFO [eventHandlingThread] org.apache.hadoop.conf.Configuration.deprecation: user.name is deprecated. Instead, use mapreduce.job.user.name
> 2014-01-10 16:21:44,698 INFO [Thread-1] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop, writing event AM_STARTED
> 2014-01-10 16:21:44,700 INFO [Thread-1] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop, writing event JOB_SUBMITTED
> 2014-01-10 16:21:44,705 INFO [Thread-1] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop, writing event JOB_INITED
> 2014-01-10 16:21:44,707 INFO [Thread-1] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop, writing event JOB_INFO_CHANGED
> 2014-01-10 16:21:44,708 INFO [Thread-1] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop, writing event TASK_STARTED
> 2014-01-10 16:21:44,708 INFO [Thread-1] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop, writing event TASK_STARTED
> 2014-01-10 16:21:44,708 INFO [Thread-1] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop, writing event TASK_STARTED
> 2014-01-10 16:21:44,708 INFO [Thread-1] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop, writing event MAP_ATTEMPT_STARTED
> 2014-01-10 16:21:44,710 INFO [Thread-1] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop, writing event MAP_ATTEMPT_STARTED
> 2014-01-10 16:21:44,710 INFO [Thread-1] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop, writing event MAP_ATTEMPT_FINISHED
> 2014-01-10 16:21:44,763 INFO [Thread-1] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop, writing event TASK_FINISHED
> 2014-01-10 16:21:44,767 INFO [Thread-1] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop, writing event REDUCE_ATTEMPT_STARTED
> 2014-01-10 16:21:44,767 INFO [Thread-1] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop, writing event MAP_ATTEMPT_FINISHED
> 2014-01-10 16:21:44,769 INFO [Thread-1] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop, writing event TASK_FINISHED
> 2014-01-10 16:21:44,771 INFO [Thread-1] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop, writing event REDUCE_ATTEMPT_FINISHED
> 2014-01-10 16:21:44,775 INFO [Thread-1] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop, writing event TASK_FINISHED
> 2014-01-10 16:21:44,777 INFO [Thread-1] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop, writing event JOB_FINISHED
> 2014-01-10 16:21:44,886 INFO [Thread-1] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying hdfs://namenode0:9000/tmp/hadoop-yarn/staging/hadoop/.staging/job_1389341658181_0001/job_1389341658181_0001_2.jhist to hdfs://namenode0:9000/mr-history/tmp/hadoop/job_1389341658181_0001-1389341978991-hadoop-word+count-1389342072969-2-1-SUCCEEDED-default.jhist_tmp
> 2014-01-10 16:21:45,005 INFO [Thread-1] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to done location: hdfs://namenode0:9000/mr-history/tmp/hadoop/job_1389341658181_0001-1389341978991-hadoop-word+count-1389342072969-2-1-SUCCEEDED-default.jhist_tmp
> 2014-01-10 16:21:45,008 INFO [Thread-1] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying hdfs://namenode0:9000/tmp/hadoop-yarn/staging/hadoop/.staging/job_1389341658181_0001/job_1389341658181_0001_2_conf.xml to hdfs://namenode0:9000/mr-history/tmp/hadoop/job_1389341658181_0001_conf.xml_tmp
> 2014-01-10 16:21:45,079 INFO [Thread-1] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to done location: hdfs://namenode0:9000/mr-history/tmp/hadoop/job_1389341658181_0001_conf.xml_tmp
> 2014-01-10 16:21:45,103 INFO [Thread-1] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://namenode0:9000/mr-history/tmp/hadoop/job_1389341658181_0001.summary_tmp to hdfs://namenode0:9000/mr-history/tmp/hadoop/job_1389341658181_0001.summary
> 2014-01-10 16:21:45,108 INFO [Thread-1] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://namenode0:9000/mr-history/tmp/hadoop/job_1389341658181_0001_conf.xml_tmp to hdfs://namenode0:9000/mr-history/tmp/hadoop/job_1389341658181_0001_conf.xml
> 2014-01-10 16:21:45,110 INFO [Thread-1] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://namenode0:9000/mr-history/tmp/hadoop/job_1389341658181_0001-1389341978991-hadoop-word+count-1389342072969-2-1-SUCCEEDED-default.jhist_tmp to hdfs://namenode0:9000/mr-history/tmp/hadoop/job_1389341658181_0001-1389341978991-hadoop-word+count-1389342072969-2-1-SUCCEEDED-default.jhist
> 2014-01-10 16:21:45,110 INFO [Thread-1] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopped JobHistoryEventHandler. super.stop()
> 2014-01-10 16:21:45,122 INFO [Thread-1] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Setting job diagnostics to We crashed after successfully committing. Recovering.
> 2014-01-10 16:21:45,198 ERROR [Thread-1] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Exception while unregistering 
> java.lang.NullPointerException
> 	at org.apache.hadoop.mapreduce.v2.util.MRWebAppUtil.getApplicationWebURLOnJHSWithoutScheme(MRWebAppUtil.java:133)
> 	at org.apache.hadoop.mapreduce.v2.util.MRWebAppUtil.getApplicationWebURLOnJHSWithScheme(MRWebAppUtil.java:148)
> 	at org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator.doUnregistration(RMCommunicator.java:207)
> 	at org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator.unregister(RMCommunicator.java:177)
> 	at org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator.serviceStop(RMCommunicator.java:250)
> 	at org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.serviceStop(RMContainerAllocator.java:255)
> 	at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:221)
> 	at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:52)
> 	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter.serviceStop(MRAppMaster.java:817)
> 	at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:221)
> 	at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:52)
> 	at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:80)
> 	at org.apache.hadoop.service.CompositeService.stop(CompositeService.java:159)
> 	at org.apache.hadoop.service.CompositeService.serviceStop(CompositeService.java:132)
> 	at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:221)
> 	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$MRAppMasterShutdownHook.run(MRAppMaster.java:1399)
> 	at org.apache.hadoop.util.ShutdownHookManager$1.run(ShutdownHookManager.java:54)
> 2014-01-10 16:21:45,199 INFO [Thread-1] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Final Stats: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:0 ContRel:0 HostLocal:0 RackLocal:0
> 2014-01-10 16:21:45,203 INFO [Thread-1] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Deleting staging directory hdfs://namenode0:9000 /tmp/hadoop-yarn/staging/hadoop/.staging/job_1389341658181_0001



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)