You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Kevin Tse <ke...@gmail.com> on 2010/06/22 03:40:56 UTC

Reduce 99.44% complete and job is marked as successful?

Hi, everyone
Is there some mistakes in the display of the completeness percentage? or the
job is not completed successfully? this is the job details page:

*User:* root
*Job Name:* MyMRJob
*Job File: *hdfs://hadoop-master:9000
/hadoop/dfs/mapred/system/job_201006171158_0002/job.xml
*Job Setup:* <http://61.145.117.22:50030/jobtasks.jsp?jobid=job_201006171158_0002&type=setup&pagenum=1&state=completed>
Successful
*Status:* Succeeded
*Started at:* Thu Jun 17 19:02:36 HKT 2010
*Finished at:* Tue Jun 22 02:29:55 HKT 2010
*Finished in:* 103hrs, 27mins, 19sec
*Job Cleanup:* <http://61.145.117.22:50030/jobtasks.jsp?jobid=job_201006171158_0002&type=cleanup&pagenum=1&state=completed>
Successful
*Black-listed TaskTrackers: 1*
------------------------------
Kind% CompleteNum TasksPendingRunningCompleteKilledFailed/Killed
Task Attemptsmap100.00%175400175400 / 0reduce99.44%9009013/3


CounterMapReduceTotalFile SystemsHDFS bytes read939,570,304,2730
939,570,304,273HDFS bytes written098,263,673,99498,263,673,994Local bytes
read141,123,935,453248,836,818,725389,960,754,178Local bytes written
272,019,963,968248,836,818,725520,856,782,693Job CountersLaunched reduce
tasks0025Rack-local map tasks00555Launched map tasks001,754Data-local map
tasks001,199Map-Reduce FrameworkReduce input groups04,364,448,722
4,364,448,722Combine output records000Map input records45,452,313,7140
45,452,313,714Reduce output records04,364,448,7224,364,448,722Map output
bytes566,686,610,6440566,686,610,644Map input bytes939,568,262,6160
939,568,262,616Map output records45,452,313,714045,452,313,714Combine input
records000Reduce input records045,452,313,71445,452,313,714