You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-user@hadoop.apache.org by Li Li <fa...@gmail.com> on 2014/05/13 08:48:11 UTC

last mapper is very slow

the log of the task:

2014-05-13 14:45:17,755 INFO org.apache.hadoop.mapred.MapTask:
Finished spill 117
2014-05-13 14:45:46,513 INFO org.apache.hadoop.mapred.MapTask:
Spilling map output: record full = true
2014-05-13 14:45:46,513 INFO org.apache.hadoop.mapred.MapTask:
bufstart = 4670527; bufend = 17362510; bufvoid = 99614720
2014-05-13 14:45:46,513 INFO org.apache.hadoop.mapred.MapTask: kvstart
= 130978; kvend = 65441; length = 327680
2014-05-13 14:45:47,131 INFO org.apache.hadoop.mapred.MapTask:
Finished spill 118
2014-05-13 14:46:18,157 INFO org.apache.hadoop.mapred.MapTask:
Spilling map output: record full = true
2014-05-13 14:46:18,157 INFO org.apache.hadoop.mapred.MapTask:
bufstart = 17362510; bufend = 30047883; bufvoid = 99614720
2014-05-13 14:46:18,157 INFO org.apache.hadoop.mapred.MapTask: kvstart
= 65441; kvend = 327585; length = 327680
2014-05-13 14:46:18,733 INFO org.apache.hadoop.mapred.MapTask:
Finished spill 119