You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-user@hadoop.apache.org by Rajesh Balamohan <ra...@gmail.com> on 2013/02/01 02:01:03 UTC

o.a.h.m.MapTask: data buffer - Takes long time to come out

Hi Experts,

At times, we have seen tasks taking a lot long time map tasks and looking
at the task logs, its spending a lot of time in "o.a.h.m.MapTask: data
buffer = xxx / yyy".

After sometime it prints the next line " MapTask: record buffer = xxx /
yyy". I initially thought it was allocating data buffer in JVM and causing
memory pressure. But it doesn't seem to be the case and no swapping is
happening in the system as well.

Has anyone else faced similar issue with MR-1.0? Any pointers would be
appreciated.

-- 
~Rajesh.B