You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-dev@hadoop.apache.org by Raghuveer <al...@yahoo.com.INVALID> on 2015/04/22 11:09:25 UTC

Mapreduce throws OutofMemoryError

 I took the code from https://github.com/raghuveerm/MRPcapParser and updated it to parse binary pcap files. I have large number of small files to be processed. Following are the steps i have already tried to resolve the issue:     
   - Tried setting mapred.child.java.opts=-Xmx2048m
   - Tried setting export HADOOP_CLIENT_OPTS="-Xmx2048m $HADOOP_CLIENT_OPTS" in hadoop-env.sh
no luck, kindly suggest