[jira] [Resolved] (MAPREDUCE-13) Mapper failed due to out of memory

["Harsh J (Resolved) (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/MAPREDUCE-13?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Harsh J resolved MAPREDUCE-13.
------------------------------

    Resolution: Not A Problem

This isn't a problem anymore. Compressed inputs work nicely at present and is hardly ever the cause of maps going OOME.
                
> Mapper failed due to out of memory
> ----------------------------------
>
>                 Key: MAPREDUCE-13
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-13
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>            Reporter: Runping Qi
>
> When a map/reduce job takes block compressed sequence files as input, 
> the input data may be expanded significantly in size (a few to tens X, depending on
> the compression ratio of the particular data blocks in the files).
> This may cause out of memory problem in mappers.
> In my case, I set heap space to 1GB.
> The mappers started to fail when the accumulated expanded input size reaches above 300MB
>  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira