You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-issues@hadoop.apache.org by "Raymond Liu (JIRA)" <ji...@apache.org> on 2013/09/03 04:11:51 UTC

[jira] [Created] (MAPREDUCE-5491) DFSIO do not initialize write buffer correctly

Raymond Liu created MAPREDUCE-5491:
--------------------------------------

             Summary: DFSIO do not initialize write buffer correctly
                 Key: MAPREDUCE-5491
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5491
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: benchmarks
    Affects Versions: trunk
            Reporter: Raymond Liu
            Assignee: Raymond Liu


In DFSIO test, the IOMapperBase will set bufferSize in configure method, while writeMapper, appendMapper etc use bufferSize to initialize buffer in the constructor. This will lead to buffer not initialized at all. It is ok for non compression route, while compression is used, the output data size will be very small due to all 0 in buffer.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira