You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-issues@hadoop.apache.org by "Xiao Kang (JIRA)" <ji...@apache.org> on 2010/03/30 08:46:27 UTC

[jira] Reopened: (HADOOP-6662) hadoop zlib compression does not fully utilize the buffer

     [ https://issues.apache.org/jira/browse/HADOOP-6662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Xiao Kang reopened HADOOP-6662:
-------------------------------


Thanks for Hong Tang. Patch is not attached in HADOOP-4196 and the issue is still unresolved in release-0.20.2.

> hadoop zlib compression does not fully utilize the buffer
> ---------------------------------------------------------
>
>                 Key: HADOOP-6662
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6662
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: io
>    Affects Versions: 0.20.2
>            Reporter: Xiao Kang
>         Attachments: ZlibCompressor.patch
>
>
> org.apache.hadoop.io.compress.ZlibCompressonr does not fully utilize its buffer. 
> Its needesInput() return false when there is any data in its buffer (64K by default). The performance will greately degrade since an JNI call will be invoded at each time the write() method of CompressonStream is called. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.