You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-dev@hadoop.apache.org by "James (JIRA)" <ji...@apache.org> on 2013/01/10 22:42:12 UTC

[jira] [Created] (HADOOP-9196) Modify BloomFilter.write() to address memory concerns

James created HADOOP-9196:
-----------------------------

             Summary: Modify BloomFilter.write() to address memory concerns
                 Key: HADOOP-9196
                 URL: https://issues.apache.org/jira/browse/HADOOP-9196
             Project: Hadoop Common
          Issue Type: Improvement
            Reporter: James
            Priority: Minor


It appears that org.apache.hadoop.util.bloom.BloomFilter's write() method creates a byte array large enough to fit the entire bit vector into memory during serialization.  This is unnecessary and may cause out of memory issues if the bit vector is sufficiently large and memory is tight.   

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira