You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Vijay (JIRA)" <ji...@apache.org> on 2012/07/09 06:25:33 UTC

[jira] [Updated] (CASSANDRA-4388) Use MMap for CompressedSegmentFile with Native Checksum

     [ https://issues.apache.org/jira/browse/CASSANDRA-4388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Vijay updated CASSANDRA-4388:
-----------------------------

    Attachment: 0001-CASSANDRA-4388.patch

There is 2 parts to this patch:
1) We have to support MMap to get access to DirectBB
2) Use hadoop's native API to use native CRC & CRCC 

For the second part needs Native C library which is included in the alpha version of hadoop jar. Hence we might want to wait till it is released (to avoid breaking other dependent code).

Bench Mark (First part is still better): 
http://pastebin.com/g4p3Sf6v
                
> Use MMap for CompressedSegmentFile with Native Checksum
> -------------------------------------------------------
>
>                 Key: CASSANDRA-4388
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-4388
>             Project: Cassandra
>          Issue Type: Improvement
>          Components: Core
>    Affects Versions: 1.2
>            Reporter: Vijay
>            Assignee: Vijay
>         Attachments: 0001-CASSANDRA-4388.patch
>
>
> Use MMap for CompressedSegmentFile (Something similar to CASSANDRA-3623) and use Native Checksum (HDFS-2080) to avoid memcpy and be faster in its calculations.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira