[jira] Issue Comment Edited: (CASSANDRA-674) New SSTable Format

["Stu Hood (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/CASSANDRA-674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12989108#comment-12989108 ] 

Stu Hood edited comment on CASSANDRA-674 at 2/1/11 9:17 AM:
------------------------------------------------------------

Attaching a snapshot of the work on this new design for the file format. There are a few important blockers not implemented, as evidenced by failing tests, but I feel confident that serialization and format themselves are solid.

Please carefully note the caveats listed under {{v2}} on the design doc: http://wiki.apache.org/cassandra/FileFormatDesignDoc#v2 In particular, we will barely see the benefits of compression with this implementation, because only Spans are storing at most 1 row. Storing more than one row in a span will require an index change, and I'd feel much better doing it once this is in trunk.

EDIT: Also, this necessarily applies atop CASSANDRA-2062.

      was (Author: stuhood):
    Attaching a snapshot of the work on this new design for the file format. There are a few important blockers not implemented, as evidenced by failing tests, but I feel confident that serialization and format themselves are solid.

Please carefully note the caveats listed under {{v2}} on the design doc: http://wiki.apache.org/cassandra/FileFormatDesignDoc#v2 In particular, we will barely see the benefits of compression with this implementation, because only Spans are storing at most 1 row. Storing more than one row in a span will require an index change, and I'd feel much better doing it once this is in trunk.
  
> New SSTable Format
> ------------------
>
>                 Key: CASSANDRA-674
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-674
>             Project: Cassandra
>          Issue Type: Improvement
>          Components: Core
>            Reporter: Stu Hood
>             Fix For: 0.8
>
>         Attachments: 674-v1.diff, 674-v2.tgz, perf-674-v1.txt, perf-trunk-2f3d2c0e4845faf62e33c191d152cb1b3fa62806.txt
>
>
> Various tickets exist due to limitations in the SSTable file format, including #16, #47 and #328. Attached is a proposed design/implementation of a new file format for SSTables that addresses a few of these limitations.
> This v2 implementation is not ready for serious use: see comments for remaining issues. It is roughly the format described here: http://wiki.apache.org/cassandra/FileFormatDesignDoc 

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira