You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Jonathan Ellis (Resolved) (JIRA)" <ji...@apache.org> on 2012/01/05 14:47:39 UTC

[jira] [Resolved] (CASSANDRA-3698) Write sstables to HDFS and stream them to cassandar using Sstableloader.

     [ https://issues.apache.org/jira/browse/CASSANDRA-3698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Ellis resolved CASSANDRA-3698.
---------------------------------------

       Resolution: Won't Fix
    Fix Version/s:     (was: 1.1)

Just write them directly with BulkOutputFormat and skip the intermediate step.
                
> Write sstables to HDFS and stream them to cassandar using Sstableloader.
> ------------------------------------------------------------------------
>
>                 Key: CASSANDRA-3698
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-3698
>             Project: Cassandra
>          Issue Type: Improvement
>          Components: Tools
>            Reporter: Samarth Gahire
>              Labels: SSTableWriter, hadoop, hdfs, sstableloader
>   Original Estimate: 168h
>  Remaining Estimate: 168h
>
> As data size is growing very fast we are planning to create the sstables right from the Hadoop reduce job.
> For that 
> 1) SSTableSimpleUnsortedWriter should be able to write sstables created to the HDFS .
> 2) Sstableloader utility should be able to read from HDFS to stream those sstables to Cassandra

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira