You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Samarth Gahire (Created) (JIRA)" <ji...@apache.org> on 2012/01/05 10:43:39 UTC
[jira] [Created] (CASSANDRA-3698) Write sstables to HDFS and stream
them to cassandar using Sstableloader.
Write sstables to HDFS and stream them to cassandar using Sstableloader.
------------------------------------------------------------------------
Key: CASSANDRA-3698
URL: https://issues.apache.org/jira/browse/CASSANDRA-3698
Project: Cassandra
Issue Type: Improvement
Components: Tools
Reporter: Samarth Gahire
Fix For: 1.1
As data size is growing very fast we are planning to create the sstables right from the Haddop reduce job.
For that
1) SSTableSimpleUnsortedWriter should be able to write sstables created to the HDFS .
2) Sstableloader utility should be able to read from HDFS to stream those sstables to Cassandra
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3698) Write sstables to HDFS and stream
them to cassandar using Sstableloader.
Posted by "Samarth Gahire (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Samarth Gahire updated CASSANDRA-3698:
--------------------------------------
Description:
As data size is growing very fast we are planning to create the sstables right from the Hadoop reduce job.
For that
1) SSTableSimpleUnsortedWriter should be able to write sstables created to the HDFS .
2) Sstableloader utility should be able to read from HDFS to stream those sstables to Cassandra
was:
As data size is growing very fast we are planning to create the sstables right from the Haddop reduce job.
For that
1) SSTableSimpleUnsortedWriter should be able to write sstables created to the HDFS .
2) Sstableloader utility should be able to read from HDFS to stream those sstables to Cassandra
> Write sstables to HDFS and stream them to cassandar using Sstableloader.
> ------------------------------------------------------------------------
>
> Key: CASSANDRA-3698
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3698
> Project: Cassandra
> Issue Type: Improvement
> Components: Tools
> Reporter: Samarth Gahire
> Labels: SSTableWriter, hadoop, hdfs, sstableloader
> Fix For: 1.1
>
> Original Estimate: 168h
> Remaining Estimate: 168h
>
> As data size is growing very fast we are planning to create the sstables right from the Hadoop reduce job.
> For that
> 1) SSTableSimpleUnsortedWriter should be able to write sstables created to the HDFS .
> 2) Sstableloader utility should be able to read from HDFS to stream those sstables to Cassandra
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (CASSANDRA-3698) Write sstables to HDFS and
stream them to cassandar using Sstableloader.
Posted by "Jonathan Ellis (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Ellis resolved CASSANDRA-3698.
---------------------------------------
Resolution: Won't Fix
Fix Version/s: (was: 1.1)
Just write them directly with BulkOutputFormat and skip the intermediate step.
> Write sstables to HDFS and stream them to cassandar using Sstableloader.
> ------------------------------------------------------------------------
>
> Key: CASSANDRA-3698
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3698
> Project: Cassandra
> Issue Type: Improvement
> Components: Tools
> Reporter: Samarth Gahire
> Labels: SSTableWriter, hadoop, hdfs, sstableloader
> Original Estimate: 168h
> Remaining Estimate: 168h
>
> As data size is growing very fast we are planning to create the sstables right from the Hadoop reduce job.
> For that
> 1) SSTableSimpleUnsortedWriter should be able to write sstables created to the HDFS .
> 2) Sstableloader utility should be able to read from HDFS to stream those sstables to Cassandra
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira