You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by srinivas rao <pi...@gmail.com> on 2014/11/11 13:51:54 UTC
Better option to load data to cassandra
Hi Team,
Please suggest me the better options to load data from NoSql to Cassndra.
Thanks
Srini
Re: Better option to load data to cassandra
Posted by Shane Hansen <sh...@gmail.com>.
So sstableloader is a cpu efficient online method of loading data if you
already have sstables.
An option you may not have considered is just using batch inserts. It was a
surprise to me coming from another
database system, but C*'s primary use case is shoving data to an append
only log. Is there a faster way to write a chunk
of data other than as sequential writes?
The only caveat is that there seems to be more parsing overhead (source:
jvisualvm) when going
the batch writing route, which is why I made sure to mention sstable
loader's cpu efficiency.
On Thu, Nov 13, 2014 at 5:10 AM, Jonathan Lacefield <jlacefield@datastax.com
> wrote:
> Here's another post which is pretty comprehensive for this topic.
> http://informationsurvival.blogspot.com/2014/02/cassandra-cql3-integration.html
>
>
>
> [image: datastax_logo.png]
>
> Jonathan Lacefield
>
> Solution Architect | (404) 822 3487 | jlacefield@datastax.com
>
> [image: linkedin.png] <http://www.linkedin.com/in/jlacefield/> [image:
> facebook.png] <https://www.facebook.com/datastax> [image: twitter.png]
> <https://twitter.com/datastax> [image: g+.png]
> <https://plus.google.com/+Datastax/about>
> <http://feeds.feedburner.com/datastax> <https://github.com/datastax/>
>
> On Thu, Nov 13, 2014 at 3:16 AM, Robert Coli <rc...@eventbrite.com> wrote:
>
>> On Wed, Nov 12, 2014 at 5:19 PM, cass savy <ca...@gmail.com> wrote:
>>
>>> Sstableloader works well for large tables if you want to move data from
>>> Cassandra to Cassandra. This works if both C* are on the same version.
>>>
>>> Sstable2json and json2sstable is another alternative.
>>>
>> This post is getting a bit long in the tooth, but is still pretty
>> relevant :
>>
>> http://www.palominodb.com/blog/2012/09/25/bulk-loading-options-cassandra
>>
>> =Rob
>> http://twitter.com/rcolidba
>>
>
>
Re: Better option to load data to cassandra
Posted by Jonathan Lacefield <jl...@datastax.com>.
Here's another post which is pretty comprehensive for this topic.
http://informationsurvival.blogspot.com/2014/02/cassandra-cql3-integration.html
[image: datastax_logo.png]
Jonathan Lacefield
Solution Architect | (404) 822 3487 | jlacefield@datastax.com
[image: linkedin.png] <http://www.linkedin.com/in/jlacefield/> [image:
facebook.png] <https://www.facebook.com/datastax> [image: twitter.png]
<https://twitter.com/datastax> [image: g+.png]
<https://plus.google.com/+Datastax/about>
<http://feeds.feedburner.com/datastax> <https://github.com/datastax/>
On Thu, Nov 13, 2014 at 3:16 AM, Robert Coli <rc...@eventbrite.com> wrote:
> On Wed, Nov 12, 2014 at 5:19 PM, cass savy <ca...@gmail.com> wrote:
>
>> Sstableloader works well for large tables if you want to move data from
>> Cassandra to Cassandra. This works if both C* are on the same version.
>>
>> Sstable2json and json2sstable is another alternative.
>>
> This post is getting a bit long in the tooth, but is still pretty relevant
> :
>
> http://www.palominodb.com/blog/2012/09/25/bulk-loading-options-cassandra
>
> =Rob
> http://twitter.com/rcolidba
>
Re: Better option to load data to cassandra
Posted by Robert Coli <rc...@eventbrite.com>.
On Wed, Nov 12, 2014 at 5:19 PM, cass savy <ca...@gmail.com> wrote:
> Sstableloader works well for large tables if you want to move data from
> Cassandra to Cassandra. This works if both C* are on the same version.
>
> Sstable2json and json2sstable is another alternative.
>
This post is getting a bit long in the tooth, but is still pretty relevant :
http://www.palominodb.com/blog/2012/09/25/bulk-loading-options-cassandra
=Rob
http://twitter.com/rcolidba
Re: Better option to load data to cassandra
Posted by cass savy <ca...@gmail.com>.
Sstableloader works well for large tables if you want to move data from
Cassandra to Cassandra. This works if both C* are on the same version.
Sstable2json and json2sstable is another alternative.
On Nov 11, 2014 4:53 AM, "srinivas rao" <pi...@gmail.com> wrote:
> Hi Team,
>
> Please suggest me the better options to load data from NoSql to Cassndra.
>
>
>
> Thanks
> Srini
>
Re: Better option to load data to cassandra
Posted by Brice Dutheil <br...@gmail.com>.
On our project we wrote ourself a custom batch to load the data to
cassandra the way we wanted.
-- Brice
On Tue, Nov 11, 2014 at 2:33 PM, srinivas rao <pi...@gmail.com>
wrote:
> hi Alexey,
>
> i tried with sqoop, and data stax copy command. any other options we can
> use.
>
> i have one more question that, have a table with compisite key as row key,
> so how can i do using sqoop or copy command while exporing.
>
> Thanks
> Srinivas
>
>
> On Tue, Nov 11, 2014 at 6:28 PM, Plotnik, Alexey <ap...@rhonda.ru>
> wrote:
>
>> What have you tried?
>>
>> ------ Original Message ------
>> From: "srinivas rao" <pi...@gmail.com>
>> To: "Cassandra Users" <us...@cassandra.apache.org>
>> Sent: 11.11.2014 22:51:54
>> Subject: Better option to load data to cassandra
>>
>>
>> Hi Team,
>>
>> Please suggest me the better options to load data from NoSql to Cassndra.
>>
>>
>>
>> Thanks
>> Srini
>>
>>
>
Re: Better option to load data to cassandra
Posted by srinivas rao <pi...@gmail.com>.
hi Alexey,
i tried with sqoop, and data stax copy command. any other options we can
use.
i have one more question that, have a table with compisite key as row key,
so how can i do using sqoop or copy command while exporing.
Thanks
Srinivas
On Tue, Nov 11, 2014 at 6:28 PM, Plotnik, Alexey <ap...@rhonda.ru> wrote:
> What have you tried?
>
> ------ Original Message ------
> From: "srinivas rao" <pi...@gmail.com>
> To: "Cassandra Users" <us...@cassandra.apache.org>
> Sent: 11.11.2014 22:51:54
> Subject: Better option to load data to cassandra
>
>
> Hi Team,
>
> Please suggest me the better options to load data from NoSql to Cassndra.
>
>
>
> Thanks
> Srini
>
>
Re: Better option to load data to cassandra
Posted by "Plotnik, Alexey" <ap...@rhonda.ru>.
What have you tried?
------ Original Message ------
From: "srinivas rao" <pi...@gmail.com>>
To: "Cassandra Users" <us...@cassandra.apache.org>>
Sent: 11.11.2014 22:51:54
Subject: Better option to load data to cassandra
Hi Team,
Please suggest me the better options to load data from NoSql to Cassndra.
Thanks
Srini