You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Lee Parker <le...@socialagency.com> on 2010/04/15 22:47:30 UTC
json2sstable
Has anyone used json2sstable to migrate a large amount of data into
cassandra? What was your methodology? I assume that this will be much
faster than stepping through my data and doing writes via PHP/Thrift.
Lee Parker
Re: json2sstable
Posted by Brandon Williams <dr...@gmail.com>.
On Thu, Apr 15, 2010 at 3:47 PM, Lee Parker <le...@socialagency.com> wrote:
> Has anyone used json2sstable to migrate a large amount of data into
> cassandra? What was your methodology? I assume that this will be much
> faster than stepping through my data and doing writes via PHP/Thrift.
If you're looking to do a bulk import, peek at contrib/bmt_example.
-Brandon
Re: json2sstable
Posted by 孔令华 <ko...@gmail.com>.
I tried that and found that it cannot handle large file at present.
But you can write a tool according to it.
eg: first sorting your data file according to it's hash key; second, write
to a SSTable directly
On Fri, Apr 16, 2010 at 4:47 AM, Lee Parker <le...@socialagency.com> wrote:
> Has anyone used json2sstable to migrate a large amount of data into
> cassandra? What was your methodology? I assume that this will be much
> faster than stepping through my data and doing writes via PHP/Thrift.
>
> Lee Parker
>