You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Abhishek Aggarwal <ab...@snapdeal.com> on 2016/04/01 11:55:52 UTC
Cassandra sstable to Mysql
Hi ,
We have the data dump into directory taken from Mysql using the
CQLSSTableWriter.
Our requirement is to read this data and load it into MySql. We don't want
to use Cassandra as it will lead to read traffic and this operation is just
for some validation .
Can anyone help us with the solution.
Abhishek Aggarwal
*Senior Software Engineer*
*M*: +91 8861212073 , 8588840304
*T*: 0124 6600600 *EXT*: 12128
ASF Center -A, ASF Center Udyog Vihar Phase IV,
Download Our App
[image: A]
<https://play.google.com/store/apps/details?id=com.snapdeal.main&utm_source=mobileAppLp&utm_campaign=android>
[image:
A]
<https://itunes.apple.com/in/app/snapdeal-mobile-shopping/id721124909?ls=1&mt=8&utm_source=mobileAppLp&utm_campaign=ios>
[image:
W]
<http://www.windowsphone.com/en-in/store/app/snapdeal/ee17fccf-40d0-4a59-80a3-04da47a5553f>
Re: Cassandra sstable to Mysql
Posted by Abhishek Aggarwal <ab...@snapdeal.com>.
Thanks Bryan,
I don't want to use the sstable as it will increase the load on Cassandra .
I directly want to use the data file created using the CQLSSTablewriter for
migrating to Mysql.
Abhishek Aggarwal
*Senior Software Engineer*
*M*: +91 8861212073 , 8588840304
*T*: 0124 6600600 *EXT*: 12128
ASF Center -A, ASF Center Udyog Vihar Phase IV,
Download Our App
[image: A]
<https://play.google.com/store/apps/details?id=com.snapdeal.main&utm_source=mobileAppLp&utm_campaign=android>
[image:
A]
<https://itunes.apple.com/in/app/snapdeal-mobile-shopping/id721124909?ls=1&mt=8&utm_source=mobileAppLp&utm_campaign=ios>
[image:
W]
<http://www.windowsphone.com/en-in/store/app/snapdeal/ee17fccf-40d0-4a59-80a3-04da47a5553f>
On Sun, Apr 3, 2016 at 12:30 AM, Bryan Cheng <br...@blockcypher.com> wrote:
> You have SSTables and you want to get importable data?
>
> You could use a tool like sstabletojson to get json formatted data
> directly from the sstables; however, unless they've been perfectly
> compacted, there will be duplicates and updates interleaved that will be
> properly ordered.
>
> If this is a full dump from a single machine that has a complete dataset
> (eg. with RF=n) you could spin up a new machine with just itself as a seed
> but all other configuration intact. If this new machine gets an identical
> copy of the cassandra data directory, it will start itself as a clone of
> the machine the dump came off of, but walled off from the previous cluster.
> (I have tested this with vnodes, but I believe it is more involved without
> vnodes). Then you can use CQL COPY or an application to bulk load into
> MySQL.
>
> On Fri, Apr 1, 2016 at 2:55 AM, Abhishek Aggarwal <
> abhishek.aggarwal01@snapdeal.com> wrote:
>
>> Hi ,
>>
>> We have the data dump into directory taken from Mysql using the
>> CQLSSTableWriter.
>>
>> Our requirement is to read this data and load it into MySql. We don't
>> want to use Cassandra as it will lead to read traffic and this operation is
>> just for some validation .
>>
>> Can anyone help us with the solution.
>>
>> Abhishek Aggarwal
>>
>> *Senior Software Engineer*
>> *M*: +91 8861212073 , 8588840304
>> *T*: 0124 6600600 *EXT*: 12128
>> ASF Center -A, ASF Center Udyog Vihar Phase IV,
>> Download Our App
>> [image: A]
>> <https://play.google.com/store/apps/details?id=com.snapdeal.main&utm_source=mobileAppLp&utm_campaign=android> [image:
>> A]
>> <https://itunes.apple.com/in/app/snapdeal-mobile-shopping/id721124909?ls=1&mt=8&utm_source=mobileAppLp&utm_campaign=ios> [image:
>> W]
>> <http://www.windowsphone.com/en-in/store/app/snapdeal/ee17fccf-40d0-4a59-80a3-04da47a5553f>
>>
>
>
Re: Cassandra sstable to Mysql
Posted by Bryan Cheng <br...@blockcypher.com>.
You have SSTables and you want to get importable data?
You could use a tool like sstabletojson to get json formatted data directly
from the sstables; however, unless they've been perfectly compacted, there
will be duplicates and updates interleaved that will be properly ordered.
If this is a full dump from a single machine that has a complete dataset
(eg. with RF=n) you could spin up a new machine with just itself as a seed
but all other configuration intact. If this new machine gets an identical
copy of the cassandra data directory, it will start itself as a clone of
the machine the dump came off of, but walled off from the previous cluster.
(I have tested this with vnodes, but I believe it is more involved without
vnodes). Then you can use CQL COPY or an application to bulk load into
MySQL.
On Fri, Apr 1, 2016 at 2:55 AM, Abhishek Aggarwal <
abhishek.aggarwal01@snapdeal.com> wrote:
> Hi ,
>
> We have the data dump into directory taken from Mysql using the
> CQLSSTableWriter.
>
> Our requirement is to read this data and load it into MySql. We don't want
> to use Cassandra as it will lead to read traffic and this operation is just
> for some validation .
>
> Can anyone help us with the solution.
>
> Abhishek Aggarwal
>
> *Senior Software Engineer*
> *M*: +91 8861212073 , 8588840304
> *T*: 0124 6600600 *EXT*: 12128
> ASF Center -A, ASF Center Udyog Vihar Phase IV,
> Download Our App
> [image: A]
> <https://play.google.com/store/apps/details?id=com.snapdeal.main&utm_source=mobileAppLp&utm_campaign=android> [image:
> A]
> <https://itunes.apple.com/in/app/snapdeal-mobile-shopping/id721124909?ls=1&mt=8&utm_source=mobileAppLp&utm_campaign=ios> [image:
> W]
> <http://www.windowsphone.com/en-in/store/app/snapdeal/ee17fccf-40d0-4a59-80a3-04da47a5553f>
>