You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Pranay akula <pr...@gmail.com> on 2017/07/18 19:24:31 UTC
Moving from DSE to Cassandra.
Planning to move from DSE to open source cassandra.
What will be better way to do it.
1) I am thinking of introducing new datacenter with apache cassandra and
replicating to that DC and after data replication remove DSE cassandra DC
2) Upgrading from current DSE version to later version of cassandra
possibly 2.2 or 3.x
Has anyone did it before any issues faced ??
Thanks
Pranay.
Re: Sync Spark Data with Cassandra Using Incremental Data Loading
Posted by Justin Cameron <ju...@instaclustr.com>.
The easiest way to do this is to create another Cassandra DC and point
Spark to it, since Spark can operate directly on data in Cassandra. No
impact on C* performance and no complex backup/restore process required,
just let Cassandra replicate the data for you.
If you need a scalable bulk export/import solution on your production data
that doesn't affect C* performance I would look at doing something like
this: https://www.youtube.com/watch?v=eY5oSZnwmJg . It's the best solution
I've seen to the problem.
On Wed, 19 Jul 2017 at 23:42 Fd Habash <fm...@gmail.com> wrote:
> I have a scenario where data has to be loaded into Spark nodes from two
> data stores: Oracle and Cassandra. We did the initial loading of data and
> found a way to do daily incremental loading from Oracle to Spark.
>
>
>
> I’m tying to figure our how to do this from C*. What tools are available
> in C* to do incremental backup/restore/load?
>
>
>
> Thanks
>
--
*Justin Cameron*Senior Software Engineer
<https://www.instaclustr.com/>
This email has been sent on behalf of Instaclustr Pty. Limited (Australia)
and Instaclustr Inc (USA).
This email and any attachments may contain confidential and legally
privileged information. If you are not the intended recipient, do not copy
or disclose its content, but please reply to this email immediately and
highlight the error to the sender and then immediately delete the message.
Sync Spark Data with Cassandra Using Incremental Data Loading
Posted by Fd Habash <fm...@gmail.com>.
I have a scenario where data has to be loaded into Spark nodes from two data stores: Oracle and Cassandra. We did the initial loading of data and found a way to do daily incremental loading from Oracle to Spark.
I’m tying to figure our how to do this from C*. What tools are available in C* to do incremental backup/restore/load?
Thanks
Re: Moving from DSE to Cassandra.
Posted by Harikrishnan Pillai <HP...@walmartlabs.com>.
yes.
________________________________
From: Harikrishnan Pillai <HP...@walmartlabs.com>
Sent: Tuesday, July 18, 2017 12:30 PM
To: user@cassandra.apache.org
Subject: EXT: Re: Moving from DSE to Cassandra.
Moving away from DSE to apache cassandra is easy.
If there are any keyspace with "EverywhereStrategy" strategies, change them to "NetworkTopologyStrategy" first.
particularly DSE system. Start in opensource mode and run sstable upgrade if needed.
Regards
Hari
________________________________
From: Pranay akula <pr...@gmail.com>
Sent: Tuesday, July 18, 2017 12:24 PM
To: user@cassandra.apache.org
Subject: EXT: Moving from DSE to Cassandra.
Planning to move from DSE to open source cassandra.
What will be better way to do it.
1) I am thinking of introducing new datacenter with apache cassandra and replicating to that DC and after data replication remove DSE cassandra DC
2) Upgrading from current DSE version to later version of cassandra possibly 2.2 or 3.x
Has anyone did it before any issues faced ??
Thanks
Pranay.
Re: Moving from DSE to Cassandra.
Posted by Pranay akula <pr...@gmail.com>.
So once i migrate to open source cassandra do i really need DSE keyspace ??
can't i just remove it ??
Thanks
Pranay.
On Tue, Jul 18, 2017 at 3:30 PM, Harikrishnan Pillai <
HPillai@walmartlabs.com> wrote:
> Moving away from DSE to apache cassandra is easy.
>
> If there are any keyspace with "EverywhereStrategy" strategies, change
> them to "NetworkTopologyStrategy" first.
>
> particularly DSE system. Start in opensource mode and run sstable
> upgrade if needed.
>
> Regards
>
> Hari
>
>
> ------------------------------
> *From:* Pranay akula <pr...@gmail.com>
> *Sent:* Tuesday, July 18, 2017 12:24 PM
> *To:* user@cassandra.apache.org
> *Subject:* EXT: Moving from DSE to Cassandra.
>
> Planning to move from DSE to open source cassandra.
>
> What will be better way to do it.
>
> 1) I am thinking of introducing new datacenter with apache cassandra and
> replicating to that DC and after data replication remove DSE cassandra DC
> 2) Upgrading from current DSE version to later version of cassandra
> possibly 2.2 or 3.x
>
> Has anyone did it before any issues faced ??
>
>
>
>
>
>
>
> Thanks
> Pranay.
>
Re: Moving from DSE to Cassandra.
Posted by Harikrishnan Pillai <HP...@walmartlabs.com>.
Moving away from DSE to apache cassandra is easy.
If there are any keyspace with "EverywhereStrategy" strategies, change them to "NetworkTopologyStrategy" first.
particularly DSE system. Start in opensource mode and run sstable upgrade if needed.
Regards
Hari
________________________________
From: Pranay akula <pr...@gmail.com>
Sent: Tuesday, July 18, 2017 12:24 PM
To: user@cassandra.apache.org
Subject: EXT: Moving from DSE to Cassandra.
Planning to move from DSE to open source cassandra.
What will be better way to do it.
1) I am thinking of introducing new datacenter with apache cassandra and replicating to that DC and after data replication remove DSE cassandra DC
2) Upgrading from current DSE version to later version of cassandra possibly 2.2 or 3.x
Has anyone did it before any issues faced ??
Thanks
Pranay.