You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Krish Donald <go...@gmail.com> on 2019/08/07 21:46:50 UTC
Backups in Cassandra
Hi Folks,
First question is , Do you take backup for your cassandra cluster ?
If answer is yes then question follows:
1. How do you take backup ?
1.1 ) Is it only snapshot?
1.2 ) We are on AWS with very large cluster around 51 nodes
with 1TB data on each node.
1.3) Do you take backup and move it to S3 ?
2. If you take backup, how restore process worked for you?
Thanks
Krish
RE: Backups in Cassandra
Posted by Rh...@swisscom.com.
Just to add to this…
We do snapshot, incremental and commitlog backups along with schema and config backups. All is copied to S3 although we do keep a small number of snapshots / inc / commitlog on the local node in the rare event they are needed.
We have written some Ansible to restore the whole cluster. If your cluster is beyond a trivial number of nodes then some type of manageable automation is required.
Cheers,
R
From: cclive1601你 <cc...@gmail.com>
Sent: 08 August 2019 04:30
To: user@cassandra.apache.org
Subject: Re: Backups in Cassandra
We have also made backup and restore for Apache Cassandra,backup process are
1.do incremental backup for flushed sstable ;do incremental backup for commitlog ;
2.do snapshot for the cluster periodically,also meta info are needed to backup(token and table info)；
3.for exception like node joining and move(if exist),leave ， refresh the meta info backup;
restore
1.use incremental sstable to reduce the number of commitlog for restore ,for log replay cost much time ;
2.all sstable can do bulkload(just node refresh （so ,my restore node's number need to be the same as backup,for sstableloader, it cost much time than this method,though use loader does not need the
node to be same as backup）)
Connor Lin <li...@gmail.com>> 于2019年8月8日周四 上午10:17写道：
Hi Krish,
It is recommended to have backups. Although I haven't practiced it myself, but I find this might be helpful.
https://thelastpickle.com/blog/2018/04/03/cassandra-backup-and-restore-aws-ebs.html
Sincerely yours,
Connor Lin
On Thu, Aug 8, 2019 at 5:47 AM Krish Donald <go...@gmail.com>> wrote:
Hi Folks,
First question is , Do you take backup for your cassandra cluster ?
If answer is yes then question follows:
1. How do you take backup ?
1.1 ) Is it only snapshot?
1.2 ) We are on AWS with very large cluster around 51 nodes with 1TB data on each node.
1.3) Do you take backup and move it to S3 ?
2. If you take backup, how restore process worked for you?
Thanks
Krish
--
you are the apple of my eye !
Re: Backups in Cassandra
Posted by cclive1601你 <cc...@gmail.com>.
We have also made backup and restore for Apache Cassandra,backup process
are
1.do incremental backup for flushed sstable ;do incremental backup for
commitlog ;
2.do snapshot for the cluster periodically,also meta info are needed to
backup(token and table info)；
3.for exception like node joining and move(if exist),leave ， refresh the
meta info backup;
restore
1.use incremental sstable to reduce the number of commitlog for restore
,for log replay cost much time ;
2.all sstable can do bulkload(just node refresh （so ,my restore node's
number need to be the same as backup,for sstableloader, it cost much time
than this method,though use loader does not need the
node to be same as backup）)
Connor Lin <li...@gmail.com> 于2019年8月8日周四 上午10:17写道：
> Hi Krish,
>
> It is recommended to have backups. Although I haven't practiced it myself,
> but I find this might be helpful.
>
> https://thelastpickle.com/blog/2018/04/03/cassandra-backup-and-restore-aws-ebs.html
>
> Sincerely yours,
>
> Connor Lin
>
>
> On Thu, Aug 8, 2019 at 5:47 AM Krish Donald <go...@gmail.com> wrote:
>
>> Hi Folks,
>>
>> First question is , Do you take backup for your cassandra cluster ?
>> If answer is yes then question follows:
>> 1. How do you take backup ?
>> 1.1 ) Is it only snapshot?
>> 1.2 ) We are on AWS with very large cluster around 51 nodes
>> with 1TB data on each node.
>> 1.3) Do you take backup and move it to S3 ?
>>
>> 2. If you take backup, how restore process worked for you?
>>
>> Thanks
>> Krish
>>
>
--
you are the apple of my eye !
Re: Backups in Cassandra
Posted by Connor Lin <li...@gmail.com>.
Hi Krish,
It is recommended to have backups. Although I haven't practiced it myself,
but I find this might be helpful.
https://thelastpickle.com/blog/2018/04/03/cassandra-backup-and-restore-aws-ebs.html
Sincerely yours,
Connor Lin
On Thu, Aug 8, 2019 at 5:47 AM Krish Donald <go...@gmail.com> wrote:
> Hi Folks,
>
> First question is , Do you take backup for your cassandra cluster ?
> If answer is yes then question follows:
> 1. How do you take backup ?
> 1.1 ) Is it only snapshot?
> 1.2 ) We are on AWS with very large cluster around 51 nodes
> with 1TB data on each node.
> 1.3) Do you take backup and move it to S3 ?
>
> 2. If you take backup, how restore process worked for you?
>
> Thanks
> Krish
>