You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by 曹志富 <ca...@gmail.com> on 2015/02/03 03:05:43 UTC
How to deal with too many sstables
Hi,all:
I have 18 nodes C* cluster with cassandra2.1.2.Some nodes have aboud
40,000+ sstables.
my compaction strategy is STCS.
Could someone give me some solution to deal with this situation.
Thanks.
--------------------------------------
曹志富
手机：18611121927
邮箱：caozf.zhifu@gmail.com
微博：http://weibo.com/boliza/
Re: How to deal with too many sstables
Posted by Marcus Eriksson <kr...@gmail.com>.
https://issues.apache.org/jira/browse/CASSANDRA-8635
On Tue, Feb 3, 2015 at 5:47 AM, 曹志富 <ca...@gmail.com> wrote:
> Just run nodetool repair.
>
> The nodes witch has many sstables are newest in my cluster.Before add
> these nodes to my cluster ,my cluster have not compaction automaticly
> because my cluster is an only write cluster.
>
> thanks.
>
> --------------------------------------
> 曹志富
> 手机：18611121927
> 邮箱：caozf.zhifu@gmail.com
> 微博：http://weibo.com/boliza/
>
> 2015-02-03 12:16 GMT+08:00 Flavien Charlon <fl...@gmail.com>:
>
>> Did you run incremental repair? Incremental repair is broken in 2.1 and
>> tends to create way too many SSTables.
>>
>> On 2 February 2015 at 18:05, 曹志富 <ca...@gmail.com> wrote:
>>
>>> Hi,all:
>>> I have 18 nodes C* cluster with cassandra2.1.2.Some nodes have aboud
>>> 40,000+ sstables.
>>>
>>> my compaction strategy is STCS.
>>>
>>> Could someone give me some solution to deal with this situation.
>>>
>>> Thanks.
>>> --------------------------------------
>>> 曹志富
>>> 手机：18611121927
>>> 邮箱：caozf.zhifu@gmail.com
>>> 微博：http://weibo.com/boliza/
>>>
>>
>>
>
Re: How to deal with too many sstables
Posted by 曹志富 <ca...@gmail.com>.
Just run nodetool repair.
The nodes witch has many sstables are newest in my cluster.Before add these
nodes to my cluster ,my cluster have not compaction automaticly because my
cluster is an only write cluster.
thanks.
--------------------------------------
曹志富
手机：18611121927
邮箱：caozf.zhifu@gmail.com
微博：http://weibo.com/boliza/
2015-02-03 12:16 GMT+08:00 Flavien Charlon <fl...@gmail.com>:
> Did you run incremental repair? Incremental repair is broken in 2.1 and
> tends to create way too many SSTables.
>
> On 2 February 2015 at 18:05, 曹志富 <ca...@gmail.com> wrote:
>
>> Hi,all:
>> I have 18 nodes C* cluster with cassandra2.1.2.Some nodes have aboud
>> 40,000+ sstables.
>>
>> my compaction strategy is STCS.
>>
>> Could someone give me some solution to deal with this situation.
>>
>> Thanks.
>> --------------------------------------
>> 曹志富
>> 手机：18611121927
>> 邮箱：caozf.zhifu@gmail.com
>> 微博：http://weibo.com/boliza/
>>
>
>
Re: How to deal with too many sstables
Posted by Flavien Charlon <fl...@gmail.com>.
Did you run incremental repair? Incremental repair is broken in 2.1 and
tends to create way too many SSTables.
On 2 February 2015 at 18:05, 曹志富 <ca...@gmail.com> wrote:
> Hi,all:
> I have 18 nodes C* cluster with cassandra2.1.2.Some nodes have aboud
> 40,000+ sstables.
>
> my compaction strategy is STCS.
>
> Could someone give me some solution to deal with this situation.
>
> Thanks.
> --------------------------------------
> 曹志富
> 手机：18611121927
> 邮箱：caozf.zhifu@gmail.com
> 微博：http://weibo.com/boliza/
>
Re: How to deal with too many sstables
Posted by 曹志富 <ca...@gmail.com>.
You are right.I have already change cold_reads_to_omit to 0.0.
--------------------------------------
曹志富
手机：18611121927
邮箱：caozf.zhifu@gmail.com
微博：http://weibo.com/boliza/
2015-02-03 14:15 GMT+08:00 Roland Etzenhammer <r....@t-online.de>:
> Hi,
>
> maybe you are running into an issue that I also had on my test cluster.
> Since there were almost no reads on it cassandra did not run any minor
> compactions at all. Solution for me (in this case) was:
>
> ALTER TABLE <tablename> WITH compaction = {'class':
> 'SizeTieredCompactionStrategy', 'min_threshold': '4', 'max_threshold':
> '32', 'cold_reads_to_omit': 0.0};
> where cold_reads_to_omit is the "trick".
>
> Anyway as Eric and Marcus among others suggest, do not run 2.1.2 for
> production as it has many issues. I'm looking forward to test 2.1.3 when it
> arrives.
>
> Cheers,
> Roland
>
>
> Am 03.02.2015 um 03:05 schrieb 曹志富:
>
> Hi,all:
> I have 18 nodes C* cluster with cassandra2.1.2.Some nodes have aboud
> 40,000+ sstables.
>
> my compaction strategy is STCS.
>
> Could someone give me some solution to deal with this situation.
>
> Thanks.
> --------------------------------------
> 曹志富
> 手机：18611121927
> 邮箱：caozf.zhifu@gmail.com
> 微博：http://weibo.com/boliza/
>
>
>
Re: How to deal with too many sstables
Posted by Roland Etzenhammer <r....@t-online.de>.
Hi,
maybe you are running into an issue that I also had on my test cluster.
Since there were almost no reads on it cassandra did not run any minor
compactions at all. Solution for me (in this case) was:
ALTER TABLE <tablename> WITH compaction = {'class':
'SizeTieredCompactionStrategy', 'min_threshold': '4', 'max_threshold':
'32', 'cold_reads_to_omit': 0.0};
where cold_reads_to_omit is the "trick".
Anyway as Eric and Marcus among others suggest, do not run 2.1.2 for
production as it has many issues. I'm looking forward to test 2.1.3 when
it arrives.
Cheers,
Roland
Am 03.02.2015 um 03:05 schrieb 曹志富:
> Hi,all:
> I have 18 nodes C* cluster with cassandra2.1.2.Some nodes have aboud
> 40,000+ sstables.
>
> my compaction strategy is STCS.
>
> Could someone give me some solution to deal with this situation.
>
> Thanks.
> --------------------------------------
> 曹志富
> 手机：18611121927
> 邮箱：caozf.zhifu@gmail.com <ma...@gmail.com>
> 微博：http://weibo.com/boliza/