You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by ruslan usifov <ru...@gmail.com> on 2012/06/01 11:52:41 UTC
row_cache_provider = 'SerializingCacheProvider'
Hello
I begin use SerializingCacheProvider for rows cashing, and got
extremely JAVA heap grows. But i think that this cache provider
doesn't use JAVA heap
Re: row_cache_provider = 'SerializingCacheProvider'
Posted by ruslan usifov <ru...@gmail.com>.
I think that SerializingCacheProvider have more JAVA HEAP footprint,
then i think
2012/6/4 ruslan usifov <ru...@gmail.com>:
> I have setup 5GB of JavaHeap wit follow tuning:
>
> MAX_HEAP_SIZE="5G"
> HEAP_NEWSIZE="800M"
>
> JVM_OPTS="$JVM_OPTS -XX:+UseParNewGC"
> JVM_OPTS="$JVM_OPTS -XX:+UseConcMarkSweepGC"
> JVM_OPTS="$JVM_OPTS -XX:+CMSParallelRemarkEnabled"
> JVM_OPTS="$JVM_OPTS -XX:SurvivorRatio=8"
> JVM_OPTS="$JVM_OPTS -XX:MaxTenuringThreshold=5"
> JVM_OPTS="$JVM_OPTS -XX:CMSInitiatingOccupancyFraction=65"
> JVM_OPTS="$JVM_OPTS -XX:+UseCMSInitiatingOccupancyOnly"
> JVM_OPTS="$JVM_OPTS -XX:CMSFullGCsBeforeCompaction=1"
>
> Also I set up 2GB to memtables (memtable_total_space_in_mb: 2048)
>
>
> My avg heap usage (nodetool -h localhost info):
>
> 3G
>
>
> Based on "nodetool -h localhost cfhistograms" i calc avg row size
>
> 70KB
>
> I setup row cache only for one CF with follow settings:
>
> update column family building with rows_cached=10000 and
> row_cache_provider='SerializingCacheProvider';
>
>
> When i setup row cache i got promotion failure in GC (with stop the
> world pause about 30secs) with almost HEAP filled. I very confused
> with this behavior.
>
>
> PS: i use cassandra 1.0.10, with JNA 3.4.0 on ubuntu lucid (kernel 2.6.32-41)
>
>
> 2012/6/4 aaron morton <aa...@thelastpickle.com>:
>> Yes SerializingCacheProvider is the off heap caching provider.
>>
>> Can you do some more digging into what is using the heap ?
>>
>> Cheers
>> A
>>
>> -----------------
>> Aaron Morton
>> Freelance Developer
>> @aaronmorton
>> http://www.thelastpickle.com
>>
>> On 1/06/2012, at 9:52 PM, ruslan usifov wrote:
>>
>> Hello
>>
>> I begin use SerializingCacheProvider for rows cashing, and got
>> extremely JAVA heap grows. But i think that this cache provider
>> doesn't use JAVA heap
>>
>>
Re: row_cache_provider = 'SerializingCacheProvider'
Posted by ruslan usifov <ru...@gmail.com>.
I have setup 5GB of JavaHeap wit follow tuning:
MAX_HEAP_SIZE="5G"
HEAP_NEWSIZE="800M"
JVM_OPTS="$JVM_OPTS -XX:+UseParNewGC"
JVM_OPTS="$JVM_OPTS -XX:+UseConcMarkSweepGC"
JVM_OPTS="$JVM_OPTS -XX:+CMSParallelRemarkEnabled"
JVM_OPTS="$JVM_OPTS -XX:SurvivorRatio=8"
JVM_OPTS="$JVM_OPTS -XX:MaxTenuringThreshold=5"
JVM_OPTS="$JVM_OPTS -XX:CMSInitiatingOccupancyFraction=65"
JVM_OPTS="$JVM_OPTS -XX:+UseCMSInitiatingOccupancyOnly"
JVM_OPTS="$JVM_OPTS -XX:CMSFullGCsBeforeCompaction=1"
Also I set up 2GB to memtables (memtable_total_space_in_mb: 2048)
My avg heap usage (nodetool -h localhost info):
3G
Based on "nodetool -h localhost cfhistograms" i calc avg row size
70KB
I setup row cache only for one CF with follow settings:
update column family building with rows_cached=10000 and
row_cache_provider='SerializingCacheProvider';
When i setup row cache i got promotion failure in GC (with stop the
world pause about 30secs) with almost HEAP filled. I very confused
with this behavior.
PS: i use cassandra 1.0.10, with JNA 3.4.0 on ubuntu lucid (kernel 2.6.32-41)
2012/6/4 aaron morton <aa...@thelastpickle.com>:
> Yes SerializingCacheProvider is the off heap caching provider.
>
> Can you do some more digging into what is using the heap ?
>
> Cheers
> A
>
> -----------------
> Aaron Morton
> Freelance Developer
> @aaronmorton
> http://www.thelastpickle.com
>
> On 1/06/2012, at 9:52 PM, ruslan usifov wrote:
>
> Hello
>
> I begin use SerializingCacheProvider for rows cashing, and got
> extremely JAVA heap grows. But i think that this cache provider
> doesn't use JAVA heap
>
>
Re: row_cache_provider = 'SerializingCacheProvider'
Posted by aaron morton <aa...@thelastpickle.com>.
Yes SerializingCacheProvider is the off heap caching provider.
Can you do some more digging into what is using the heap ?
Cheers
A
-----------------
Aaron Morton
Freelance Developer
@aaronmorton
http://www.thelastpickle.com
On 1/06/2012, at 9:52 PM, ruslan usifov wrote:
> Hello
>
> I begin use SerializingCacheProvider for rows cashing, and got
> extremely JAVA heap grows. But i think that this cache provider
> doesn't use JAVA heap