You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Vijay (Issue Comment Edited) (JIRA)" <ji...@apache.org> on 2012/03/04 23:26:59 UTC
[jira] [Issue Comment Edited] (CASSANDRA-3997) Make
SerializingCache Memory Pluggable
[ https://issues.apache.org/jira/browse/CASSANDRA-3997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13222039#comment-13222039 ]
Vijay edited comment on CASSANDRA-3997 at 3/4/12 10:26 PM:
-----------------------------------------------------------
Attached is the test classes used for the test.
Results on CentOS:
<nowiki>
[vijay_tcasstest@vijay_tcass-i-a91ee8cd ~]$ /etc/alternatives/jre_1.7.0/bin/java -Djava.library.path=/usr/local/lib/ -cp jna.jar:/apps/nfcassandra_server/lib/*:. com.sun.jna.MallocAllocator 50000 2000000
total used free shared buffers cached
Mem: 71688220 26049380 45638840 0 169116 996172
-/+ buffers/cache: 24884092 46804128
Swap: 0 0 0
**** Starting Test! ****
Total bytes read: 101422934016
Time taken: 25407
total used free shared buffers cached
Mem: 71688220 31981924 39706296 0 169116 996312
-/+ buffers/cache: 30816496 40871724
Swap: 0 0 0
**** ending Test!****
[vijay_tcasstest@vijay_tcass-i-a91ee8cd ~]$ export LD_LIBRARY_PATH=/usr/local/lib/
[vijay_tcasstest@vijay_tcass-i-a91ee8cd ~]$ /etc/alternatives/jre_1.7.0/bin/java -Djava.library.path=/usr/local/lib/ -cp jna.jar:/apps/nfcassandra_server/lib/*:. com.sun.jna.TCMallocAllocator 50000 2000000
total used free shared buffers cached
Mem: 71688220 26054620 45633600 0 169128 996228
-/+ buffers/cache: 24889264 46798956
Swap: 0 0 0
**** Starting Test! ****
Total bytes read: 101304894464
Time taken: 46387
total used free shared buffers cached
Mem: 71688220 28535136 43153084 0 169128 996436
-/+ buffers/cache: 27369572 44318648
Swap: 0 0 0
**** ending Test!****
[vijay_tcasstest@vijay_tcass-i-a91ee8cd ~]$ export LD_LIBRARY_PATH=~/jemalloc-2.2.5/lib/
[vijay_tcasstest@vijay_tcass-i-a91ee8cd ~]$ /etc/alternatives/jre_1.7.0/bin/java -Djava.library.path=~/jemalloc-2.2.5/lib/ -cp jna.jar:/apps/nfcassandra_server/lib/*:. com.sun.jna.JEMallocAllocator 50000 2000000
total used free shared buffers cached
Mem: 71688220 26060604 45627616 0 169128 996300
-/+ buffers/cache: 24895176 46793044
Swap: 0 0 0
**** Starting Test! ****
Total bytes read: 101321734144
Time taken: 29937
total used free shared buffers cached
Mem: 71688220 28472436 43215784 0 169128 996440
-/+ buffers/cache: 27306868 44381352
Swap: 0 0 0
**** ending Test!****
[vijay_tcasstest@vijay_tcass-i-a91ee8cd ~]$
</nowiki>
was (Author: vijay2win@yahoo.com):
Attached is the test classes used for the test.
Results on CentOS:
[vijay_tcasstest@vijay_tcass-i-a91ee8cd ~]$ /etc/alternatives/jre_1.7.0/bin/java -Djava.library.path=/usr/local/lib/ -cp jna.jar:/apps/nfcassandra_server/lib/*:. com.sun.jna.MallocAllocator 50000 2000000
total used free shared buffers cached
Mem: 71688220 26049380 45638840 0 169116 996172
-/+ buffers/cache: 24884092 46804128
Swap: 0 0 0
**** Starting Test! ****
Total bytes read: 101422934016
Time taken: 25407
total used free shared buffers cached
Mem: 71688220 31981924 39706296 0 169116 996312
-/+ buffers/cache: 30816496 40871724
Swap: 0 0 0
**** ending Test!****
[vijay_tcasstest@vijay_tcass-i-a91ee8cd ~]$ export LD_LIBRARY_PATH=/usr/local/lib/
[vijay_tcasstest@vijay_tcass-i-a91ee8cd ~]$ /etc/alternatives/jre_1.7.0/bin/java -Djava.library.path=/usr/local/lib/ -cp jna.jar:/apps/nfcassandra_server/lib/*:. com.sun.jna.TCMallocAllocator 50000 2000000
total used free shared buffers cached
Mem: 71688220 26054620 45633600 0 169128 996228
-/+ buffers/cache: 24889264 46798956
Swap: 0 0 0
**** Starting Test! ****
Total bytes read: 101304894464
Time taken: 46387
total used free shared buffers cached
Mem: 71688220 28535136 43153084 0 169128 996436
-/+ buffers/cache: 27369572 44318648
Swap: 0 0 0
**** ending Test!****
[vijay_tcasstest@vijay_tcass-i-a91ee8cd ~]$ export LD_LIBRARY_PATH=~/jemalloc-2.2.5/lib/
[vijay_tcasstest@vijay_tcass-i-a91ee8cd ~]$ /etc/alternatives/jre_1.7.0/bin/java -Djava.library.path=~/jemalloc-2.2.5/lib/ -cp jna.jar:/apps/nfcassandra_server/lib/*:. com.sun.jna.JEMallocAllocator 50000 2000000
total used free shared buffers cached
Mem: 71688220 26060604 45627616 0 169128 996300
-/+ buffers/cache: 24895176 46793044
Swap: 0 0 0
**** Starting Test! ****
Total bytes read: 101321734144
Time taken: 29937
total used free shared buffers cached
Mem: 71688220 28472436 43215784 0 169128 996440
-/+ buffers/cache: 27306868 44381352
Swap: 0 0 0
**** ending Test!****
[vijay_tcasstest@vijay_tcass-i-a91ee8cd ~]$
> Make SerializingCache Memory Pluggable
> --------------------------------------
>
> Key: CASSANDRA-3997
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3997
> Project: Cassandra
> Issue Type: Improvement
> Components: Core
> Affects Versions: 1.2
> Reporter: Vijay
> Priority: Minor
> Labels: cache
> Fix For: 1.2
>
> Attachments: jna.zip
>
>
> Serializing cache uses native malloc and free by making FM pluggable, users will have a choice of gcc malloc, TCMalloc or JEMalloc as needed.
> Initial tests shows less fragmentation in JEMalloc but the only issue with it is that (both TCMalloc and JEMalloc) are kind of single threaded (at-least they crash in my test otherwise).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira