You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Jonathan Colby <jo...@gmail.com> on 2011/04/05 21:30:36 UTC

extreme memory consumption

I've seen the other posts about memory consumption, but I'm seeing some weird behavior with 0.7.4   with 5 GB heap size   (64 bit system with 8 GB ram total)...

note the virtual mem used 20.6 GB ?!   and Shared 8.4 GB ?!

PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND                                                                                                                                            
 2390 root      20   0     0    0    0 D    1  0.0   0:28.73 flush-104:0                                                                                                                                         
31684 cassandr  20   0 20.6g 3.5g 8496 S    1 45.4   4:08.91 java                                                                                                                                                
   17 root      20   0     0    0    0 S    0  0.0   0:38.03 events/2 


What could be going on here?


config ....

initial_token: 
auto_bootstrap: true
hinted_handoff_enabled: true
max_hint_window_in_ms: 3600000 # one hour
hinted_handoff_throttle_delay_in_ms: 50
authenticator: org.apache.cassandra.auth.AllowAllAuthenticator
authority: org.apache.cassandra.auth.AllowAllAuthority
partitioner: org.apache.cassandra.dht.RandomPartitioner
data_file_directories:
    - /var/lib/cassandra/data
commitlog_directory: /var/lib/cassandra/commitlog
saved_caches_directory: /var/lib/cassandra/saved_caches
commitlog_rotation_threshold_in_mb: 128
commitlog_sync: periodic
commitlog_sync_period_in_ms: 10000
flush_largest_memtables_at: 0.75
reduce_cache_sizes_at: 0.85
reduce_cache_capacity_to: 0.6
disk_access_mode: auto
concurrent_reads: 16
concurrent_writes: 32
sliced_buffer_size_in_kb: 64
storage_port: 7000

rpc_port: 9160
rpc_keepalive: true
thrift_framed_transport_size_in_mb: 15
thrift_max_message_length_in_mb: 16
snapshot_before_compaction: false
binary_memtable_throughput_in_mb: 256
column_index_size_in_kb: 64
in_memory_compaction_limit_in_mb: 64
rpc_timeout_in_ms: 10000
endpoint_snitch: org.apache.cassandra.locator.RackInferringSnitch
dynamic_snitch: true
dynamic_snitch_update_interval_in_ms: 100 
dynamic_snitch_reset_interval_in_ms: 600000
dynamic_snitch_badness_threshold: 0.0
request_scheduler: org.apache.cassandra.scheduler.NoScheduler
index_interval: 128
keyspaces:
    - name: DFS
      replica_placement_strategy: org.apache.cassandra.locator.OldNetworkTopologyStrategy
      replication_factor: 3
      column_families:
        - name: main
          compare_with: BytesType
          keys_cached: 200000
          rows_cached: 200
          row_cache_save_period_in_seconds: 0
          key_cache_save_period_in_seconds: 3600

Re: extreme memory consumption

Posted by Peter Schuller <pe...@infidyne.com>.
> note the virtual mem used 20.6 GB ?!   and Shared 8.4 GB ?!

http://wiki.apache.org/cassandra/FAQ#mmap

-- 
/ Peter Schuller