You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Dathan Pattishall <da...@gmail.com> on 2010/09/07 19:38:41 UTC
Capping the memory limit in cassandra
For this java process
/opt/java/bin/java -ea -Xms1G -*Xmx7G *-XX:+UseParNewGC
-XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:SurvivorRatio=8
-XX:MaxTenuringThreshold=1 -XX:+HeapDumpOnOutOfMemoryError
-Dcom.sun.management.jmxremote.port=8181
-Dcom.sun.management.jmxremote.ssl=false
-Dcom.sun.management.jmxremote.authenticate=false
-Dstorage-config=/opt/cassandra/bin/../conf -cp
/opt/cassandra/bin/../conf:/opt/cassandra/bin/../build/classes:/opt/cassandra/bin/../lib/antlr-3.1.3.jar:/opt/cassandra/bin/../lib/apache-cassandra-0.6.4.jar:/opt/cassandra/bin/../lib/clhm-production.jar:/opt/cassandra/bin/../lib/commons-cli-1.1.jar:/opt/cassandra/bin/../lib/commons-codec-1.2.jar:/opt/cassandra/bin/../lib/commons-collections-3.2.1.jar:/opt/cassandra/bin/../lib/commons-lang-2.4.jar:/opt/cassandra/bin/../lib/google-collections-1.0.jar:/opt/cassandra/bin/../lib/hadoop-core-0.20.1.jar:/opt/cassandra/bin/../lib/high-scale-lib.jar:/opt/cassandra/bin/../lib/ivy-2.1.0.jar:/opt/cassandra/bin/../lib/jackson-core-asl-1.4.0.jar:/opt/cassandra/bin/../lib/jackson-mapper-asl-1.4.0.jar:/opt/cassandra/bin/../lib/jline-0.9.94.jar:/opt/cassandra/bin/../lib/json-simple-1.1.jar:/opt/cassandra/bin/../lib/libthrift-r917130.jar:/opt/cassandra/bin/../lib/log4j-1.2.14.jar:/opt/cassandra/bin/../lib/slf4j-api-1.5.8.jar:/opt/cassandra/bin/../lib/slf4j-log4j12-1.5.8.jar
org.apache.cassandra.thrift.CassandraDaemon
I set the max memory size to 7G yet Cassandra is taking
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
6992 root 18 0 32.8g 29g 21g S 19 93.9 5685:14
/opt/java/bin/java -ea -Xms1G* -Xmx7G *-XX:+UseParNewGC
-XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:SurvivorRatio=8
-XX:M
why is that, and how do I cap the memory used for cassandra? Is this a bug
or a mistake on my part?
Re: Capping the memory limit in cassandra
Posted by Colin Vipurs <zo...@gmail.com>.
Are you using mmapped i/o? If so you'll be running into
https://issues.apache.org/jira/browse/CASSANDRA-1214
On Tue, Sep 7, 2010 at 6:38 PM, Dathan Pattishall <da...@gmail.com> wrote:
> For this java process
>
> /opt/java/bin/java -ea -Xms1G -Xmx7G -XX:+UseParNewGC
> -XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:SurvivorRatio=8
> -XX:MaxTenuringThreshold=1 -XX:+HeapDumpOnOutOfMemoryError
> -Dcom.sun.management.jmxremote.port=8181
> -Dcom.sun.management.jmxremote.ssl=false
> -Dcom.sun.management.jmxremote.authenticate=false
> -Dstorage-config=/opt/cassandra/bin/../conf -cp
> /opt/cassandra/bin/../conf:/opt/cassandra/bin/../build/classes:/opt/cassandra/bin/../lib/antlr-3.1.3.jar:/opt/cassandra/bin/../lib/apache-cassandra-0.6.4.jar:/opt/cassandra/bin/../lib/clhm-production.jar:/opt/cassandra/bin/../lib/commons-cli-1.1.jar:/opt/cassandra/bin/../lib/commons-codec-1.2.jar:/opt/cassandra/bin/../lib/commons-collections-3.2.1.jar:/opt/cassandra/bin/../lib/commons-lang-2.4.jar:/opt/cassandra/bin/../lib/google-collections-1.0.jar:/opt/cassandra/bin/../lib/hadoop-core-0.20.1.jar:/opt/cassandra/bin/../lib/high-scale-lib.jar:/opt/cassandra/bin/../lib/ivy-2.1.0.jar:/opt/cassandra/bin/../lib/jackson-core-asl-1.4.0.jar:/opt/cassandra/bin/../lib/jackson-mapper-asl-1.4.0.jar:/opt/cassandra/bin/../lib/jline-0.9.94.jar:/opt/cassandra/bin/../lib/json-simple-1.1.jar:/opt/cassandra/bin/../lib/libthrift-r917130.jar:/opt/cassandra/bin/../lib/log4j-1.2.14.jar:/opt/cassandra/bin/../lib/slf4j-api-1.5.8.jar:/opt/cassandra/bin/../lib/slf4j-log4j12-1.5.8.jar
> org.apache.cassandra.thrift.CassandraDaemon
>
> I set the max memory size to 7G yet Cassandra is taking
>
>
> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
>
>
>
> 6992 root 18 0 32.8g 29g 21g S 19 93.9 5685:14
> /opt/java/bin/java -ea -Xms1G -Xmx7G -XX:+UseParNewGC
> -XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:SurvivorRatio=8
> -XX:M
>
> why is that, and how do I cap the memory used for cassandra? Is this a bug
> or a mistake on my part?
>
>
--
Maybe she awoke to see the roommate's boyfriend swinging from the
chandelier wearing a boar's head.
Something which you, I, and everyone else would call "Tuesday", of course.
Re: Capping the memory limit in cassandra
Posted by vineet daniel <vi...@gmail.com>.
Hi
When is this happening I mean is Cassandra idle or application is
inserting/reading values from it .....are you running any map/reduce job at
that time.
Regards
Vineet Daniel
Cell : +918106217121
Websites :
Blog <http://vinetedaniel.blogspot.com> |
Linkedin<http://in.linkedin.com/in/vineetdaniel>
| Twitter <https://twitter.com/vineetdaniel>
On Tue, Sep 7, 2010 at 11:08 PM, Dathan Pattishall <da...@gmail.com>wrote:
> For this java process
>
> /opt/java/bin/java -ea -Xms1G -*Xmx7G *-XX:+UseParNewGC
> -XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:SurvivorRatio=8
> -XX:MaxTenuringThreshold=1 -XX:+HeapDumpOnOutOfMemoryError
> -Dcom.sun.management.jmxremote.port=8181
> -Dcom.sun.management.jmxremote.ssl=false
> -Dcom.sun.management.jmxremote.authenticate=false
> -Dstorage-config=/opt/cassandra/bin/../conf -cp
> /opt/cassandra/bin/../conf:/opt/cassandra/bin/../build/classes:/opt/cassandra/bin/../lib/antlr-3.1.3.jar:/opt/cassandra/bin/../lib/apache-cassandra-0.6.4.jar:/opt/cassandra/bin/../lib/clhm-production.jar:/opt/cassandra/bin/../lib/commons-cli-1.1.jar:/opt/cassandra/bin/../lib/commons-codec-1.2.jar:/opt/cassandra/bin/../lib/commons-collections-3.2.1.jar:/opt/cassandra/bin/../lib/commons-lang-2.4.jar:/opt/cassandra/bin/../lib/google-collections-1.0.jar:/opt/cassandra/bin/../lib/hadoop-core-0.20.1.jar:/opt/cassandra/bin/../lib/high-scale-lib.jar:/opt/cassandra/bin/../lib/ivy-2.1.0.jar:/opt/cassandra/bin/../lib/jackson-core-asl-1.4.0.jar:/opt/cassandra/bin/../lib/jackson-mapper-asl-1.4.0.jar:/opt/cassandra/bin/../lib/jline-0.9.94.jar:/opt/cassandra/bin/../lib/json-simple-1.1.jar:/opt/cassandra/bin/../lib/libthrift-r917130.jar:/opt/cassandra/bin/../lib/log4j-1.2.14.jar:/opt/cassandra/bin/../lib/slf4j-api-1.5.8.jar:/opt/cassandra/bin/../lib/slf4j-log4j12-1.5.8.jar
> org.apache.cassandra.thrift.CassandraDaemon
>
> I set the max memory size to 7G yet Cassandra is taking
>
>
> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
>
>
>
> 6992 root 18 0 32.8g 29g 21g S 19 93.9 5685:14
> /opt/java/bin/java -ea -Xms1G* -Xmx7G *-XX:+UseParNewGC
> -XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:SurvivorRatio=8
> -XX:M
>
> why is that, and how do I cap the memory used for cassandra? Is this a bug
> or a mistake on my part?
>
>
Re: Capping the memory limit in cassandra
Posted by Dathan Pattishall <da...@gmail.com>.
Ah thanks Johnathan. I am using mmap, which is outside the control of the
JVM from the looks of it.
On Tue, Sep 7, 2010 at 11:15 AM, Jonathan Ellis <jb...@gmail.com> wrote:
> see http://www.mail-archive.com/user@cassandra.apache.org/msg03583.html
>
> On Tue, Sep 7, 2010 at 12:38 PM, Dathan Pattishall <da...@gmail.com>
> wrote:
> > For this java process
> >
> > /opt/java/bin/java -ea -Xms1G -Xmx7G -XX:+UseParNewGC
> > -XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:SurvivorRatio=8
> > -XX:MaxTenuringThreshold=1 -XX:+HeapDumpOnOutOfMemoryError
> > -Dcom.sun.management.jmxremote.port=8181
> > -Dcom.sun.management.jmxremote.ssl=false
> > -Dcom.sun.management.jmxremote.authenticate=false
> > -Dstorage-config=/opt/cassandra/bin/../conf -cp
> >
> /opt/cassandra/bin/../conf:/opt/cassandra/bin/../build/classes:/opt/cassandra/bin/../lib/antlr-3.1.3.jar:/opt/cassandra/bin/../lib/apache-cassandra-0.6.4.jar:/opt/cassandra/bin/../lib/clhm-production.jar:/opt/cassandra/bin/../lib/commons-cli-1.1.jar:/opt/cassandra/bin/../lib/commons-codec-1.2.jar:/opt/cassandra/bin/../lib/commons-collections-3.2.1.jar:/opt/cassandra/bin/../lib/commons-lang-2.4.jar:/opt/cassandra/bin/../lib/google-collections-1.0.jar:/opt/cassandra/bin/../lib/hadoop-core-0.20.1.jar:/opt/cassandra/bin/../lib/high-scale-lib.jar:/opt/cassandra/bin/../lib/ivy-2.1.0.jar:/opt/cassandra/bin/../lib/jackson-core-asl-1.4.0.jar:/opt/cassandra/bin/../lib/jackson-mapper-asl-1.4.0.jar:/opt/cassandra/bin/../lib/jline-0.9.94.jar:/opt/cassandra/bin/../lib/json-simple-1.1.jar:/opt/cassandra/bin/../lib/libthrift-r917130.jar:/opt/cassandra/bin/../lib/log4j-1.2.14.jar:/opt/cassandra/bin/../lib/slf4j-api-1.5.8.jar:/opt/cassandra/bin/../lib/slf4j-log4j12-1.5.8.jar
> > org.apache.cassandra.thrift.CassandraDaemon
> >
> > I set the max memory size to 7G yet Cassandra is taking
> >
> >
> > PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
> >
> >
> >
> > 6992 root 18 0 32.8g 29g 21g S 19 93.9 5685:14
> > /opt/java/bin/java -ea -Xms1G -Xmx7G -XX:+UseParNewGC
> > -XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:SurvivorRatio=8
> > -XX:M
> >
> > why is that, and how do I cap the memory used for cassandra? Is this a
> bug
> > or a mistake on my part?
> >
> >
>
>
>
> --
> Jonathan Ellis
> Project Chair, Apache Cassandra
> co-founder of Riptano, the source for professional Cassandra support
> http://riptano.com
>
Re: Capping the memory limit in cassandra
Posted by Jonathan Ellis <jb...@gmail.com>.
see http://www.mail-archive.com/user@cassandra.apache.org/msg03583.html
On Tue, Sep 7, 2010 at 12:38 PM, Dathan Pattishall <da...@gmail.com> wrote:
> For this java process
>
> /opt/java/bin/java -ea -Xms1G -Xmx7G -XX:+UseParNewGC
> -XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:SurvivorRatio=8
> -XX:MaxTenuringThreshold=1 -XX:+HeapDumpOnOutOfMemoryError
> -Dcom.sun.management.jmxremote.port=8181
> -Dcom.sun.management.jmxremote.ssl=false
> -Dcom.sun.management.jmxremote.authenticate=false
> -Dstorage-config=/opt/cassandra/bin/../conf -cp
> /opt/cassandra/bin/../conf:/opt/cassandra/bin/../build/classes:/opt/cassandra/bin/../lib/antlr-3.1.3.jar:/opt/cassandra/bin/../lib/apache-cassandra-0.6.4.jar:/opt/cassandra/bin/../lib/clhm-production.jar:/opt/cassandra/bin/../lib/commons-cli-1.1.jar:/opt/cassandra/bin/../lib/commons-codec-1.2.jar:/opt/cassandra/bin/../lib/commons-collections-3.2.1.jar:/opt/cassandra/bin/../lib/commons-lang-2.4.jar:/opt/cassandra/bin/../lib/google-collections-1.0.jar:/opt/cassandra/bin/../lib/hadoop-core-0.20.1.jar:/opt/cassandra/bin/../lib/high-scale-lib.jar:/opt/cassandra/bin/../lib/ivy-2.1.0.jar:/opt/cassandra/bin/../lib/jackson-core-asl-1.4.0.jar:/opt/cassandra/bin/../lib/jackson-mapper-asl-1.4.0.jar:/opt/cassandra/bin/../lib/jline-0.9.94.jar:/opt/cassandra/bin/../lib/json-simple-1.1.jar:/opt/cassandra/bin/../lib/libthrift-r917130.jar:/opt/cassandra/bin/../lib/log4j-1.2.14.jar:/opt/cassandra/bin/../lib/slf4j-api-1.5.8.jar:/opt/cassandra/bin/../lib/slf4j-log4j12-1.5.8.jar
> org.apache.cassandra.thrift.CassandraDaemon
>
> I set the max memory size to 7G yet Cassandra is taking
>
>
> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
>
>
>
> 6992 root 18 0 32.8g 29g 21g S 19 93.9 5685:14
> /opt/java/bin/java -ea -Xms1G -Xmx7G -XX:+UseParNewGC
> -XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:SurvivorRatio=8
> -XX:M
>
> why is that, and how do I cap the memory used for cassandra? Is this a bug
> or a mistake on my part?
>
>
--
Jonathan Ellis
Project Chair, Apache Cassandra
co-founder of Riptano, the source for professional Cassandra support
http://riptano.com