You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Joaquin Casares (Created) (JIRA)" <ji...@apache.org> on 2012/03/29 21:36:22 UTC
[jira] [Created] (CASSANDRA-4104) Cassandra appears to hang when
JNA enabled and heapsize > free memory
Cassandra appears to hang when JNA enabled and heapsize > free memory
---------------------------------------------------------------------
Key: CASSANDRA-4104
URL: https://issues.apache.org/jira/browse/CASSANDRA-4104
Project: Cassandra
Issue Type: Bug
Affects Versions: 1.0.8
Reporter: Joaquin Casares
Priority: Minor
When JNA is enabled heapsize is larger than free memory, all that is printed out is the classpath, then the printouts stop.
If you hit enter again, you get the commandline, but no Cassandra process is running.
Tested on both OpenJDK and Oracle Java.
{noformat}
datastax@datastax-image:~/repos/cassandra$ free -m
total used free shared buffers cached
Mem: 2008 740 1267 0 3 54
-/+ buffers/cache: 682 1326
Swap: 0 0 0
datastax@datastax-image:~/repos/cassandra$ sudo bin/cassandra
datastax@datastax-image:~/repos/cassandra$ INFO 14:31:32,520 Logging initialized
INFO 14:31:32,533 JVM vendor/version: Java HotSpot(TM) 64-Bit Server VM/1.6.0_31
INFO 14:31:32,534 Heap size: 1247805440/1247805440
INFO 14:31:32,534 Classpath: bin/../conf:bin/../build/classes/main:bin/../build/classes/thrift:bin/../lib/antlr-3.2.jar:bin/../lib/avro-1.4.0-fixes.jar:bin/../lib/avro-1.4.0-sources-fixes.jar:bin/../lib/commons-cli-1.1.jar:bin/../lib/commons-codec-1.2.jar:bin/../lib/commons-lang-2.4.jar:bin/../lib/compress-lzf-0.8.4.jar:bin/../lib/concurrentlinkedhashmap-lru-1.2.jar:bin/../lib/guava-r08.jar:bin/../lib/high-scale-lib-1.1.2.jar:bin/../lib/jackson-core-asl-1.4.0.jar:bin/../lib/jackson-mapper-asl-1.4.0.jar:bin/../lib/jamm-0.2.5.jar:bin/../lib/jline-0.9.94.jar:bin/../lib/jna.jar:bin/../lib/json-simple-1.1.jar:bin/../lib/libthrift-0.6.jar:bin/../lib/log4j-1.2.16.jar:bin/../lib/servlet-api-2.5-20081211.jar:bin/../lib/slf4j-api-1.6.1.jar:bin/../lib/slf4j-log4j12-1.6.1.jar:bin/../lib/snakeyaml-1.6.jar:bin/../lib/snappy-java-1.0.4.1.jar:bin/../lib/jamm-0.2.5.jar
datastax@datastax-image:~/repos/cassandra$ ps auwx | grep cass
datastax 18374 1.0 0.0 13448 904 pts/2 S+ 14:32 0:00 grep --color=auto cass
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-4104) Cassandra appears to hang when
JNA enabled and heapsize > free memory
Posted by "Martin Mokry (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-4104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13454103#comment-13454103 ]
Martin Mokry commented on CASSANDRA-4104:
-----------------------------------------
the memory doesn't even fill up. It looks like it just assesses that there is not enough memory to starts so it just hangs there but doesnt print any message about it http://pastebin.com/A1pDMWYk . Now I have turned on set -x in cassandra-env.sh and got some extra messages out of it http://pastebin.com/S1HxJNLs but still hangs at the end with no apparent system activity.
> Cassandra appears to hang when JNA enabled and heapsize > free memory
> ---------------------------------------------------------------------
>
> Key: CASSANDRA-4104
> URL: https://issues.apache.org/jira/browse/CASSANDRA-4104
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 1.0.8
> Reporter: Joaquin Casares
> Priority: Minor
> Labels: datastax_qa
>
> When JNA is enabled heapsize is larger than free memory, all that is printed out is the classpath, then the printouts stop.
> If you hit enter again, you get the commandline, but no Cassandra process is running.
> Tested on both OpenJDK and Oracle Java.
> {noformat}
> datastax@datastax-image:~/repos/cassandra$ free -m
> total used free shared buffers cached
> Mem: 2008 740 1267 0 3 54
> -/+ buffers/cache: 682 1326
> Swap: 0 0 0
> datastax@datastax-image:~/repos/cassandra$ sudo bin/cassandra
> datastax@datastax-image:~/repos/cassandra$ INFO 14:31:32,520 Logging initialized
> INFO 14:31:32,533 JVM vendor/version: Java HotSpot(TM) 64-Bit Server VM/1.6.0_31
> INFO 14:31:32,534 Heap size: 1247805440/1247805440
> INFO 14:31:32,534 Classpath: bin/../conf:bin/../build/classes/main:bin/../build/classes/thrift:bin/../lib/antlr-3.2.jar:bin/../lib/avro-1.4.0-fixes.jar:bin/../lib/avro-1.4.0-sources-fixes.jar:bin/../lib/commons-cli-1.1.jar:bin/../lib/commons-codec-1.2.jar:bin/../lib/commons-lang-2.4.jar:bin/../lib/compress-lzf-0.8.4.jar:bin/../lib/concurrentlinkedhashmap-lru-1.2.jar:bin/../lib/guava-r08.jar:bin/../lib/high-scale-lib-1.1.2.jar:bin/../lib/jackson-core-asl-1.4.0.jar:bin/../lib/jackson-mapper-asl-1.4.0.jar:bin/../lib/jamm-0.2.5.jar:bin/../lib/jline-0.9.94.jar:bin/../lib/jna.jar:bin/../lib/json-simple-1.1.jar:bin/../lib/libthrift-0.6.jar:bin/../lib/log4j-1.2.16.jar:bin/../lib/servlet-api-2.5-20081211.jar:bin/../lib/slf4j-api-1.6.1.jar:bin/../lib/slf4j-log4j12-1.6.1.jar:bin/../lib/snakeyaml-1.6.jar:bin/../lib/snappy-java-1.0.4.1.jar:bin/../lib/jamm-0.2.5.jar
> datastax@datastax-image:~/repos/cassandra$ ps auwx | grep cass
> datastax 18374 1.0 0.0 13448 904 pts/2 S+ 14:32 0:00 grep --color=auto cass
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-4104) Cassandra appears to hang when
JNA enabled and heapsize > free memory
Posted by "Brandon Williams (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-4104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13454129#comment-13454129 ]
Brandon Williams commented on CASSANDRA-4104:
---------------------------------------------
According to the set -x log, JNA isn't enabled.
> Cassandra appears to hang when JNA enabled and heapsize > free memory
> ---------------------------------------------------------------------
>
> Key: CASSANDRA-4104
> URL: https://issues.apache.org/jira/browse/CASSANDRA-4104
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 1.0.8
> Reporter: Joaquin Casares
> Priority: Minor
> Labels: datastax_qa
>
> When JNA is enabled heapsize is larger than free memory, all that is printed out is the classpath, then the printouts stop.
> If you hit enter again, you get the commandline, but no Cassandra process is running.
> Tested on both OpenJDK and Oracle Java.
> {noformat}
> datastax@datastax-image:~/repos/cassandra$ free -m
> total used free shared buffers cached
> Mem: 2008 740 1267 0 3 54
> -/+ buffers/cache: 682 1326
> Swap: 0 0 0
> datastax@datastax-image:~/repos/cassandra$ sudo bin/cassandra
> datastax@datastax-image:~/repos/cassandra$ INFO 14:31:32,520 Logging initialized
> INFO 14:31:32,533 JVM vendor/version: Java HotSpot(TM) 64-Bit Server VM/1.6.0_31
> INFO 14:31:32,534 Heap size: 1247805440/1247805440
> INFO 14:31:32,534 Classpath: bin/../conf:bin/../build/classes/main:bin/../build/classes/thrift:bin/../lib/antlr-3.2.jar:bin/../lib/avro-1.4.0-fixes.jar:bin/../lib/avro-1.4.0-sources-fixes.jar:bin/../lib/commons-cli-1.1.jar:bin/../lib/commons-codec-1.2.jar:bin/../lib/commons-lang-2.4.jar:bin/../lib/compress-lzf-0.8.4.jar:bin/../lib/concurrentlinkedhashmap-lru-1.2.jar:bin/../lib/guava-r08.jar:bin/../lib/high-scale-lib-1.1.2.jar:bin/../lib/jackson-core-asl-1.4.0.jar:bin/../lib/jackson-mapper-asl-1.4.0.jar:bin/../lib/jamm-0.2.5.jar:bin/../lib/jline-0.9.94.jar:bin/../lib/jna.jar:bin/../lib/json-simple-1.1.jar:bin/../lib/libthrift-0.6.jar:bin/../lib/log4j-1.2.16.jar:bin/../lib/servlet-api-2.5-20081211.jar:bin/../lib/slf4j-api-1.6.1.jar:bin/../lib/slf4j-log4j12-1.6.1.jar:bin/../lib/snakeyaml-1.6.jar:bin/../lib/snappy-java-1.0.4.1.jar:bin/../lib/jamm-0.2.5.jar
> datastax@datastax-image:~/repos/cassandra$ ps auwx | grep cass
> datastax 18374 1.0 0.0 13448 904 pts/2 S+ 14:32 0:00 grep --color=auto cass
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-4104) Cassandra appears to hang when
JNA enabled and heapsize > free memory
Posted by "Martin Mokry (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-4104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13449975#comment-13449975 ]
Martin Mokry commented on CASSANDRA-4104:
-----------------------------------------
I have noticed if the memory is low enough 128M cheap VPS, nothing even gets printed and no logs are created.
While cassandra-env.sh seems to check validity of configuration (HEAP_NEWSIZE and MAX_HEAP_SIZE), maybe it should check for values that end up being so low the system obviously cannot support cassandra.
> Cassandra appears to hang when JNA enabled and heapsize > free memory
> ---------------------------------------------------------------------
>
> Key: CASSANDRA-4104
> URL: https://issues.apache.org/jira/browse/CASSANDRA-4104
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 1.0.8
> Reporter: Joaquin Casares
> Priority: Minor
> Labels: datastax_qa
>
> When JNA is enabled heapsize is larger than free memory, all that is printed out is the classpath, then the printouts stop.
> If you hit enter again, you get the commandline, but no Cassandra process is running.
> Tested on both OpenJDK and Oracle Java.
> {noformat}
> datastax@datastax-image:~/repos/cassandra$ free -m
> total used free shared buffers cached
> Mem: 2008 740 1267 0 3 54
> -/+ buffers/cache: 682 1326
> Swap: 0 0 0
> datastax@datastax-image:~/repos/cassandra$ sudo bin/cassandra
> datastax@datastax-image:~/repos/cassandra$ INFO 14:31:32,520 Logging initialized
> INFO 14:31:32,533 JVM vendor/version: Java HotSpot(TM) 64-Bit Server VM/1.6.0_31
> INFO 14:31:32,534 Heap size: 1247805440/1247805440
> INFO 14:31:32,534 Classpath: bin/../conf:bin/../build/classes/main:bin/../build/classes/thrift:bin/../lib/antlr-3.2.jar:bin/../lib/avro-1.4.0-fixes.jar:bin/../lib/avro-1.4.0-sources-fixes.jar:bin/../lib/commons-cli-1.1.jar:bin/../lib/commons-codec-1.2.jar:bin/../lib/commons-lang-2.4.jar:bin/../lib/compress-lzf-0.8.4.jar:bin/../lib/concurrentlinkedhashmap-lru-1.2.jar:bin/../lib/guava-r08.jar:bin/../lib/high-scale-lib-1.1.2.jar:bin/../lib/jackson-core-asl-1.4.0.jar:bin/../lib/jackson-mapper-asl-1.4.0.jar:bin/../lib/jamm-0.2.5.jar:bin/../lib/jline-0.9.94.jar:bin/../lib/jna.jar:bin/../lib/json-simple-1.1.jar:bin/../lib/libthrift-0.6.jar:bin/../lib/log4j-1.2.16.jar:bin/../lib/servlet-api-2.5-20081211.jar:bin/../lib/slf4j-api-1.6.1.jar:bin/../lib/slf4j-log4j12-1.6.1.jar:bin/../lib/snakeyaml-1.6.jar:bin/../lib/snappy-java-1.0.4.1.jar:bin/../lib/jamm-0.2.5.jar
> datastax@datastax-image:~/repos/cassandra$ ps auwx | grep cass
> datastax 18374 1.0 0.0 13448 904 pts/2 S+ 14:32 0:00 grep --color=auto cass
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-4104) Cassandra appears to hang when
JNA enabled and heapsize > free memory
Posted by "Brandon Williams (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-4104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13449986#comment-13449986 ]
Brandon Williams commented on CASSANDRA-4104:
---------------------------------------------
bq. nothing even gets printed and no logs are created
Are you running {{bin/cassandra -f}} or just {{bin/cassandra}}?
> Cassandra appears to hang when JNA enabled and heapsize > free memory
> ---------------------------------------------------------------------
>
> Key: CASSANDRA-4104
> URL: https://issues.apache.org/jira/browse/CASSANDRA-4104
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 1.0.8
> Reporter: Joaquin Casares
> Priority: Minor
> Labels: datastax_qa
>
> When JNA is enabled heapsize is larger than free memory, all that is printed out is the classpath, then the printouts stop.
> If you hit enter again, you get the commandline, but no Cassandra process is running.
> Tested on both OpenJDK and Oracle Java.
> {noformat}
> datastax@datastax-image:~/repos/cassandra$ free -m
> total used free shared buffers cached
> Mem: 2008 740 1267 0 3 54
> -/+ buffers/cache: 682 1326
> Swap: 0 0 0
> datastax@datastax-image:~/repos/cassandra$ sudo bin/cassandra
> datastax@datastax-image:~/repos/cassandra$ INFO 14:31:32,520 Logging initialized
> INFO 14:31:32,533 JVM vendor/version: Java HotSpot(TM) 64-Bit Server VM/1.6.0_31
> INFO 14:31:32,534 Heap size: 1247805440/1247805440
> INFO 14:31:32,534 Classpath: bin/../conf:bin/../build/classes/main:bin/../build/classes/thrift:bin/../lib/antlr-3.2.jar:bin/../lib/avro-1.4.0-fixes.jar:bin/../lib/avro-1.4.0-sources-fixes.jar:bin/../lib/commons-cli-1.1.jar:bin/../lib/commons-codec-1.2.jar:bin/../lib/commons-lang-2.4.jar:bin/../lib/compress-lzf-0.8.4.jar:bin/../lib/concurrentlinkedhashmap-lru-1.2.jar:bin/../lib/guava-r08.jar:bin/../lib/high-scale-lib-1.1.2.jar:bin/../lib/jackson-core-asl-1.4.0.jar:bin/../lib/jackson-mapper-asl-1.4.0.jar:bin/../lib/jamm-0.2.5.jar:bin/../lib/jline-0.9.94.jar:bin/../lib/jna.jar:bin/../lib/json-simple-1.1.jar:bin/../lib/libthrift-0.6.jar:bin/../lib/log4j-1.2.16.jar:bin/../lib/servlet-api-2.5-20081211.jar:bin/../lib/slf4j-api-1.6.1.jar:bin/../lib/slf4j-log4j12-1.6.1.jar:bin/../lib/snakeyaml-1.6.jar:bin/../lib/snappy-java-1.0.4.1.jar:bin/../lib/jamm-0.2.5.jar
> datastax@datastax-image:~/repos/cassandra$ ps auwx | grep cass
> datastax 18374 1.0 0.0 13448 904 pts/2 S+ 14:32 0:00 grep --color=auto cass
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-4104) Cassandra appears to hang when
JNA enabled and heapsize > free memory
Posted by "Jonathan Ellis (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-4104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13241558#comment-13241558 ]
Jonathan Ellis commented on CASSANDRA-4104:
-------------------------------------------
Well, that's what you'd expect right? mlockall says "Thou shalt pin the heap in memory and not swap it out."
I suppose it would be better if mlockall errored out with "I can't let you do that, Dave," but fixing that isn't in-scope for us.
> Cassandra appears to hang when JNA enabled and heapsize > free memory
> ---------------------------------------------------------------------
>
> Key: CASSANDRA-4104
> URL: https://issues.apache.org/jira/browse/CASSANDRA-4104
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 1.0.8
> Reporter: Joaquin Casares
> Priority: Minor
> Labels: datastax_qa
>
> When JNA is enabled heapsize is larger than free memory, all that is printed out is the classpath, then the printouts stop.
> If you hit enter again, you get the commandline, but no Cassandra process is running.
> Tested on both OpenJDK and Oracle Java.
> {noformat}
> datastax@datastax-image:~/repos/cassandra$ free -m
> total used free shared buffers cached
> Mem: 2008 740 1267 0 3 54
> -/+ buffers/cache: 682 1326
> Swap: 0 0 0
> datastax@datastax-image:~/repos/cassandra$ sudo bin/cassandra
> datastax@datastax-image:~/repos/cassandra$ INFO 14:31:32,520 Logging initialized
> INFO 14:31:32,533 JVM vendor/version: Java HotSpot(TM) 64-Bit Server VM/1.6.0_31
> INFO 14:31:32,534 Heap size: 1247805440/1247805440
> INFO 14:31:32,534 Classpath: bin/../conf:bin/../build/classes/main:bin/../build/classes/thrift:bin/../lib/antlr-3.2.jar:bin/../lib/avro-1.4.0-fixes.jar:bin/../lib/avro-1.4.0-sources-fixes.jar:bin/../lib/commons-cli-1.1.jar:bin/../lib/commons-codec-1.2.jar:bin/../lib/commons-lang-2.4.jar:bin/../lib/compress-lzf-0.8.4.jar:bin/../lib/concurrentlinkedhashmap-lru-1.2.jar:bin/../lib/guava-r08.jar:bin/../lib/high-scale-lib-1.1.2.jar:bin/../lib/jackson-core-asl-1.4.0.jar:bin/../lib/jackson-mapper-asl-1.4.0.jar:bin/../lib/jamm-0.2.5.jar:bin/../lib/jline-0.9.94.jar:bin/../lib/jna.jar:bin/../lib/json-simple-1.1.jar:bin/../lib/libthrift-0.6.jar:bin/../lib/log4j-1.2.16.jar:bin/../lib/servlet-api-2.5-20081211.jar:bin/../lib/slf4j-api-1.6.1.jar:bin/../lib/slf4j-log4j12-1.6.1.jar:bin/../lib/snakeyaml-1.6.jar:bin/../lib/snappy-java-1.0.4.1.jar:bin/../lib/jamm-0.2.5.jar
> datastax@datastax-image:~/repos/cassandra$ ps auwx | grep cass
> datastax 18374 1.0 0.0 13448 904 pts/2 S+ 14:32 0:00 grep --color=auto cass
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-4104) Cassandra appears to hang when
JNA enabled and heapsize > free memory
Posted by "Martin Mokry (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-4104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13455012#comment-13455012 ]
Martin Mokry commented on CASSANDRA-4104:
-----------------------------------------
It is surprising it got even that far this time. The debian package is installed - libjna-java and the message looks like this is not a fatal error.
> Cassandra appears to hang when JNA enabled and heapsize > free memory
> ---------------------------------------------------------------------
>
> Key: CASSANDRA-4104
> URL: https://issues.apache.org/jira/browse/CASSANDRA-4104
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 1.0.8
> Reporter: Joaquin Casares
> Priority: Minor
> Labels: datastax_qa
>
> When JNA is enabled heapsize is larger than free memory, all that is printed out is the classpath, then the printouts stop.
> If you hit enter again, you get the commandline, but no Cassandra process is running.
> Tested on both OpenJDK and Oracle Java.
> {noformat}
> datastax@datastax-image:~/repos/cassandra$ free -m
> total used free shared buffers cached
> Mem: 2008 740 1267 0 3 54
> -/+ buffers/cache: 682 1326
> Swap: 0 0 0
> datastax@datastax-image:~/repos/cassandra$ sudo bin/cassandra
> datastax@datastax-image:~/repos/cassandra$ INFO 14:31:32,520 Logging initialized
> INFO 14:31:32,533 JVM vendor/version: Java HotSpot(TM) 64-Bit Server VM/1.6.0_31
> INFO 14:31:32,534 Heap size: 1247805440/1247805440
> INFO 14:31:32,534 Classpath: bin/../conf:bin/../build/classes/main:bin/../build/classes/thrift:bin/../lib/antlr-3.2.jar:bin/../lib/avro-1.4.0-fixes.jar:bin/../lib/avro-1.4.0-sources-fixes.jar:bin/../lib/commons-cli-1.1.jar:bin/../lib/commons-codec-1.2.jar:bin/../lib/commons-lang-2.4.jar:bin/../lib/compress-lzf-0.8.4.jar:bin/../lib/concurrentlinkedhashmap-lru-1.2.jar:bin/../lib/guava-r08.jar:bin/../lib/high-scale-lib-1.1.2.jar:bin/../lib/jackson-core-asl-1.4.0.jar:bin/../lib/jackson-mapper-asl-1.4.0.jar:bin/../lib/jamm-0.2.5.jar:bin/../lib/jline-0.9.94.jar:bin/../lib/jna.jar:bin/../lib/json-simple-1.1.jar:bin/../lib/libthrift-0.6.jar:bin/../lib/log4j-1.2.16.jar:bin/../lib/servlet-api-2.5-20081211.jar:bin/../lib/slf4j-api-1.6.1.jar:bin/../lib/slf4j-log4j12-1.6.1.jar:bin/../lib/snakeyaml-1.6.jar:bin/../lib/snappy-java-1.0.4.1.jar:bin/../lib/jamm-0.2.5.jar
> datastax@datastax-image:~/repos/cassandra$ ps auwx | grep cass
> datastax 18374 1.0 0.0 13448 904 pts/2 S+ 14:32 0:00 grep --color=auto cass
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-4104) Cassandra appears to hang when
JNA enabled and heapsize > free memory
Posted by "Joaquin Casares (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-4104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13246931#comment-13246931 ]
Joaquin Casares commented on CASSANDRA-4104:
--------------------------------------------
I did manage to see this with 512MB of RAM and a heap space of 256MB. -f didn't help and output.log wasn't written yet.
I do agree this is out of scope since Cassandra shouldn't be run on such a small system. Hopefully in the future mlockall or Java will error out a bit nicer.
> Cassandra appears to hang when JNA enabled and heapsize > free memory
> ---------------------------------------------------------------------
>
> Key: CASSANDRA-4104
> URL: https://issues.apache.org/jira/browse/CASSANDRA-4104
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 1.0.8
> Reporter: Joaquin Casares
> Priority: Minor
> Labels: datastax_qa
>
> When JNA is enabled heapsize is larger than free memory, all that is printed out is the classpath, then the printouts stop.
> If you hit enter again, you get the commandline, but no Cassandra process is running.
> Tested on both OpenJDK and Oracle Java.
> {noformat}
> datastax@datastax-image:~/repos/cassandra$ free -m
> total used free shared buffers cached
> Mem: 2008 740 1267 0 3 54
> -/+ buffers/cache: 682 1326
> Swap: 0 0 0
> datastax@datastax-image:~/repos/cassandra$ sudo bin/cassandra
> datastax@datastax-image:~/repos/cassandra$ INFO 14:31:32,520 Logging initialized
> INFO 14:31:32,533 JVM vendor/version: Java HotSpot(TM) 64-Bit Server VM/1.6.0_31
> INFO 14:31:32,534 Heap size: 1247805440/1247805440
> INFO 14:31:32,534 Classpath: bin/../conf:bin/../build/classes/main:bin/../build/classes/thrift:bin/../lib/antlr-3.2.jar:bin/../lib/avro-1.4.0-fixes.jar:bin/../lib/avro-1.4.0-sources-fixes.jar:bin/../lib/commons-cli-1.1.jar:bin/../lib/commons-codec-1.2.jar:bin/../lib/commons-lang-2.4.jar:bin/../lib/compress-lzf-0.8.4.jar:bin/../lib/concurrentlinkedhashmap-lru-1.2.jar:bin/../lib/guava-r08.jar:bin/../lib/high-scale-lib-1.1.2.jar:bin/../lib/jackson-core-asl-1.4.0.jar:bin/../lib/jackson-mapper-asl-1.4.0.jar:bin/../lib/jamm-0.2.5.jar:bin/../lib/jline-0.9.94.jar:bin/../lib/jna.jar:bin/../lib/json-simple-1.1.jar:bin/../lib/libthrift-0.6.jar:bin/../lib/log4j-1.2.16.jar:bin/../lib/servlet-api-2.5-20081211.jar:bin/../lib/slf4j-api-1.6.1.jar:bin/../lib/slf4j-log4j12-1.6.1.jar:bin/../lib/snakeyaml-1.6.jar:bin/../lib/snappy-java-1.0.4.1.jar:bin/../lib/jamm-0.2.5.jar
> datastax@datastax-image:~/repos/cassandra$ ps auwx | grep cass
> datastax 18374 1.0 0.0 13448 904 pts/2 S+ 14:32 0:00 grep --color=auto cass
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (CASSANDRA-4104) Cassandra appears to hang when
JNA enabled and heapsize > free memory
Posted by "Joaquin Casares (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-4104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Joaquin Casares resolved CASSANDRA-4104.
----------------------------------------
Resolution: Not A Problem
With cassandra -f printing out the error, this is acceptable behavior.
> Cassandra appears to hang when JNA enabled and heapsize > free memory
> ---------------------------------------------------------------------
>
> Key: CASSANDRA-4104
> URL: https://issues.apache.org/jira/browse/CASSANDRA-4104
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 1.0.8
> Reporter: Joaquin Casares
> Priority: Minor
> Labels: datastax_qa
>
> When JNA is enabled heapsize is larger than free memory, all that is printed out is the classpath, then the printouts stop.
> If you hit enter again, you get the commandline, but no Cassandra process is running.
> Tested on both OpenJDK and Oracle Java.
> {noformat}
> datastax@datastax-image:~/repos/cassandra$ free -m
> total used free shared buffers cached
> Mem: 2008 740 1267 0 3 54
> -/+ buffers/cache: 682 1326
> Swap: 0 0 0
> datastax@datastax-image:~/repos/cassandra$ sudo bin/cassandra
> datastax@datastax-image:~/repos/cassandra$ INFO 14:31:32,520 Logging initialized
> INFO 14:31:32,533 JVM vendor/version: Java HotSpot(TM) 64-Bit Server VM/1.6.0_31
> INFO 14:31:32,534 Heap size: 1247805440/1247805440
> INFO 14:31:32,534 Classpath: bin/../conf:bin/../build/classes/main:bin/../build/classes/thrift:bin/../lib/antlr-3.2.jar:bin/../lib/avro-1.4.0-fixes.jar:bin/../lib/avro-1.4.0-sources-fixes.jar:bin/../lib/commons-cli-1.1.jar:bin/../lib/commons-codec-1.2.jar:bin/../lib/commons-lang-2.4.jar:bin/../lib/compress-lzf-0.8.4.jar:bin/../lib/concurrentlinkedhashmap-lru-1.2.jar:bin/../lib/guava-r08.jar:bin/../lib/high-scale-lib-1.1.2.jar:bin/../lib/jackson-core-asl-1.4.0.jar:bin/../lib/jackson-mapper-asl-1.4.0.jar:bin/../lib/jamm-0.2.5.jar:bin/../lib/jline-0.9.94.jar:bin/../lib/jna.jar:bin/../lib/json-simple-1.1.jar:bin/../lib/libthrift-0.6.jar:bin/../lib/log4j-1.2.16.jar:bin/../lib/servlet-api-2.5-20081211.jar:bin/../lib/slf4j-api-1.6.1.jar:bin/../lib/slf4j-log4j12-1.6.1.jar:bin/../lib/snakeyaml-1.6.jar:bin/../lib/snappy-java-1.0.4.1.jar:bin/../lib/jamm-0.2.5.jar
> datastax@datastax-image:~/repos/cassandra$ ps auwx | grep cass
> datastax 18374 1.0 0.0 13448 904 pts/2 S+ 14:32 0:00 grep --color=auto cass
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-4104) Cassandra appears to hang when
JNA enabled and heapsize > free memory
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-4104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13454092#comment-13454092 ]
Jonathan Ellis commented on CASSANDRA-4104:
-------------------------------------------
Did you check for swap activity? I'd expect it to start swapping fiercely when you ask it to do something like that.
> Cassandra appears to hang when JNA enabled and heapsize > free memory
> ---------------------------------------------------------------------
>
> Key: CASSANDRA-4104
> URL: https://issues.apache.org/jira/browse/CASSANDRA-4104
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 1.0.8
> Reporter: Joaquin Casares
> Priority: Minor
> Labels: datastax_qa
>
> When JNA is enabled heapsize is larger than free memory, all that is printed out is the classpath, then the printouts stop.
> If you hit enter again, you get the commandline, but no Cassandra process is running.
> Tested on both OpenJDK and Oracle Java.
> {noformat}
> datastax@datastax-image:~/repos/cassandra$ free -m
> total used free shared buffers cached
> Mem: 2008 740 1267 0 3 54
> -/+ buffers/cache: 682 1326
> Swap: 0 0 0
> datastax@datastax-image:~/repos/cassandra$ sudo bin/cassandra
> datastax@datastax-image:~/repos/cassandra$ INFO 14:31:32,520 Logging initialized
> INFO 14:31:32,533 JVM vendor/version: Java HotSpot(TM) 64-Bit Server VM/1.6.0_31
> INFO 14:31:32,534 Heap size: 1247805440/1247805440
> INFO 14:31:32,534 Classpath: bin/../conf:bin/../build/classes/main:bin/../build/classes/thrift:bin/../lib/antlr-3.2.jar:bin/../lib/avro-1.4.0-fixes.jar:bin/../lib/avro-1.4.0-sources-fixes.jar:bin/../lib/commons-cli-1.1.jar:bin/../lib/commons-codec-1.2.jar:bin/../lib/commons-lang-2.4.jar:bin/../lib/compress-lzf-0.8.4.jar:bin/../lib/concurrentlinkedhashmap-lru-1.2.jar:bin/../lib/guava-r08.jar:bin/../lib/high-scale-lib-1.1.2.jar:bin/../lib/jackson-core-asl-1.4.0.jar:bin/../lib/jackson-mapper-asl-1.4.0.jar:bin/../lib/jamm-0.2.5.jar:bin/../lib/jline-0.9.94.jar:bin/../lib/jna.jar:bin/../lib/json-simple-1.1.jar:bin/../lib/libthrift-0.6.jar:bin/../lib/log4j-1.2.16.jar:bin/../lib/servlet-api-2.5-20081211.jar:bin/../lib/slf4j-api-1.6.1.jar:bin/../lib/slf4j-log4j12-1.6.1.jar:bin/../lib/snakeyaml-1.6.jar:bin/../lib/snappy-java-1.0.4.1.jar:bin/../lib/jamm-0.2.5.jar
> datastax@datastax-image:~/repos/cassandra$ ps auwx | grep cass
> datastax 18374 1.0 0.0 13448 904 pts/2 S+ 14:32 0:00 grep --color=auto cass
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-4104) Cassandra appears to hang when
JNA enabled and heapsize > free memory
Posted by "Brandon Williams (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-4104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13241598#comment-13241598 ]
Brandon Williams commented on CASSANDRA-4104:
---------------------------------------------
Also, it's not hanging nor exiting without telling you what's wrong, you just aren't running it in foreground mode:
{noformat}
# bin/cassandra -f
Error occurred during initialization of VM
Could not reserve enough space for object heap
{noformat}
> Cassandra appears to hang when JNA enabled and heapsize > free memory
> ---------------------------------------------------------------------
>
> Key: CASSANDRA-4104
> URL: https://issues.apache.org/jira/browse/CASSANDRA-4104
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 1.0.8
> Reporter: Joaquin Casares
> Priority: Minor
> Labels: datastax_qa
>
> When JNA is enabled heapsize is larger than free memory, all that is printed out is the classpath, then the printouts stop.
> If you hit enter again, you get the commandline, but no Cassandra process is running.
> Tested on both OpenJDK and Oracle Java.
> {noformat}
> datastax@datastax-image:~/repos/cassandra$ free -m
> total used free shared buffers cached
> Mem: 2008 740 1267 0 3 54
> -/+ buffers/cache: 682 1326
> Swap: 0 0 0
> datastax@datastax-image:~/repos/cassandra$ sudo bin/cassandra
> datastax@datastax-image:~/repos/cassandra$ INFO 14:31:32,520 Logging initialized
> INFO 14:31:32,533 JVM vendor/version: Java HotSpot(TM) 64-Bit Server VM/1.6.0_31
> INFO 14:31:32,534 Heap size: 1247805440/1247805440
> INFO 14:31:32,534 Classpath: bin/../conf:bin/../build/classes/main:bin/../build/classes/thrift:bin/../lib/antlr-3.2.jar:bin/../lib/avro-1.4.0-fixes.jar:bin/../lib/avro-1.4.0-sources-fixes.jar:bin/../lib/commons-cli-1.1.jar:bin/../lib/commons-codec-1.2.jar:bin/../lib/commons-lang-2.4.jar:bin/../lib/compress-lzf-0.8.4.jar:bin/../lib/concurrentlinkedhashmap-lru-1.2.jar:bin/../lib/guava-r08.jar:bin/../lib/high-scale-lib-1.1.2.jar:bin/../lib/jackson-core-asl-1.4.0.jar:bin/../lib/jackson-mapper-asl-1.4.0.jar:bin/../lib/jamm-0.2.5.jar:bin/../lib/jline-0.9.94.jar:bin/../lib/jna.jar:bin/../lib/json-simple-1.1.jar:bin/../lib/libthrift-0.6.jar:bin/../lib/log4j-1.2.16.jar:bin/../lib/servlet-api-2.5-20081211.jar:bin/../lib/slf4j-api-1.6.1.jar:bin/../lib/slf4j-log4j12-1.6.1.jar:bin/../lib/snakeyaml-1.6.jar:bin/../lib/snappy-java-1.0.4.1.jar:bin/../lib/jamm-0.2.5.jar
> datastax@datastax-image:~/repos/cassandra$ ps auwx | grep cass
> datastax 18374 1.0 0.0 13448 904 pts/2 S+ 14:32 0:00 grep --color=auto cass
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-4104) Cassandra appears to hang when
JNA enabled and heapsize > free memory
Posted by "Jonathan Ellis (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-4104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13241821#comment-13241821 ]
Jonathan Ellis commented on CASSANDRA-4104:
-------------------------------------------
Also note that stdout + stderr get logged to /var/log/cassandra/output.log when run normally by the debian packaging. Not sure about the RH packages.
> Cassandra appears to hang when JNA enabled and heapsize > free memory
> ---------------------------------------------------------------------
>
> Key: CASSANDRA-4104
> URL: https://issues.apache.org/jira/browse/CASSANDRA-4104
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 1.0.8
> Reporter: Joaquin Casares
> Priority: Minor
> Labels: datastax_qa
>
> When JNA is enabled heapsize is larger than free memory, all that is printed out is the classpath, then the printouts stop.
> If you hit enter again, you get the commandline, but no Cassandra process is running.
> Tested on both OpenJDK and Oracle Java.
> {noformat}
> datastax@datastax-image:~/repos/cassandra$ free -m
> total used free shared buffers cached
> Mem: 2008 740 1267 0 3 54
> -/+ buffers/cache: 682 1326
> Swap: 0 0 0
> datastax@datastax-image:~/repos/cassandra$ sudo bin/cassandra
> datastax@datastax-image:~/repos/cassandra$ INFO 14:31:32,520 Logging initialized
> INFO 14:31:32,533 JVM vendor/version: Java HotSpot(TM) 64-Bit Server VM/1.6.0_31
> INFO 14:31:32,534 Heap size: 1247805440/1247805440
> INFO 14:31:32,534 Classpath: bin/../conf:bin/../build/classes/main:bin/../build/classes/thrift:bin/../lib/antlr-3.2.jar:bin/../lib/avro-1.4.0-fixes.jar:bin/../lib/avro-1.4.0-sources-fixes.jar:bin/../lib/commons-cli-1.1.jar:bin/../lib/commons-codec-1.2.jar:bin/../lib/commons-lang-2.4.jar:bin/../lib/compress-lzf-0.8.4.jar:bin/../lib/concurrentlinkedhashmap-lru-1.2.jar:bin/../lib/guava-r08.jar:bin/../lib/high-scale-lib-1.1.2.jar:bin/../lib/jackson-core-asl-1.4.0.jar:bin/../lib/jackson-mapper-asl-1.4.0.jar:bin/../lib/jamm-0.2.5.jar:bin/../lib/jline-0.9.94.jar:bin/../lib/jna.jar:bin/../lib/json-simple-1.1.jar:bin/../lib/libthrift-0.6.jar:bin/../lib/log4j-1.2.16.jar:bin/../lib/servlet-api-2.5-20081211.jar:bin/../lib/slf4j-api-1.6.1.jar:bin/../lib/slf4j-log4j12-1.6.1.jar:bin/../lib/snakeyaml-1.6.jar:bin/../lib/snappy-java-1.0.4.1.jar:bin/../lib/jamm-0.2.5.jar
> datastax@datastax-image:~/repos/cassandra$ ps auwx | grep cass
> datastax 18374 1.0 0.0 13448 904 pts/2 S+ 14:32 0:00 grep --color=auto cass
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-4104) Cassandra appears to hang when
JNA enabled and heapsize > free memory
Posted by "Martin Mokry (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-4104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13454061#comment-13454061 ]
Martin Mokry commented on CASSANDRA-4104:
-----------------------------------------
Yes, with the -f (foreground) option. By nothing printed I meant nothing but what seems to be running config option:
cassandra -f
xss = -ea -javaagent:/usr/share/cassandra/lib/jamm-0.2.5.jar -XX:+UseThreadPriorities -XX:ThreadPriorityPolicy=42 -Xms105M -Xmx105M -Xmn92M -XX:+HeapDumpOnOutOfMemoryError -Xss128k
^C^C
after that the process is killable only by -9
> Cassandra appears to hang when JNA enabled and heapsize > free memory
> ---------------------------------------------------------------------
>
> Key: CASSANDRA-4104
> URL: https://issues.apache.org/jira/browse/CASSANDRA-4104
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 1.0.8
> Reporter: Joaquin Casares
> Priority: Minor
> Labels: datastax_qa
>
> When JNA is enabled heapsize is larger than free memory, all that is printed out is the classpath, then the printouts stop.
> If you hit enter again, you get the commandline, but no Cassandra process is running.
> Tested on both OpenJDK and Oracle Java.
> {noformat}
> datastax@datastax-image:~/repos/cassandra$ free -m
> total used free shared buffers cached
> Mem: 2008 740 1267 0 3 54
> -/+ buffers/cache: 682 1326
> Swap: 0 0 0
> datastax@datastax-image:~/repos/cassandra$ sudo bin/cassandra
> datastax@datastax-image:~/repos/cassandra$ INFO 14:31:32,520 Logging initialized
> INFO 14:31:32,533 JVM vendor/version: Java HotSpot(TM) 64-Bit Server VM/1.6.0_31
> INFO 14:31:32,534 Heap size: 1247805440/1247805440
> INFO 14:31:32,534 Classpath: bin/../conf:bin/../build/classes/main:bin/../build/classes/thrift:bin/../lib/antlr-3.2.jar:bin/../lib/avro-1.4.0-fixes.jar:bin/../lib/avro-1.4.0-sources-fixes.jar:bin/../lib/commons-cli-1.1.jar:bin/../lib/commons-codec-1.2.jar:bin/../lib/commons-lang-2.4.jar:bin/../lib/compress-lzf-0.8.4.jar:bin/../lib/concurrentlinkedhashmap-lru-1.2.jar:bin/../lib/guava-r08.jar:bin/../lib/high-scale-lib-1.1.2.jar:bin/../lib/jackson-core-asl-1.4.0.jar:bin/../lib/jackson-mapper-asl-1.4.0.jar:bin/../lib/jamm-0.2.5.jar:bin/../lib/jline-0.9.94.jar:bin/../lib/jna.jar:bin/../lib/json-simple-1.1.jar:bin/../lib/libthrift-0.6.jar:bin/../lib/log4j-1.2.16.jar:bin/../lib/servlet-api-2.5-20081211.jar:bin/../lib/slf4j-api-1.6.1.jar:bin/../lib/slf4j-log4j12-1.6.1.jar:bin/../lib/snakeyaml-1.6.jar:bin/../lib/snappy-java-1.0.4.1.jar:bin/../lib/jamm-0.2.5.jar
> datastax@datastax-image:~/repos/cassandra$ ps auwx | grep cass
> datastax 18374 1.0 0.0 13448 904 pts/2 S+ 14:32 0:00 grep --color=auto cass
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira