You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Steve Corona (JIRA)" <ji...@apache.org> on 2011/07/01 15:11:28 UTC
[jira] [Created] (CASSANDRA-2845) Cassandra uses 100% system CPU on
Ubuntu Natty (11.04)
Cassandra uses 100% system CPU on Ubuntu Natty (11.04)
------------------------------------------------------
Key: CASSANDRA-2845
URL: https://issues.apache.org/jira/browse/CASSANDRA-2845
Project: Cassandra
Issue Type: Bug
Components: Core
Affects Versions: 0.8.1, 0.8.0
Environment: Default install of Ubuntu 11.04
Reporter: Steve Corona
Step 1. Boot up a brand new, default Ubuntu 11.04 Server install
Step 2. Install Cassandra from Apache APT Respository (deb http://www.apache.org/dist/cassandra/debian 08x main)
Step 3. apt-get install cassandra, as soon as it cassandra starts it will freeze the machine
What's happening is that as soon as cassandra starts up it immediately sucks up 100% of CPU and starves the machine. This effectively bricks the box until you boot into single user mode and disable the cassandra init.d script.
Under htop, the CPU usage shows up as "system" cpu, not user.
The machine I'm testing this on is a Quad-Core Sandy Bridge w/ 16GB of Memory, so it's not a system resource issue. I've also tested this on completely different hardware (Dual 64-Bit Xeons & AMD X4) and it has the same effect.
Ubuntu 10.10 does not exhibit the same issue. I have only tested 0.8 and 0.8.1.
root@cassandra01:/# java -version
java version "1.6.0_22"
OpenJDK Runtime Environment (IcedTea6 1.10.2) (6b22-1.10.2-0ubuntu1~11.04.1)
OpenJDK 64-Bit Server VM (build 20.0-b11, mixed mode)
root@cassandra:/# uname -a
Linux cassandra01 2.6.38-8-generic #42-Ubuntu SMP Mon Apr 11 03:31:24 UTC 2011 x86_64 x86_64 x86_64 GNU/Linux
/proc/cpu
Intel(R) Xeon(R) CPU E31270 @ 3.40GHz
/proc/meminfo
MemTotal: 16459776 kB
MemFree: 14190708 kB
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-2845) Cassandra uses 100% system CPU
on Ubuntu Natty (11.04)
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13067872#comment-13067872 ]
Jonathan Ellis commented on CASSANDRA-2845:
-------------------------------------------
should we report a bug, mark jna as don't-install-by-default, recommend avoiding natty, and move on?
> Cassandra uses 100% system CPU on Ubuntu Natty (11.04)
> ------------------------------------------------------
>
> Key: CASSANDRA-2845
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2845
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 0.8.0
> Environment: Default install of Ubuntu 11.04
> Reporter: Steve Corona
> Assignee: paul cannon
> Priority: Critical
> Fix For: 0.8.2
>
>
> Step 1. Boot up a brand new, default Ubuntu 11.04 Server install
> Step 2. Install Cassandra from Apache APT Respository (deb http://www.apache.org/dist/cassandra/debian 08x main)
> Step 3. apt-get install cassandra, as soon as it cassandra starts it will freeze the machine
> What's happening is that as soon as cassandra starts up it immediately sucks up 100% of CPU and starves the machine. This effectively bricks the box until you boot into single user mode and disable the cassandra init.d script.
> Under htop, the CPU usage shows up as "system" cpu, not user.
> The machine I'm testing this on is a Quad-Core Sandy Bridge w/ 16GB of Memory, so it's not a system resource issue. I've also tested this on completely different hardware (Dual 64-Bit Xeons & AMD X4) and it has the same effect.
> Ubuntu 10.10 does not exhibit the same issue. I have only tested 0.8 and 0.8.1.
> root@cassandra01:/# java -version
> java version "1.6.0_22"
> OpenJDK Runtime Environment (IcedTea6 1.10.2) (6b22-1.10.2-0ubuntu1~11.04.1)
> OpenJDK 64-Bit Server VM (build 20.0-b11, mixed mode)
> root@cassandra:/# uname -a
> Linux cassandra01 2.6.38-8-generic #42-Ubuntu SMP Mon Apr 11 03:31:24 UTC 2011 x86_64 x86_64 x86_64 GNU/Linux
> /proc/cpu
> Intel(R) Xeon(R) CPU E31270 @ 3.40GHz
> /proc/meminfo
> MemTotal: 16459776 kB
> MemFree: 14190708 kB
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Issue Comment Edited] (CASSANDRA-2845) Cassandra uses 100%
system CPU on Ubuntu Natty (11.04)
Posted by "tyler cheung (Issue Comment Edited) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13220627#comment-13220627 ]
tyler cheung edited comment on CASSANDRA-2845 at 3/2/12 2:47 AM:
-----------------------------------------------------------------
OK - so what happened was I manually put in libjna 3.4.0 files (copied the tarball and redid the symlinks). The /etc/init.d script didn't work but the sudo /usr/sbin/cassandra did, and things seem to work a lot better.
They just moved my office and I have a new core i5 w/ 4 gb RAM. I just redid the cassandra install w/ vanilla 11.10 (libjna 3.2.7), openjre6, jsvc1.0.6.
There was a brief hiccup but its running. Top shows jsvc running cassandra consuming 35% memory as follows:
{{Cpu(s): 0.2%us, 0.2%sy, 0.0%ni, 99.6%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st}}
{{Mem: 3934168k total, 3805184k used, 128984k free, 175792k buffers}}
{{Swap: 4071420k total, 26532k used, 4044888k free, 1083252k cached}}
{{PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND}}
{{20452 root 20 0 166m 13m 8640 S 1 0.4 1:37.09 Xorg}}
{{21906 tylerc 20 0 453m 16m 10m S 1 0.4 0:02.43 xfce4-terminal}}
{{21337 tylerc 20 0 172m 12m 8704 S 0 0.3 0:10.59 xfwm4}}
{{21433 tylerc 20 0 698m 105m 38m S 0 2.7 2:59.83 chrome}}
{{23067 tylerc 20 0 864m 59m 16m S 0 1.6 0:01.94 chrome}}
{{23735 cassandr 20 0 1518m 1.3g 18m S 0 35.1 0:01.90 jsvc}}
{{...}}
I'm going to try and get the newer libjna again and see if this helps memory usage. Kernel is 3.0.0.12 generic.
was (Author: tcheung):
OK - so what happened was I manually put in libjna 3.4.0 files (copied the tarball and redid the symlinks). The /etc/init.d script didn't work but the sudo /usr/sbin/cassandra did, and things seem to work a lot better.
They just moved my office and I have a new core i5 w/ 4 gb RAM. I just redid the cassandra install w/ vanilla 11.10 (libjna 3.2.7), openjre6, jsvc1.0.6.
There was a brief hiccup but its running. Top shows jsvc running cassandra consuming 35% memory as follows:
{{Cpu(s): 0.2%us, 0.2%sy, 0.0%ni, 99.6%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st}}
{{Mem: 3934168k total, 3805184k used, 128984k free, 175792k buffers}}
{{Swap: 4071420k total, 26532k used, 4044888k free, 1083252k cached}}
{{ PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND}}
{{20452 root 20 0 166m 13m 8640 S 1 0.4 1:37.09 Xorg}}
{{21906 tylerc 20 0 453m 16m 10m S 1 0.4 0:02.43 xfce4-terminal}}
{{21337 tylerc 20 0 172m 12m 8704 S 0 0.3 0:10.59 xfwm4}}
{{21433 tylerc 20 0 698m 105m 38m S 0 2.7 2:59.83 chrome}}
{{23067 tylerc 20 0 864m 59m 16m S 0 1.6 0:01.94 chrome}}
{{23735 cassandr 20 0 1518m 1.3g 18m S 0 35.1 0:01.90 jsvc}}
{{...}}
I'm going to try and get the newer libjna again and see if this helps memory usage. Kernel is 3.0.0.12 generic.
> Cassandra uses 100% system CPU on Ubuntu Natty (11.04)
> ------------------------------------------------------
>
> Key: CASSANDRA-2845
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2845
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 0.8.0
> Environment: Default install of Ubuntu 11.04
> Reporter: Steve Corona
> Assignee: paul cannon
> Priority: Critical
> Fix For: 0.8.2
>
>
> Step 1. Boot up a brand new, default Ubuntu 11.04 Server install
> Step 2. Install Cassandra from Apache APT Respository (deb http://www.apache.org/dist/cassandra/debian 08x main)
> Step 3. apt-get install cassandra, as soon as it cassandra starts it will freeze the machine
> What's happening is that as soon as cassandra starts up it immediately sucks up 100% of CPU and starves the machine. This effectively bricks the box until you boot into single user mode and disable the cassandra init.d script.
> Under htop, the CPU usage shows up as "system" cpu, not user.
> The machine I'm testing this on is a Quad-Core Sandy Bridge w/ 16GB of Memory, so it's not a system resource issue. I've also tested this on completely different hardware (Dual 64-Bit Xeons & AMD X4) and it has the same effect.
> Ubuntu 10.10 does not exhibit the same issue. I have only tested 0.8 and 0.8.1.
> root@cassandra01:/# java -version
> java version "1.6.0_22"
> OpenJDK Runtime Environment (IcedTea6 1.10.2) (6b22-1.10.2-0ubuntu1~11.04.1)
> OpenJDK 64-Bit Server VM (build 20.0-b11, mixed mode)
> root@cassandra:/# uname -a
> Linux cassandra01 2.6.38-8-generic #42-Ubuntu SMP Mon Apr 11 03:31:24 UTC 2011 x86_64 x86_64 x86_64 GNU/Linux
> /proc/cpu
> Intel(R) Xeon(R) CPU E31270 @ 3.40GHz
> /proc/meminfo
> MemTotal: 16459776 kB
> MemFree: 14190708 kB
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Issue Comment Edited] (CASSANDRA-2845) Cassandra uses 100%
system CPU on Ubuntu Natty (11.04)
Posted by "Steve Corona (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13067943#comment-13067943 ]
Steve Corona edited comment on CASSANDRA-2845 at 7/19/11 8:33 PM:
------------------------------------------------------------------
FWIW, I am using real hardware and not an EC2 instance. i.e, the problem is not localized to ec2 only, it's all ubuntu 2.6.38-8 kernels
was (Author: stevecorona):
FWIW, I am using real hardware and not an EC2 instance.
> Cassandra uses 100% system CPU on Ubuntu Natty (11.04)
> ------------------------------------------------------
>
> Key: CASSANDRA-2845
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2845
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 0.8.0
> Environment: Default install of Ubuntu 11.04
> Reporter: Steve Corona
> Assignee: paul cannon
> Priority: Critical
> Fix For: 0.8.2
>
>
> Step 1. Boot up a brand new, default Ubuntu 11.04 Server install
> Step 2. Install Cassandra from Apache APT Respository (deb http://www.apache.org/dist/cassandra/debian 08x main)
> Step 3. apt-get install cassandra, as soon as it cassandra starts it will freeze the machine
> What's happening is that as soon as cassandra starts up it immediately sucks up 100% of CPU and starves the machine. This effectively bricks the box until you boot into single user mode and disable the cassandra init.d script.
> Under htop, the CPU usage shows up as "system" cpu, not user.
> The machine I'm testing this on is a Quad-Core Sandy Bridge w/ 16GB of Memory, so it's not a system resource issue. I've also tested this on completely different hardware (Dual 64-Bit Xeons & AMD X4) and it has the same effect.
> Ubuntu 10.10 does not exhibit the same issue. I have only tested 0.8 and 0.8.1.
> root@cassandra01:/# java -version
> java version "1.6.0_22"
> OpenJDK Runtime Environment (IcedTea6 1.10.2) (6b22-1.10.2-0ubuntu1~11.04.1)
> OpenJDK 64-Bit Server VM (build 20.0-b11, mixed mode)
> root@cassandra:/# uname -a
> Linux cassandra01 2.6.38-8-generic #42-Ubuntu SMP Mon Apr 11 03:31:24 UTC 2011 x86_64 x86_64 x86_64 GNU/Linux
> /proc/cpu
> Intel(R) Xeon(R) CPU E31270 @ 3.40GHz
> /proc/meminfo
> MemTotal: 16459776 kB
> MemFree: 14190708 kB
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Issue Comment Edited] (CASSANDRA-2845) Cassandra uses 100%
system CPU on Ubuntu Natty (11.04)
Posted by "tyler cheung (Issue Comment Edited) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13220631#comment-13220631 ]
tyler cheung edited comment on CASSANDRA-2845 at 3/2/12 2:59 AM:
-----------------------------------------------------------------
hmm... when i start it w/ sudo /usr/sbin/cassandra, instead of the /etc/init.d/cassandra script, the memory usage is fine...
{{Tasks: 156 total, 1 running, 154 sleeping, 0 stopped, 1 zombie}}
{{Cpu(s): 0.3%us, 0.2%sy, 0.0%ni, 99.5%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st}}
{{Mem: 3934168k total, 2511668k used, 1422500k free, 176076k buffers}}
{{Swap: 4071420k total, 25572k used, 4045848k free, 1086980k cached}}
{{PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND}}
{{24815 root 20 0 1527m 69m 9.9m S 1 1.8 0:00.99 java}}
Am I missing something very basic? My limited understanding is that when cassandra is run under a jsvc wrapper things, memory usage seems to go up, at least what top is telling me....
I guess perhaps this is a separate issue (memory usage under jsvc) than the cpu usage issue being reported here...
was (Author: tcheung):
hmm... when i start it w/ sudo /usr/sbin/cassandra, instead of the /etc/init.d/cassandra script, the memory usage is fine...
{{Tasks: 156 total, 1 running, 154 sleeping, 0 stopped, 1 zombie}}
{{Cpu(s): 0.3%us, 0.2%sy, 0.0%ni, 99.5%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st}}
{{Mem: 3934168k total, 2511668k used, 1422500k free, 176076k buffers}}
{{Swap: 4071420k total, 25572k used, 4045848k free, 1086980k cached}}
{{PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND}}
{{24815 root 20 0 1527m 69m 9.9m S 1 1.8 0:00.99 java}}
I am missing something?
> Cassandra uses 100% system CPU on Ubuntu Natty (11.04)
> ------------------------------------------------------
>
> Key: CASSANDRA-2845
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2845
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 0.8.0
> Environment: Default install of Ubuntu 11.04
> Reporter: Steve Corona
> Assignee: paul cannon
> Priority: Critical
> Fix For: 0.8.2
>
>
> Step 1. Boot up a brand new, default Ubuntu 11.04 Server install
> Step 2. Install Cassandra from Apache APT Respository (deb http://www.apache.org/dist/cassandra/debian 08x main)
> Step 3. apt-get install cassandra, as soon as it cassandra starts it will freeze the machine
> What's happening is that as soon as cassandra starts up it immediately sucks up 100% of CPU and starves the machine. This effectively bricks the box until you boot into single user mode and disable the cassandra init.d script.
> Under htop, the CPU usage shows up as "system" cpu, not user.
> The machine I'm testing this on is a Quad-Core Sandy Bridge w/ 16GB of Memory, so it's not a system resource issue. I've also tested this on completely different hardware (Dual 64-Bit Xeons & AMD X4) and it has the same effect.
> Ubuntu 10.10 does not exhibit the same issue. I have only tested 0.8 and 0.8.1.
> root@cassandra01:/# java -version
> java version "1.6.0_22"
> OpenJDK Runtime Environment (IcedTea6 1.10.2) (6b22-1.10.2-0ubuntu1~11.04.1)
> OpenJDK 64-Bit Server VM (build 20.0-b11, mixed mode)
> root@cassandra:/# uname -a
> Linux cassandra01 2.6.38-8-generic #42-Ubuntu SMP Mon Apr 11 03:31:24 UTC 2011 x86_64 x86_64 x86_64 GNU/Linux
> /proc/cpu
> Intel(R) Xeon(R) CPU E31270 @ 3.40GHz
> /proc/meminfo
> MemTotal: 16459776 kB
> MemFree: 14190708 kB
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (CASSANDRA-2845) Cassandra uses 100% system CPU
on Ubuntu Natty (11.04)
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Ellis reassigned CASSANDRA-2845:
-----------------------------------------
Assignee: paul cannon
/baffled
> Cassandra uses 100% system CPU on Ubuntu Natty (11.04)
> ------------------------------------------------------
>
> Key: CASSANDRA-2845
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2845
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 0.8.0, 0.8.1
> Environment: Default install of Ubuntu 11.04
> Reporter: Steve Corona
> Assignee: paul cannon
>
> Step 1. Boot up a brand new, default Ubuntu 11.04 Server install
> Step 2. Install Cassandra from Apache APT Respository (deb http://www.apache.org/dist/cassandra/debian 08x main)
> Step 3. apt-get install cassandra, as soon as it cassandra starts it will freeze the machine
> What's happening is that as soon as cassandra starts up it immediately sucks up 100% of CPU and starves the machine. This effectively bricks the box until you boot into single user mode and disable the cassandra init.d script.
> Under htop, the CPU usage shows up as "system" cpu, not user.
> The machine I'm testing this on is a Quad-Core Sandy Bridge w/ 16GB of Memory, so it's not a system resource issue. I've also tested this on completely different hardware (Dual 64-Bit Xeons & AMD X4) and it has the same effect.
> Ubuntu 10.10 does not exhibit the same issue. I have only tested 0.8 and 0.8.1.
> root@cassandra01:/# java -version
> java version "1.6.0_22"
> OpenJDK Runtime Environment (IcedTea6 1.10.2) (6b22-1.10.2-0ubuntu1~11.04.1)
> OpenJDK 64-Bit Server VM (build 20.0-b11, mixed mode)
> root@cassandra:/# uname -a
> Linux cassandra01 2.6.38-8-generic #42-Ubuntu SMP Mon Apr 11 03:31:24 UTC 2011 x86_64 x86_64 x86_64 GNU/Linux
> /proc/cpu
> Intel(R) Xeon(R) CPU E31270 @ 3.40GHz
> /proc/meminfo
> MemTotal: 16459776 kB
> MemFree: 14190708 kB
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Issue Comment Edited] (CASSANDRA-2845) Cassandra uses 100%
system CPU on Ubuntu Natty (11.04)
Posted by "tyler cheung (Issue Comment Edited) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13220627#comment-13220627 ]
tyler cheung edited comment on CASSANDRA-2845 at 3/2/12 2:44 AM:
-----------------------------------------------------------------
OK - so what happened was I manually put in libjna 3.4.0 files (copied the tarball and redid the symlinks). The /etc/init.d script didn't work but the sudo /usr/sbin/cassandra did, and things seem to work a lot better.
They just moved my office and I have a new core i5 w/ 4 gb RAM. I just redid the cassandra install w/ vanilla 11.10 (libjna 3.2.7), openjre6, jsvc1.0.6.
There was a brief hiccup but its running. Top shows jsvc running cassandra consuming 35% memory as follows:
Cpu(s): 0.2%us, 0.2%sy, 0.0%ni, 99.6%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
Mem: 3934168k total, 3805184k used, 128984k free, 175792k buffers
Swap: 4071420k total, 26532k used, 4044888k free, 1083252k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
20452 root 20 0 166m 13m 8640 S 1 0.4 1:37.09 Xorg
21906 tylerc 20 0 453m 16m 10m S 1 0.4 0:02.43 xfce4-terminal
21337 tylerc 20 0 172m 12m 8704 S 0 0.3 0:10.59 xfwm4
21433 tylerc 20 0 698m 105m 38m S 0 2.7 2:59.83 chrome
23067 tylerc 20 0 864m 59m 16m S 0 1.6 0:01.94 chrome
23735 cassandr 20 0 1518m 1.3g 18m S 0 35.1 0:01.90 jsvc
...
I'm going to try and get the newer libjna again and see if this helps memory usage. Kernel is 3.0.0.12 generic.
was (Author: tcheung):
OK - so what happened was I manually put in libjna 3.4.0 files (copied the tarball and redid the symlinks). The /etc/init.d script didn't work but the sudo /usr/sbin/cassandra did, and things seem to work a lot better.
They just moved my office and I have a new core i5 w/ 4 gb RAM. I just redid the cassandra install w/ vanilla 11.10 (libjna 3.2.7), openjre6, jsvc1.0.6.
There was a brief hiccup but its running. Top shows jsvc running cassandra consuming 35% memory as follows:
{{monospaced}}
Cpu(s): 0.2%us, 0.2%sy, 0.0%ni, 99.6%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
Mem: 3934168k total, 3805184k used, 128984k free, 175792k buffers
Swap: 4071420k total, 26532k used, 4044888k free, 1083252k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
20452 root 20 0 166m 13m 8640 S 1 0.4 1:37.09 Xorg
21906 tylerc 20 0 453m 16m 10m S 1 0.4 0:02.43 xfce4-terminal
21337 tylerc 20 0 172m 12m 8704 S 0 0.3 0:10.59 xfwm4
21433 tylerc 20 0 698m 105m 38m S 0 2.7 2:59.83 chrome
23067 tylerc 20 0 864m 59m 16m S 0 1.6 0:01.94 chrome
23735 cassandr 20 0 1518m 1.3g 18m S 0 35.1 0:01.90 jsvc
...
{{monospaced}}
I'm going to try and get the newer libjna again and see if this helps. Kernel is 3.0.0.12 generic.
> Cassandra uses 100% system CPU on Ubuntu Natty (11.04)
> ------------------------------------------------------
>
> Key: CASSANDRA-2845
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2845
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 0.8.0
> Environment: Default install of Ubuntu 11.04
> Reporter: Steve Corona
> Assignee: paul cannon
> Priority: Critical
> Fix For: 0.8.2
>
>
> Step 1. Boot up a brand new, default Ubuntu 11.04 Server install
> Step 2. Install Cassandra from Apache APT Respository (deb http://www.apache.org/dist/cassandra/debian 08x main)
> Step 3. apt-get install cassandra, as soon as it cassandra starts it will freeze the machine
> What's happening is that as soon as cassandra starts up it immediately sucks up 100% of CPU and starves the machine. This effectively bricks the box until you boot into single user mode and disable the cassandra init.d script.
> Under htop, the CPU usage shows up as "system" cpu, not user.
> The machine I'm testing this on is a Quad-Core Sandy Bridge w/ 16GB of Memory, so it's not a system resource issue. I've also tested this on completely different hardware (Dual 64-Bit Xeons & AMD X4) and it has the same effect.
> Ubuntu 10.10 does not exhibit the same issue. I have only tested 0.8 and 0.8.1.
> root@cassandra01:/# java -version
> java version "1.6.0_22"
> OpenJDK Runtime Environment (IcedTea6 1.10.2) (6b22-1.10.2-0ubuntu1~11.04.1)
> OpenJDK 64-Bit Server VM (build 20.0-b11, mixed mode)
> root@cassandra:/# uname -a
> Linux cassandra01 2.6.38-8-generic #42-Ubuntu SMP Mon Apr 11 03:31:24 UTC 2011 x86_64 x86_64 x86_64 GNU/Linux
> /proc/cpu
> Intel(R) Xeon(R) CPU E31270 @ 3.40GHz
> /proc/meminfo
> MemTotal: 16459776 kB
> MemFree: 14190708 kB
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-2845) Cassandra uses 100% system CPU
on Ubuntu Natty (11.04)
Posted by "paul cannon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13067852#comment-13067852 ]
paul cannon commented on CASSANDRA-2845:
----------------------------------------
Ok, I believe I've reproduced this. I don't get 100% cpu usage, but I do see strange stalls and kernel errors in dmesg about tasks being hung for too long, or in some cases, the machine becomes completely unresponsive. Simple things like "ps aux" hang on reading certain /proc/$pid/cmdline entries, effects like that.
What I've found so far:
* Can reproduce on Ubuntu 11.04 (natty), haven't been able to reproduce on Ubuntu 10.10 (maverick)
* Can reproduce with several different libjna-java/jna.jar builds. Can not reproduce without any JNA available.
* Can not reproduce when CLibrary.tryMlockall() call to mlockall() is commented out.
* Can still reproduce when memlock resource-limit is severely restricted (i.e. set to 1 kb in /etc/security/limits.d/cassandra.conf)
* Can reproduce with a couple different EC2 kernel images. Haven't found a kernel yet that makes it unreproducible.
At this point I'm suspecting some sort of funkiness in the natty glibc. Will be testing more.
Oh, and as an aside- aptitude also doesn't force you to install recommends; just use {{aptitude install --without-recommends}}.
> Cassandra uses 100% system CPU on Ubuntu Natty (11.04)
> ------------------------------------------------------
>
> Key: CASSANDRA-2845
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2845
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 0.8.0
> Environment: Default install of Ubuntu 11.04
> Reporter: Steve Corona
> Assignee: paul cannon
> Priority: Critical
> Fix For: 0.8.2
>
>
> Step 1. Boot up a brand new, default Ubuntu 11.04 Server install
> Step 2. Install Cassandra from Apache APT Respository (deb http://www.apache.org/dist/cassandra/debian 08x main)
> Step 3. apt-get install cassandra, as soon as it cassandra starts it will freeze the machine
> What's happening is that as soon as cassandra starts up it immediately sucks up 100% of CPU and starves the machine. This effectively bricks the box until you boot into single user mode and disable the cassandra init.d script.
> Under htop, the CPU usage shows up as "system" cpu, not user.
> The machine I'm testing this on is a Quad-Core Sandy Bridge w/ 16GB of Memory, so it's not a system resource issue. I've also tested this on completely different hardware (Dual 64-Bit Xeons & AMD X4) and it has the same effect.
> Ubuntu 10.10 does not exhibit the same issue. I have only tested 0.8 and 0.8.1.
> root@cassandra01:/# java -version
> java version "1.6.0_22"
> OpenJDK Runtime Environment (IcedTea6 1.10.2) (6b22-1.10.2-0ubuntu1~11.04.1)
> OpenJDK 64-Bit Server VM (build 20.0-b11, mixed mode)
> root@cassandra:/# uname -a
> Linux cassandra01 2.6.38-8-generic #42-Ubuntu SMP Mon Apr 11 03:31:24 UTC 2011 x86_64 x86_64 x86_64 GNU/Linux
> /proc/cpu
> Intel(R) Xeon(R) CPU E31270 @ 3.40GHz
> /proc/meminfo
> MemTotal: 16459776 kB
> MemFree: 14190708 kB
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-2845) Cassandra uses 100% system CPU
on Ubuntu Natty (11.04)
Posted by "tyler cheung (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13211972#comment-13211972 ]
tyler cheung commented on CASSANDRA-2845:
-----------------------------------------
I'm not sure if things have changed or maybe the machine I'm running this on is old, but its happening for me. Kernel is 3.0.0.16.19, ubuntu 11.10. This is on a late model pentium4 w/ ~1 gb memory. libjna is at 3.2.7 (whatever the ubuntu distro has). I'm trying to figure out how to update that to 3.4.0, but not quite sure how to do that yet.
> Cassandra uses 100% system CPU on Ubuntu Natty (11.04)
> ------------------------------------------------------
>
> Key: CASSANDRA-2845
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2845
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 0.8.0
> Environment: Default install of Ubuntu 11.04
> Reporter: Steve Corona
> Assignee: paul cannon
> Priority: Critical
> Fix For: 0.8.2
>
>
> Step 1. Boot up a brand new, default Ubuntu 11.04 Server install
> Step 2. Install Cassandra from Apache APT Respository (deb http://www.apache.org/dist/cassandra/debian 08x main)
> Step 3. apt-get install cassandra, as soon as it cassandra starts it will freeze the machine
> What's happening is that as soon as cassandra starts up it immediately sucks up 100% of CPU and starves the machine. This effectively bricks the box until you boot into single user mode and disable the cassandra init.d script.
> Under htop, the CPU usage shows up as "system" cpu, not user.
> The machine I'm testing this on is a Quad-Core Sandy Bridge w/ 16GB of Memory, so it's not a system resource issue. I've also tested this on completely different hardware (Dual 64-Bit Xeons & AMD X4) and it has the same effect.
> Ubuntu 10.10 does not exhibit the same issue. I have only tested 0.8 and 0.8.1.
> root@cassandra01:/# java -version
> java version "1.6.0_22"
> OpenJDK Runtime Environment (IcedTea6 1.10.2) (6b22-1.10.2-0ubuntu1~11.04.1)
> OpenJDK 64-Bit Server VM (build 20.0-b11, mixed mode)
> root@cassandra:/# uname -a
> Linux cassandra01 2.6.38-8-generic #42-Ubuntu SMP Mon Apr 11 03:31:24 UTC 2011 x86_64 x86_64 x86_64 GNU/Linux
> /proc/cpu
> Intel(R) Xeon(R) CPU E31270 @ 3.40GHz
> /proc/meminfo
> MemTotal: 16459776 kB
> MemFree: 14190708 kB
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-2845) Cassandra uses 100% system CPU
on Ubuntu Natty (11.04)
Posted by "paul cannon (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13211979#comment-13211979 ]
paul cannon commented on CASSANDRA-2845:
----------------------------------------
tyler- would it be possible to try with a 2.6.38-10 kernel, and/or try by running cassandra directly instead of with the initscript (which uses jsvc)? Also, which JVM are you using?
> Cassandra uses 100% system CPU on Ubuntu Natty (11.04)
> ------------------------------------------------------
>
> Key: CASSANDRA-2845
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2845
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 0.8.0
> Environment: Default install of Ubuntu 11.04
> Reporter: Steve Corona
> Assignee: paul cannon
> Priority: Critical
> Fix For: 0.8.2
>
>
> Step 1. Boot up a brand new, default Ubuntu 11.04 Server install
> Step 2. Install Cassandra from Apache APT Respository (deb http://www.apache.org/dist/cassandra/debian 08x main)
> Step 3. apt-get install cassandra, as soon as it cassandra starts it will freeze the machine
> What's happening is that as soon as cassandra starts up it immediately sucks up 100% of CPU and starves the machine. This effectively bricks the box until you boot into single user mode and disable the cassandra init.d script.
> Under htop, the CPU usage shows up as "system" cpu, not user.
> The machine I'm testing this on is a Quad-Core Sandy Bridge w/ 16GB of Memory, so it's not a system resource issue. I've also tested this on completely different hardware (Dual 64-Bit Xeons & AMD X4) and it has the same effect.
> Ubuntu 10.10 does not exhibit the same issue. I have only tested 0.8 and 0.8.1.
> root@cassandra01:/# java -version
> java version "1.6.0_22"
> OpenJDK Runtime Environment (IcedTea6 1.10.2) (6b22-1.10.2-0ubuntu1~11.04.1)
> OpenJDK 64-Bit Server VM (build 20.0-b11, mixed mode)
> root@cassandra:/# uname -a
> Linux cassandra01 2.6.38-8-generic #42-Ubuntu SMP Mon Apr 11 03:31:24 UTC 2011 x86_64 x86_64 x86_64 GNU/Linux
> /proc/cpu
> Intel(R) Xeon(R) CPU E31270 @ 3.40GHz
> /proc/meminfo
> MemTotal: 16459776 kB
> MemFree: 14190708 kB
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-2845) Cassandra uses 100% system CPU on
Ubuntu Natty (11.04)
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Ellis updated CASSANDRA-2845:
--------------------------------------
Priority: Critical (was: Major)
Affects Version/s: (was: 0.8.1)
Fix Version/s: 0.8.2
> Cassandra uses 100% system CPU on Ubuntu Natty (11.04)
> ------------------------------------------------------
>
> Key: CASSANDRA-2845
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2845
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 0.8.0
> Environment: Default install of Ubuntu 11.04
> Reporter: Steve Corona
> Assignee: paul cannon
> Priority: Critical
> Fix For: 0.8.2
>
>
> Step 1. Boot up a brand new, default Ubuntu 11.04 Server install
> Step 2. Install Cassandra from Apache APT Respository (deb http://www.apache.org/dist/cassandra/debian 08x main)
> Step 3. apt-get install cassandra, as soon as it cassandra starts it will freeze the machine
> What's happening is that as soon as cassandra starts up it immediately sucks up 100% of CPU and starves the machine. This effectively bricks the box until you boot into single user mode and disable the cassandra init.d script.
> Under htop, the CPU usage shows up as "system" cpu, not user.
> The machine I'm testing this on is a Quad-Core Sandy Bridge w/ 16GB of Memory, so it's not a system resource issue. I've also tested this on completely different hardware (Dual 64-Bit Xeons & AMD X4) and it has the same effect.
> Ubuntu 10.10 does not exhibit the same issue. I have only tested 0.8 and 0.8.1.
> root@cassandra01:/# java -version
> java version "1.6.0_22"
> OpenJDK Runtime Environment (IcedTea6 1.10.2) (6b22-1.10.2-0ubuntu1~11.04.1)
> OpenJDK 64-Bit Server VM (build 20.0-b11, mixed mode)
> root@cassandra:/# uname -a
> Linux cassandra01 2.6.38-8-generic #42-Ubuntu SMP Mon Apr 11 03:31:24 UTC 2011 x86_64 x86_64 x86_64 GNU/Linux
> /proc/cpu
> Intel(R) Xeon(R) CPU E31270 @ 3.40GHz
> /proc/meminfo
> MemTotal: 16459776 kB
> MemFree: 14190708 kB
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-2845) Cassandra uses 100% system CPU
on Ubuntu Natty (11.04)
Posted by "Steve Corona (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13058613#comment-13058613 ]
Steve Corona commented on CASSANDRA-2845:
-----------------------------------------
I actually figured this out- it's more of a cassandra packaging issue than an issue with the actual code.
I extracted the cassandra-0.8.1.deb file and diff'ed all of the files with apache-cassandra-0.8.1-bin.tar.gz. I noticed that apache-cassandra-0.8.1.jar was off by a few bytes. I extracted the jar and determined that the deb file was using a different version of the following classes:
cli/CliLexer.class
cli/CliParser.class
cql/CqlLexer.class
cql/CqlParser.class
I repackaged the .deb using apache-cassandra-0.8.1.jar from the bin.tar.gz (will post instructions below) and it installed on Ubuntu 11.04 without a hitch. I'm not sure if the .jar/.class files used to package the deb were corrupted or just are a different/incomplete/broken version.
Poor mans .deb repackaging until it's officially fixed:
cd /tmp
mkdir work && cd work
wget http://www.fightrice.com/mirrors/apache/cassandra/0.8.1/apache-cassandra-0.8.1-bin.tar.gz
tar -zxvf apache-cassandra-0.8.1-bin.tar.gz
mkdir deb && cd deb
wget http://www.apache.org/dist/cassandra/debian/pool/main/c/cassandra/cassandra_0.8.1_all.deb
# need bintools to get ar utility
sudo apt-get install binutils
ar vx cassandra_0.8.1_all.deb
tar -zxvf data.tar.gz
rm data.tar.gz
cd ./usr/share/cassandra
mv /tmp/work/apache-cassandra-0.8.1/lib/apache-cassandra-0.8.1.jar .
cd /tmp/work/deb
tar -czvf data.tar.gz etc/ usr/ var/
rm cassandra_0.8.1_all.deb
ar rc cassandra_0.8.1_all.deb debian-binary control.tar.gz data.tar.gz
sudo apt-get install openjdk-6-jdk
sudo dpkg -i cassandra_0.8.1_all.deb
Alternatively, you can use policy-rc.d to prevent cassandra.deb's post-init script from running on install and replace the messed up .jar after it has been installed. Instructions here: http://lifeonubuntu.com/how-to-prevent-server-daemons-from-starting-during-apt-get-install/
> Cassandra uses 100% system CPU on Ubuntu Natty (11.04)
> ------------------------------------------------------
>
> Key: CASSANDRA-2845
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2845
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 0.8.0, 0.8.1
> Environment: Default install of Ubuntu 11.04
> Reporter: Steve Corona
>
> Step 1. Boot up a brand new, default Ubuntu 11.04 Server install
> Step 2. Install Cassandra from Apache APT Respository (deb http://www.apache.org/dist/cassandra/debian 08x main)
> Step 3. apt-get install cassandra, as soon as it cassandra starts it will freeze the machine
> What's happening is that as soon as cassandra starts up it immediately sucks up 100% of CPU and starves the machine. This effectively bricks the box until you boot into single user mode and disable the cassandra init.d script.
> Under htop, the CPU usage shows up as "system" cpu, not user.
> The machine I'm testing this on is a Quad-Core Sandy Bridge w/ 16GB of Memory, so it's not a system resource issue. I've also tested this on completely different hardware (Dual 64-Bit Xeons & AMD X4) and it has the same effect.
> Ubuntu 10.10 does not exhibit the same issue. I have only tested 0.8 and 0.8.1.
> root@cassandra01:/# java -version
> java version "1.6.0_22"
> OpenJDK Runtime Environment (IcedTea6 1.10.2) (6b22-1.10.2-0ubuntu1~11.04.1)
> OpenJDK 64-Bit Server VM (build 20.0-b11, mixed mode)
> root@cassandra:/# uname -a
> Linux cassandra01 2.6.38-8-generic #42-Ubuntu SMP Mon Apr 11 03:31:24 UTC 2011 x86_64 x86_64 x86_64 GNU/Linux
> /proc/cpu
> Intel(R) Xeon(R) CPU E31270 @ 3.40GHz
> /proc/meminfo
> MemTotal: 16459776 kB
> MemFree: 14190708 kB
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (CASSANDRA-2845) Cassandra uses 100% system CPU
on Ubuntu Natty (11.04)
Posted by "paul cannon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
paul cannon resolved CASSANDRA-2845.
------------------------------------
Resolution: Not A Problem
Ok, documented things at http://wiki.apache.org/cassandra/FAQ#ubuntu_ec2_hangs . Closing this for now.
> Cassandra uses 100% system CPU on Ubuntu Natty (11.04)
> ------------------------------------------------------
>
> Key: CASSANDRA-2845
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2845
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 0.8.0
> Environment: Default install of Ubuntu 11.04
> Reporter: Steve Corona
> Assignee: paul cannon
> Priority: Critical
> Fix For: 0.8.2
>
>
> Step 1. Boot up a brand new, default Ubuntu 11.04 Server install
> Step 2. Install Cassandra from Apache APT Respository (deb http://www.apache.org/dist/cassandra/debian 08x main)
> Step 3. apt-get install cassandra, as soon as it cassandra starts it will freeze the machine
> What's happening is that as soon as cassandra starts up it immediately sucks up 100% of CPU and starves the machine. This effectively bricks the box until you boot into single user mode and disable the cassandra init.d script.
> Under htop, the CPU usage shows up as "system" cpu, not user.
> The machine I'm testing this on is a Quad-Core Sandy Bridge w/ 16GB of Memory, so it's not a system resource issue. I've also tested this on completely different hardware (Dual 64-Bit Xeons & AMD X4) and it has the same effect.
> Ubuntu 10.10 does not exhibit the same issue. I have only tested 0.8 and 0.8.1.
> root@cassandra01:/# java -version
> java version "1.6.0_22"
> OpenJDK Runtime Environment (IcedTea6 1.10.2) (6b22-1.10.2-0ubuntu1~11.04.1)
> OpenJDK 64-Bit Server VM (build 20.0-b11, mixed mode)
> root@cassandra:/# uname -a
> Linux cassandra01 2.6.38-8-generic #42-Ubuntu SMP Mon Apr 11 03:31:24 UTC 2011 x86_64 x86_64 x86_64 GNU/Linux
> /proc/cpu
> Intel(R) Xeon(R) CPU E31270 @ 3.40GHz
> /proc/meminfo
> MemTotal: 16459776 kB
> MemFree: 14190708 kB
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-2845) Cassandra uses 100% system CPU
on Ubuntu Natty (11.04)
Posted by "paul cannon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13067888#comment-13067888 ]
paul cannon commented on CASSANDRA-2845:
----------------------------------------
To clarify my earlier comment about different EC2 kernel images: I thought those were the actual linux kernel images I was getting, but they were actually just different pv-grub builds. They were all still chaining to the kernel from inside the Ubuntu image.
> Cassandra uses 100% system CPU on Ubuntu Natty (11.04)
> ------------------------------------------------------
>
> Key: CASSANDRA-2845
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2845
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 0.8.0
> Environment: Default install of Ubuntu 11.04
> Reporter: Steve Corona
> Assignee: paul cannon
> Priority: Critical
> Fix For: 0.8.2
>
>
> Step 1. Boot up a brand new, default Ubuntu 11.04 Server install
> Step 2. Install Cassandra from Apache APT Respository (deb http://www.apache.org/dist/cassandra/debian 08x main)
> Step 3. apt-get install cassandra, as soon as it cassandra starts it will freeze the machine
> What's happening is that as soon as cassandra starts up it immediately sucks up 100% of CPU and starves the machine. This effectively bricks the box until you boot into single user mode and disable the cassandra init.d script.
> Under htop, the CPU usage shows up as "system" cpu, not user.
> The machine I'm testing this on is a Quad-Core Sandy Bridge w/ 16GB of Memory, so it's not a system resource issue. I've also tested this on completely different hardware (Dual 64-Bit Xeons & AMD X4) and it has the same effect.
> Ubuntu 10.10 does not exhibit the same issue. I have only tested 0.8 and 0.8.1.
> root@cassandra01:/# java -version
> java version "1.6.0_22"
> OpenJDK Runtime Environment (IcedTea6 1.10.2) (6b22-1.10.2-0ubuntu1~11.04.1)
> OpenJDK 64-Bit Server VM (build 20.0-b11, mixed mode)
> root@cassandra:/# uname -a
> Linux cassandra01 2.6.38-8-generic #42-Ubuntu SMP Mon Apr 11 03:31:24 UTC 2011 x86_64 x86_64 x86_64 GNU/Linux
> /proc/cpu
> Intel(R) Xeon(R) CPU E31270 @ 3.40GHz
> /proc/meminfo
> MemTotal: 16459776 kB
> MemFree: 14190708 kB
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-2845) Cassandra uses 100% system CPU
on Ubuntu Natty (11.04)
Posted by "paul cannon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13067990#comment-13067990 ]
paul cannon commented on CASSANDRA-2845:
----------------------------------------
Oh ok, thanks.
> Cassandra uses 100% system CPU on Ubuntu Natty (11.04)
> ------------------------------------------------------
>
> Key: CASSANDRA-2845
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2845
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 0.8.0
> Environment: Default install of Ubuntu 11.04
> Reporter: Steve Corona
> Assignee: paul cannon
> Priority: Critical
> Fix For: 0.8.2
>
>
> Step 1. Boot up a brand new, default Ubuntu 11.04 Server install
> Step 2. Install Cassandra from Apache APT Respository (deb http://www.apache.org/dist/cassandra/debian 08x main)
> Step 3. apt-get install cassandra, as soon as it cassandra starts it will freeze the machine
> What's happening is that as soon as cassandra starts up it immediately sucks up 100% of CPU and starves the machine. This effectively bricks the box until you boot into single user mode and disable the cassandra init.d script.
> Under htop, the CPU usage shows up as "system" cpu, not user.
> The machine I'm testing this on is a Quad-Core Sandy Bridge w/ 16GB of Memory, so it's not a system resource issue. I've also tested this on completely different hardware (Dual 64-Bit Xeons & AMD X4) and it has the same effect.
> Ubuntu 10.10 does not exhibit the same issue. I have only tested 0.8 and 0.8.1.
> root@cassandra01:/# java -version
> java version "1.6.0_22"
> OpenJDK Runtime Environment (IcedTea6 1.10.2) (6b22-1.10.2-0ubuntu1~11.04.1)
> OpenJDK 64-Bit Server VM (build 20.0-b11, mixed mode)
> root@cassandra:/# uname -a
> Linux cassandra01 2.6.38-8-generic #42-Ubuntu SMP Mon Apr 11 03:31:24 UTC 2011 x86_64 x86_64 x86_64 GNU/Linux
> /proc/cpu
> Intel(R) Xeon(R) CPU E31270 @ 3.40GHz
> /proc/meminfo
> MemTotal: 16459776 kB
> MemFree: 14190708 kB
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-2845) Cassandra uses 100% system CPU
on Ubuntu Natty (11.04)
Posted by "Jackson Chung (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13083455#comment-13083455 ]
Jackson Chung commented on CASSANDRA-2845:
------------------------------------------
fwiw,
i was able to avoid this (hang) if using just java (Sun's) instead of jsvc. (jna enabled on both, i do have to symlink it manually when start manually if install from deb package)
Once i switch to jsvc, hell breaks
kernel was on the older one on ec2:
Linux domU-12-31-39-00-2C-42 2.6.38-8-virtual #42-Ubuntu SMP Mon Apr 11 04:06:34 UTC 2011 x86_64 x86_64 x86_64 GNU/Linux
Also able to had the same hang on a 2.6.35 on a rackspace couple days ago (killed the vm already..)
dmesg shows timeout/OOM, crazy stuff :)
on my own local,with separate install kernel
Distributor ID: Ubuntu
Description: Ubuntu 10.10
Release: 10.10
Codename: maverick
Linux faranth 2.6.39-02063903-generic #201107091121 SMP Sat Jul 9 11:25:36 UTC 2011 x86_64 GNU/Linux
I don't have the hang problem (using jsvc/jna/package)
> Cassandra uses 100% system CPU on Ubuntu Natty (11.04)
> ------------------------------------------------------
>
> Key: CASSANDRA-2845
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2845
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 0.8.0
> Environment: Default install of Ubuntu 11.04
> Reporter: Steve Corona
> Assignee: paul cannon
> Priority: Critical
> Fix For: 0.8.2
>
>
> Step 1. Boot up a brand new, default Ubuntu 11.04 Server install
> Step 2. Install Cassandra from Apache APT Respository (deb http://www.apache.org/dist/cassandra/debian 08x main)
> Step 3. apt-get install cassandra, as soon as it cassandra starts it will freeze the machine
> What's happening is that as soon as cassandra starts up it immediately sucks up 100% of CPU and starves the machine. This effectively bricks the box until you boot into single user mode and disable the cassandra init.d script.
> Under htop, the CPU usage shows up as "system" cpu, not user.
> The machine I'm testing this on is a Quad-Core Sandy Bridge w/ 16GB of Memory, so it's not a system resource issue. I've also tested this on completely different hardware (Dual 64-Bit Xeons & AMD X4) and it has the same effect.
> Ubuntu 10.10 does not exhibit the same issue. I have only tested 0.8 and 0.8.1.
> root@cassandra01:/# java -version
> java version "1.6.0_22"
> OpenJDK Runtime Environment (IcedTea6 1.10.2) (6b22-1.10.2-0ubuntu1~11.04.1)
> OpenJDK 64-Bit Server VM (build 20.0-b11, mixed mode)
> root@cassandra:/# uname -a
> Linux cassandra01 2.6.38-8-generic #42-Ubuntu SMP Mon Apr 11 03:31:24 UTC 2011 x86_64 x86_64 x86_64 GNU/Linux
> /proc/cpu
> Intel(R) Xeon(R) CPU E31270 @ 3.40GHz
> /proc/meminfo
> MemTotal: 16459776 kB
> MemFree: 14190708 kB
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-2845) Cassandra uses 100% system CPU
on Ubuntu Natty (11.04)
Posted by "paul cannon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13067887#comment-13067887 ]
paul cannon commented on CASSANDRA-2845:
----------------------------------------
It seems worth just a tiny bit of extra testing if we can identify the problem a little better, because the potential benefit from JNA is so large, and Ubuntu is, by and large, a very handy platform to use with ec2 (not least because of the UEC AMIs).
I've found now that upgrading the kernel to 2.6.38-10 (in my case, the package linux-image-2.6.38-10-virtual) seems to make the problem go away completely. Steve, can you see if that helps you as well? If so, we can close this and just recommend avoiding Ubuntu 2.6.38-8 kernel builds.
> Cassandra uses 100% system CPU on Ubuntu Natty (11.04)
> ------------------------------------------------------
>
> Key: CASSANDRA-2845
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2845
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 0.8.0
> Environment: Default install of Ubuntu 11.04
> Reporter: Steve Corona
> Assignee: paul cannon
> Priority: Critical
> Fix For: 0.8.2
>
>
> Step 1. Boot up a brand new, default Ubuntu 11.04 Server install
> Step 2. Install Cassandra from Apache APT Respository (deb http://www.apache.org/dist/cassandra/debian 08x main)
> Step 3. apt-get install cassandra, as soon as it cassandra starts it will freeze the machine
> What's happening is that as soon as cassandra starts up it immediately sucks up 100% of CPU and starves the machine. This effectively bricks the box until you boot into single user mode and disable the cassandra init.d script.
> Under htop, the CPU usage shows up as "system" cpu, not user.
> The machine I'm testing this on is a Quad-Core Sandy Bridge w/ 16GB of Memory, so it's not a system resource issue. I've also tested this on completely different hardware (Dual 64-Bit Xeons & AMD X4) and it has the same effect.
> Ubuntu 10.10 does not exhibit the same issue. I have only tested 0.8 and 0.8.1.
> root@cassandra01:/# java -version
> java version "1.6.0_22"
> OpenJDK Runtime Environment (IcedTea6 1.10.2) (6b22-1.10.2-0ubuntu1~11.04.1)
> OpenJDK 64-Bit Server VM (build 20.0-b11, mixed mode)
> root@cassandra:/# uname -a
> Linux cassandra01 2.6.38-8-generic #42-Ubuntu SMP Mon Apr 11 03:31:24 UTC 2011 x86_64 x86_64 x86_64 GNU/Linux
> /proc/cpu
> Intel(R) Xeon(R) CPU E31270 @ 3.40GHz
> /proc/meminfo
> MemTotal: 16459776 kB
> MemFree: 14190708 kB
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-2845) Cassandra uses 100% system CPU
on Ubuntu Natty (11.04)
Posted by "Steve Corona (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13058706#comment-13058706 ]
Steve Corona commented on CASSANDRA-2845:
-----------------------------------------
Okay, so as it turns out the original problem is different than I thought. My dpkg solution was just skirting around the real issue (since dpkg doesn't force you to install all of the recommended dependencies).
It's libjna-java (3.2.4-2ubuntu2) that's really causing the issue. The cassandra apt repository is pulling it in as a dependency and for, whatever reason, it sucks up all of the CPU when it runs with cassandra. I don't know if it's a matter of libjna being broken in 11.04 or just that it doesn't play nice with Cassandra.
FWIW, CASSANDRA-2803 mentions deb packages & libjna- not sure what role that plays into this.
Here is my current workaround:
mkdir -p /usr/sbin/
cat < /usr/sbin/policy-rc.d
#!/bin/sh
exit 101
EOF
chmod 755 /usr/sbin/policy-rc.d
apt-get install cassandra
apt-get remove libjna-java
service cassandra start
> Cassandra uses 100% system CPU on Ubuntu Natty (11.04)
> ------------------------------------------------------
>
> Key: CASSANDRA-2845
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2845
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 0.8.0, 0.8.1
> Environment: Default install of Ubuntu 11.04
> Reporter: Steve Corona
> Assignee: paul cannon
>
> Step 1. Boot up a brand new, default Ubuntu 11.04 Server install
> Step 2. Install Cassandra from Apache APT Respository (deb http://www.apache.org/dist/cassandra/debian 08x main)
> Step 3. apt-get install cassandra, as soon as it cassandra starts it will freeze the machine
> What's happening is that as soon as cassandra starts up it immediately sucks up 100% of CPU and starves the machine. This effectively bricks the box until you boot into single user mode and disable the cassandra init.d script.
> Under htop, the CPU usage shows up as "system" cpu, not user.
> The machine I'm testing this on is a Quad-Core Sandy Bridge w/ 16GB of Memory, so it's not a system resource issue. I've also tested this on completely different hardware (Dual 64-Bit Xeons & AMD X4) and it has the same effect.
> Ubuntu 10.10 does not exhibit the same issue. I have only tested 0.8 and 0.8.1.
> root@cassandra01:/# java -version
> java version "1.6.0_22"
> OpenJDK Runtime Environment (IcedTea6 1.10.2) (6b22-1.10.2-0ubuntu1~11.04.1)
> OpenJDK 64-Bit Server VM (build 20.0-b11, mixed mode)
> root@cassandra:/# uname -a
> Linux cassandra01 2.6.38-8-generic #42-Ubuntu SMP Mon Apr 11 03:31:24 UTC 2011 x86_64 x86_64 x86_64 GNU/Linux
> /proc/cpu
> Intel(R) Xeon(R) CPU E31270 @ 3.40GHz
> /proc/meminfo
> MemTotal: 16459776 kB
> MemFree: 14190708 kB
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-2845) Cassandra uses 100% system CPU
on Ubuntu Natty (11.04)
Posted by "Steve Corona (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13067943#comment-13067943 ]
Steve Corona commented on CASSANDRA-2845:
-----------------------------------------
FWIW, I am using real hardware and not an EC2 instance.
> Cassandra uses 100% system CPU on Ubuntu Natty (11.04)
> ------------------------------------------------------
>
> Key: CASSANDRA-2845
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2845
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 0.8.0
> Environment: Default install of Ubuntu 11.04
> Reporter: Steve Corona
> Assignee: paul cannon
> Priority: Critical
> Fix For: 0.8.2
>
>
> Step 1. Boot up a brand new, default Ubuntu 11.04 Server install
> Step 2. Install Cassandra from Apache APT Respository (deb http://www.apache.org/dist/cassandra/debian 08x main)
> Step 3. apt-get install cassandra, as soon as it cassandra starts it will freeze the machine
> What's happening is that as soon as cassandra starts up it immediately sucks up 100% of CPU and starves the machine. This effectively bricks the box until you boot into single user mode and disable the cassandra init.d script.
> Under htop, the CPU usage shows up as "system" cpu, not user.
> The machine I'm testing this on is a Quad-Core Sandy Bridge w/ 16GB of Memory, so it's not a system resource issue. I've also tested this on completely different hardware (Dual 64-Bit Xeons & AMD X4) and it has the same effect.
> Ubuntu 10.10 does not exhibit the same issue. I have only tested 0.8 and 0.8.1.
> root@cassandra01:/# java -version
> java version "1.6.0_22"
> OpenJDK Runtime Environment (IcedTea6 1.10.2) (6b22-1.10.2-0ubuntu1~11.04.1)
> OpenJDK 64-Bit Server VM (build 20.0-b11, mixed mode)
> root@cassandra:/# uname -a
> Linux cassandra01 2.6.38-8-generic #42-Ubuntu SMP Mon Apr 11 03:31:24 UTC 2011 x86_64 x86_64 x86_64 GNU/Linux
> /proc/cpu
> Intel(R) Xeon(R) CPU E31270 @ 3.40GHz
> /proc/meminfo
> MemTotal: 16459776 kB
> MemFree: 14190708 kB
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Issue Comment Edited] (CASSANDRA-2845) Cassandra uses 100%
system CPU on Ubuntu Natty (11.04)
Posted by "tyler cheung (Issue Comment Edited) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13220631#comment-13220631 ]
tyler cheung edited comment on CASSANDRA-2845 at 3/2/12 2:52 AM:
-----------------------------------------------------------------
hmm... when i start it w/ sudo /usr/sbin/cassandra, instead of the /etc/init.d/cassandra script, the memory usage is fine...
{{Tasks: 156 total, 1 running, 154 sleeping, 0 stopped, 1 zombie}}
{{Cpu(s): 0.3%us, 0.2%sy, 0.0%ni, 99.5%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st}}
{{Mem: 3934168k total, 2511668k used, 1422500k free, 176076k buffers}}
{{Swap: 4071420k total, 25572k used, 4045848k free, 1086980k cached}}
{{PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND}}
{{24815 root 20 0 1527m 69m 9.9m S 1 1.8 0:00.99 java}}
I am missing something?
was (Author: tcheung):
hmm... when i start it w/ sudo /usr/sbin/cassandra, the memory usage is fine...
{{Tasks: 156 total, 1 running, 154 sleeping, 0 stopped, 1 zombie}}
{{Cpu(s): 0.3%us, 0.2%sy, 0.0%ni, 99.5%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st}}
{{Mem: 3934168k total, 2511668k used, 1422500k free, 176076k buffers}}
{{Swap: 4071420k total, 25572k used, 4045848k free, 1086980k cached}}
{{PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND}}
{{24815 root 20 0 1527m 69m 9.9m S 1 1.8 0:00.99 java}}
I am missing something?
> Cassandra uses 100% system CPU on Ubuntu Natty (11.04)
> ------------------------------------------------------
>
> Key: CASSANDRA-2845
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2845
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 0.8.0
> Environment: Default install of Ubuntu 11.04
> Reporter: Steve Corona
> Assignee: paul cannon
> Priority: Critical
> Fix For: 0.8.2
>
>
> Step 1. Boot up a brand new, default Ubuntu 11.04 Server install
> Step 2. Install Cassandra from Apache APT Respository (deb http://www.apache.org/dist/cassandra/debian 08x main)
> Step 3. apt-get install cassandra, as soon as it cassandra starts it will freeze the machine
> What's happening is that as soon as cassandra starts up it immediately sucks up 100% of CPU and starves the machine. This effectively bricks the box until you boot into single user mode and disable the cassandra init.d script.
> Under htop, the CPU usage shows up as "system" cpu, not user.
> The machine I'm testing this on is a Quad-Core Sandy Bridge w/ 16GB of Memory, so it's not a system resource issue. I've also tested this on completely different hardware (Dual 64-Bit Xeons & AMD X4) and it has the same effect.
> Ubuntu 10.10 does not exhibit the same issue. I have only tested 0.8 and 0.8.1.
> root@cassandra01:/# java -version
> java version "1.6.0_22"
> OpenJDK Runtime Environment (IcedTea6 1.10.2) (6b22-1.10.2-0ubuntu1~11.04.1)
> OpenJDK 64-Bit Server VM (build 20.0-b11, mixed mode)
> root@cassandra:/# uname -a
> Linux cassandra01 2.6.38-8-generic #42-Ubuntu SMP Mon Apr 11 03:31:24 UTC 2011 x86_64 x86_64 x86_64 GNU/Linux
> /proc/cpu
> Intel(R) Xeon(R) CPU E31270 @ 3.40GHz
> /proc/meminfo
> MemTotal: 16459776 kB
> MemFree: 14190708 kB
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Issue Comment Edited] (CASSANDRA-2845) Cassandra uses 100%
system CPU on Ubuntu Natty (11.04)
Posted by "tyler cheung (Issue Comment Edited) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13220627#comment-13220627 ]
tyler cheung edited comment on CASSANDRA-2845 at 3/2/12 2:46 AM:
-----------------------------------------------------------------
OK - so what happened was I manually put in libjna 3.4.0 files (copied the tarball and redid the symlinks). The /etc/init.d script didn't work but the sudo /usr/sbin/cassandra did, and things seem to work a lot better.
They just moved my office and I have a new core i5 w/ 4 gb RAM. I just redid the cassandra install w/ vanilla 11.10 (libjna 3.2.7), openjre6, jsvc1.0.6.
There was a brief hiccup but its running. Top shows jsvc running cassandra consuming 35% memory as follows:
{{Cpu(s): 0.2%us, 0.2%sy, 0.0%ni, 99.6%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st}}
{{Mem: 3934168k total, 3805184k used, 128984k free, 175792k buffers}}
{{Swap: 4071420k total, 26532k used, 4044888k free, 1083252k cached}}
{{ PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND }}
{{20452 root 20 0 166m 13m 8640 S 1 0.4 1:37.09 Xorg }}
{{21906 tylerc 20 0 453m 16m 10m S 1 0.4 0:02.43 xfce4-terminal }}
{{21337 tylerc 20 0 172m 12m 8704 S 0 0.3 0:10.59 xfwm4 }}
{{21433 tylerc 20 0 698m 105m 38m S 0 2.7 2:59.83 chrome }}
{{23067 tylerc 20 0 864m 59m 16m S 0 1.6 0:01.94 chrome }}
{{23735 cassandr 20 0 1518m 1.3g 18m S 0 35.1 0:01.90 jsvc }}
{{...}}
I'm going to try and get the newer libjna again and see if this helps memory usage. Kernel is 3.0.0.12 generic.
was (Author: tcheung):
OK - so what happened was I manually put in libjna 3.4.0 files (copied the tarball and redid the symlinks). The /etc/init.d script didn't work but the sudo /usr/sbin/cassandra did, and things seem to work a lot better.
They just moved my office and I have a new core i5 w/ 4 gb RAM. I just redid the cassandra install w/ vanilla 11.10 (libjna 3.2.7), openjre6, jsvc1.0.6.
There was a brief hiccup but its running. Top shows jsvc running cassandra consuming 35% memory as follows:
Cpu(s): 0.2%us, 0.2%sy, 0.0%ni, 99.6%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
Mem: 3934168k total, 3805184k used, 128984k free, 175792k buffers
Swap: 4071420k total, 26532k used, 4044888k free, 1083252k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
20452 root 20 0 166m 13m 8640 S 1 0.4 1:37.09 Xorg
21906 tylerc 20 0 453m 16m 10m S 1 0.4 0:02.43 xfce4-terminal
21337 tylerc 20 0 172m 12m 8704 S 0 0.3 0:10.59 xfwm4
21433 tylerc 20 0 698m 105m 38m S 0 2.7 2:59.83 chrome
23067 tylerc 20 0 864m 59m 16m S 0 1.6 0:01.94 chrome
23735 cassandr 20 0 1518m 1.3g 18m S 0 35.1 0:01.90 jsvc
...
I'm going to try and get the newer libjna again and see if this helps memory usage. Kernel is 3.0.0.12 generic.
> Cassandra uses 100% system CPU on Ubuntu Natty (11.04)
> ------------------------------------------------------
>
> Key: CASSANDRA-2845
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2845
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 0.8.0
> Environment: Default install of Ubuntu 11.04
> Reporter: Steve Corona
> Assignee: paul cannon
> Priority: Critical
> Fix For: 0.8.2
>
>
> Step 1. Boot up a brand new, default Ubuntu 11.04 Server install
> Step 2. Install Cassandra from Apache APT Respository (deb http://www.apache.org/dist/cassandra/debian 08x main)
> Step 3. apt-get install cassandra, as soon as it cassandra starts it will freeze the machine
> What's happening is that as soon as cassandra starts up it immediately sucks up 100% of CPU and starves the machine. This effectively bricks the box until you boot into single user mode and disable the cassandra init.d script.
> Under htop, the CPU usage shows up as "system" cpu, not user.
> The machine I'm testing this on is a Quad-Core Sandy Bridge w/ 16GB of Memory, so it's not a system resource issue. I've also tested this on completely different hardware (Dual 64-Bit Xeons & AMD X4) and it has the same effect.
> Ubuntu 10.10 does not exhibit the same issue. I have only tested 0.8 and 0.8.1.
> root@cassandra01:/# java -version
> java version "1.6.0_22"
> OpenJDK Runtime Environment (IcedTea6 1.10.2) (6b22-1.10.2-0ubuntu1~11.04.1)
> OpenJDK 64-Bit Server VM (build 20.0-b11, mixed mode)
> root@cassandra:/# uname -a
> Linux cassandra01 2.6.38-8-generic #42-Ubuntu SMP Mon Apr 11 03:31:24 UTC 2011 x86_64 x86_64 x86_64 GNU/Linux
> /proc/cpu
> Intel(R) Xeon(R) CPU E31270 @ 3.40GHz
> /proc/meminfo
> MemTotal: 16459776 kB
> MemFree: 14190708 kB
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-2845) Cassandra uses 100% system CPU
on Ubuntu Natty (11.04)
Posted by "Steve Corona (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13212075#comment-13212075 ]
Steve Corona commented on CASSANDRA-2845:
-----------------------------------------
The kernel upgrade is what fixed it for us.
> Cassandra uses 100% system CPU on Ubuntu Natty (11.04)
> ------------------------------------------------------
>
> Key: CASSANDRA-2845
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2845
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 0.8.0
> Environment: Default install of Ubuntu 11.04
> Reporter: Steve Corona
> Assignee: paul cannon
> Priority: Critical
> Fix For: 0.8.2
>
>
> Step 1. Boot up a brand new, default Ubuntu 11.04 Server install
> Step 2. Install Cassandra from Apache APT Respository (deb http://www.apache.org/dist/cassandra/debian 08x main)
> Step 3. apt-get install cassandra, as soon as it cassandra starts it will freeze the machine
> What's happening is that as soon as cassandra starts up it immediately sucks up 100% of CPU and starves the machine. This effectively bricks the box until you boot into single user mode and disable the cassandra init.d script.
> Under htop, the CPU usage shows up as "system" cpu, not user.
> The machine I'm testing this on is a Quad-Core Sandy Bridge w/ 16GB of Memory, so it's not a system resource issue. I've also tested this on completely different hardware (Dual 64-Bit Xeons & AMD X4) and it has the same effect.
> Ubuntu 10.10 does not exhibit the same issue. I have only tested 0.8 and 0.8.1.
> root@cassandra01:/# java -version
> java version "1.6.0_22"
> OpenJDK Runtime Environment (IcedTea6 1.10.2) (6b22-1.10.2-0ubuntu1~11.04.1)
> OpenJDK 64-Bit Server VM (build 20.0-b11, mixed mode)
> root@cassandra:/# uname -a
> Linux cassandra01 2.6.38-8-generic #42-Ubuntu SMP Mon Apr 11 03:31:24 UTC 2011 x86_64 x86_64 x86_64 GNU/Linux
> /proc/cpu
> Intel(R) Xeon(R) CPU E31270 @ 3.40GHz
> /proc/meminfo
> MemTotal: 16459776 kB
> MemFree: 14190708 kB
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Issue Comment Edited] (CASSANDRA-2845) Cassandra uses 100%
system CPU on Ubuntu Natty (11.04)
Posted by "tyler cheung (Issue Comment Edited) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13220627#comment-13220627 ]
tyler cheung edited comment on CASSANDRA-2845 at 3/2/12 2:44 AM:
-----------------------------------------------------------------
OK - so what happened was I manually put in libjna 3.4.0 files (copied the tarball and redid the symlinks). The /etc/init.d script didn't work but the sudo /usr/sbin/cassandra did, and things seem to work a lot better.
They just moved my office and I have a new core i5 w/ 4 gb RAM. I just redid the cassandra install w/ vanilla 11.10 (libjna 3.2.7), openjre6, jsvc1.0.6.
There was a brief hiccup but its running. Top shows jsvc running cassandra consuming 35% memory as follows:
{{monospaced}}
Cpu(s): 0.2%us, 0.2%sy, 0.0%ni, 99.6%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
Mem: 3934168k total, 3805184k used, 128984k free, 175792k buffers
Swap: 4071420k total, 26532k used, 4044888k free, 1083252k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
20452 root 20 0 166m 13m 8640 S 1 0.4 1:37.09 Xorg
21906 tylerc 20 0 453m 16m 10m S 1 0.4 0:02.43 xfce4-terminal
21337 tylerc 20 0 172m 12m 8704 S 0 0.3 0:10.59 xfwm4
21433 tylerc 20 0 698m 105m 38m S 0 2.7 2:59.83 chrome
23067 tylerc 20 0 864m 59m 16m S 0 1.6 0:01.94 chrome
23735 cassandr 20 0 1518m 1.3g 18m S 0 35.1 0:01.90 jsvc
...
{{monospaced}}
I'm going to try and get the newer libjna again and see if this helps. Kernel is 3.0.0.12 generic.
was (Author: tcheung):
OK - so what happened was I manually put in libjna 3.4.0 files (copied the tarball and redid the symlinks). The /etc/init.d script didn't work but the sudo /usr/sbin/cassandra did, and things seem to work a lot better.
They just moved my office and I have a new core i5 w/ 4 gb RAM. I just redid the cassandra install w/ vanilla 11.10 (libjna 3.2.7), openjre6, jsvc1.0.6.
There was a brief hiccup but its running. Top shows jsvc running cassandra consuming 35% memory as follows:
{{
Cpu(s): 0.2%us, 0.2%sy, 0.0%ni, 99.6%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
Mem: 3934168k total, 3805184k used, 128984k free, 175792k buffers
Swap: 4071420k total, 26532k used, 4044888k free, 1083252k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
20452 root 20 0 166m 13m 8640 S 1 0.4 1:37.09 Xorg
21906 tylerc 20 0 453m 16m 10m S 1 0.4 0:02.43 xfce4-terminal
21337 tylerc 20 0 172m 12m 8704 S 0 0.3 0:10.59 xfwm4
21433 tylerc 20 0 698m 105m 38m S 0 2.7 2:59.83 chrome
23067 tylerc 20 0 864m 59m 16m S 0 1.6 0:01.94 chrome
23735 cassandr 20 0 1518m 1.3g 18m S 0 35.1 0:01.90 jsvc
...
}}
I'm going to try and get the newer libjna again and see if this helps. Kernel is 3.0.0.12 generic.
> Cassandra uses 100% system CPU on Ubuntu Natty (11.04)
> ------------------------------------------------------
>
> Key: CASSANDRA-2845
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2845
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 0.8.0
> Environment: Default install of Ubuntu 11.04
> Reporter: Steve Corona
> Assignee: paul cannon
> Priority: Critical
> Fix For: 0.8.2
>
>
> Step 1. Boot up a brand new, default Ubuntu 11.04 Server install
> Step 2. Install Cassandra from Apache APT Respository (deb http://www.apache.org/dist/cassandra/debian 08x main)
> Step 3. apt-get install cassandra, as soon as it cassandra starts it will freeze the machine
> What's happening is that as soon as cassandra starts up it immediately sucks up 100% of CPU and starves the machine. This effectively bricks the box until you boot into single user mode and disable the cassandra init.d script.
> Under htop, the CPU usage shows up as "system" cpu, not user.
> The machine I'm testing this on is a Quad-Core Sandy Bridge w/ 16GB of Memory, so it's not a system resource issue. I've also tested this on completely different hardware (Dual 64-Bit Xeons & AMD X4) and it has the same effect.
> Ubuntu 10.10 does not exhibit the same issue. I have only tested 0.8 and 0.8.1.
> root@cassandra01:/# java -version
> java version "1.6.0_22"
> OpenJDK Runtime Environment (IcedTea6 1.10.2) (6b22-1.10.2-0ubuntu1~11.04.1)
> OpenJDK 64-Bit Server VM (build 20.0-b11, mixed mode)
> root@cassandra:/# uname -a
> Linux cassandra01 2.6.38-8-generic #42-Ubuntu SMP Mon Apr 11 03:31:24 UTC 2011 x86_64 x86_64 x86_64 GNU/Linux
> /proc/cpu
> Intel(R) Xeon(R) CPU E31270 @ 3.40GHz
> /proc/meminfo
> MemTotal: 16459776 kB
> MemFree: 14190708 kB
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-2845) Cassandra uses 100% system CPU
on Ubuntu Natty (11.04)
Posted by "Steve Corona (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13067904#comment-13067904 ]
Steve Corona commented on CASSANDRA-2845:
-----------------------------------------
brilliant- upgrading from 2.6.38-8 to 2.6.38-10 solves the issue for me as well. so strange
> Cassandra uses 100% system CPU on Ubuntu Natty (11.04)
> ------------------------------------------------------
>
> Key: CASSANDRA-2845
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2845
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 0.8.0
> Environment: Default install of Ubuntu 11.04
> Reporter: Steve Corona
> Assignee: paul cannon
> Priority: Critical
> Fix For: 0.8.2
>
>
> Step 1. Boot up a brand new, default Ubuntu 11.04 Server install
> Step 2. Install Cassandra from Apache APT Respository (deb http://www.apache.org/dist/cassandra/debian 08x main)
> Step 3. apt-get install cassandra, as soon as it cassandra starts it will freeze the machine
> What's happening is that as soon as cassandra starts up it immediately sucks up 100% of CPU and starves the machine. This effectively bricks the box until you boot into single user mode and disable the cassandra init.d script.
> Under htop, the CPU usage shows up as "system" cpu, not user.
> The machine I'm testing this on is a Quad-Core Sandy Bridge w/ 16GB of Memory, so it's not a system resource issue. I've also tested this on completely different hardware (Dual 64-Bit Xeons & AMD X4) and it has the same effect.
> Ubuntu 10.10 does not exhibit the same issue. I have only tested 0.8 and 0.8.1.
> root@cassandra01:/# java -version
> java version "1.6.0_22"
> OpenJDK Runtime Environment (IcedTea6 1.10.2) (6b22-1.10.2-0ubuntu1~11.04.1)
> OpenJDK 64-Bit Server VM (build 20.0-b11, mixed mode)
> root@cassandra:/# uname -a
> Linux cassandra01 2.6.38-8-generic #42-Ubuntu SMP Mon Apr 11 03:31:24 UTC 2011 x86_64 x86_64 x86_64 GNU/Linux
> /proc/cpu
> Intel(R) Xeon(R) CPU E31270 @ 3.40GHz
> /proc/meminfo
> MemTotal: 16459776 kB
> MemFree: 14190708 kB
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Issue Comment Edited] (CASSANDRA-2845) Cassandra uses 100%
system CPU on Ubuntu Natty (11.04)
Posted by "tyler cheung (Issue Comment Edited) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13220627#comment-13220627 ]
tyler cheung edited comment on CASSANDRA-2845 at 3/2/12 2:43 AM:
-----------------------------------------------------------------
OK - so what happened was I manually put in libjna 3.4.0 files (copied the tarball and redid the symlinks). The /etc/init.d script didn't work but the sudo /usr/sbin/cassandra did, and things seem to work a lot better.
They just moved my office and I have a new core i5 w/ 4 gb RAM. I just redid the cassandra install w/ vanilla 11.10 (libjna 3.2.7), openjre6, jsvc1.0.6.
There was a brief hiccup but its running. Top shows jsvc running cassandra consuming 35% memory as follows:
{{
Cpu(s): 0.2%us, 0.2%sy, 0.0%ni, 99.6%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
Mem: 3934168k total, 3805184k used, 128984k free, 175792k buffers
Swap: 4071420k total, 26532k used, 4044888k free, 1083252k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
20452 root 20 0 166m 13m 8640 S 1 0.4 1:37.09 Xorg
21906 tylerc 20 0 453m 16m 10m S 1 0.4 0:02.43 xfce4-terminal
21337 tylerc 20 0 172m 12m 8704 S 0 0.3 0:10.59 xfwm4
21433 tylerc 20 0 698m 105m 38m S 0 2.7 2:59.83 chrome
23067 tylerc 20 0 864m 59m 16m S 0 1.6 0:01.94 chrome
23735 cassandr 20 0 1518m 1.3g 18m S 0 35.1 0:01.90 jsvc
...
}}
I'm going to try and get the newer libjna again and see if this helps. Kernel is 3.0.0.12 generic.
was (Author: tcheung):
OK - so what happened was I manually put in libjna 3.4.0 files (copied the tarball and redid the symlinks). The /etc/init.d script didn't work but the sudo /usr/sbin/cassandra did, and things seem to work a lot better.
They just moved my office and I have a new core i5 w/ 4 gb RAM. I just redid the cassandra install w/ vanilla 11.10 (libjna 3.2.7), openjre6, jsvc1.0.6.
There was a brief hiccup but its running. Top shows jsvc running cassandra consuming 35% memory as follows:
<code>
Cpu(s): 0.2%us, 0.2%sy, 0.0%ni, 99.6%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
Mem: 3934168k total, 3805184k used, 128984k free, 175792k buffers
Swap: 4071420k total, 26532k used, 4044888k free, 1083252k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
20452 root 20 0 166m 13m 8640 S 1 0.4 1:37.09 Xorg
21906 tylerc 20 0 453m 16m 10m S 1 0.4 0:02.43 xfce4-terminal
21337 tylerc 20 0 172m 12m 8704 S 0 0.3 0:10.59 xfwm4
21433 tylerc 20 0 698m 105m 38m S 0 2.7 2:59.83 chrome
23067 tylerc 20 0 864m 59m 16m S 0 1.6 0:01.94 chrome
23735 cassandr 20 0 1518m 1.3g 18m S 0 35.1 0:01.90 jsvc
...
</code>
I'm going to try and get the newer libjna again and see if this helps. Kernel is 3.0.0.12 generic.
> Cassandra uses 100% system CPU on Ubuntu Natty (11.04)
> ------------------------------------------------------
>
> Key: CASSANDRA-2845
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2845
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 0.8.0
> Environment: Default install of Ubuntu 11.04
> Reporter: Steve Corona
> Assignee: paul cannon
> Priority: Critical
> Fix For: 0.8.2
>
>
> Step 1. Boot up a brand new, default Ubuntu 11.04 Server install
> Step 2. Install Cassandra from Apache APT Respository (deb http://www.apache.org/dist/cassandra/debian 08x main)
> Step 3. apt-get install cassandra, as soon as it cassandra starts it will freeze the machine
> What's happening is that as soon as cassandra starts up it immediately sucks up 100% of CPU and starves the machine. This effectively bricks the box until you boot into single user mode and disable the cassandra init.d script.
> Under htop, the CPU usage shows up as "system" cpu, not user.
> The machine I'm testing this on is a Quad-Core Sandy Bridge w/ 16GB of Memory, so it's not a system resource issue. I've also tested this on completely different hardware (Dual 64-Bit Xeons & AMD X4) and it has the same effect.
> Ubuntu 10.10 does not exhibit the same issue. I have only tested 0.8 and 0.8.1.
> root@cassandra01:/# java -version
> java version "1.6.0_22"
> OpenJDK Runtime Environment (IcedTea6 1.10.2) (6b22-1.10.2-0ubuntu1~11.04.1)
> OpenJDK 64-Bit Server VM (build 20.0-b11, mixed mode)
> root@cassandra:/# uname -a
> Linux cassandra01 2.6.38-8-generic #42-Ubuntu SMP Mon Apr 11 03:31:24 UTC 2011 x86_64 x86_64 x86_64 GNU/Linux
> /proc/cpu
> Intel(R) Xeon(R) CPU E31270 @ 3.40GHz
> /proc/meminfo
> MemTotal: 16459776 kB
> MemFree: 14190708 kB
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-2845) Cassandra uses 100% system CPU
on Ubuntu Natty (11.04)
Posted by "tyler cheung (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13220631#comment-13220631 ]
tyler cheung commented on CASSANDRA-2845:
-----------------------------------------
hmm... when i start it w/ sudo /usr/sbin/cassandra, the memory usage is fine...
{{Tasks: 156 total, 1 running, 154 sleeping, 0 stopped, 1 zombie}}
{{Cpu(s): 0.3%us, 0.2%sy, 0.0%ni, 99.5%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st}}
{{Mem: 3934168k total, 2511668k used, 1422500k free, 176076k buffers}}
{{Swap: 4071420k total, 25572k used, 4045848k free, 1086980k cached}}
{{PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND}}
{{24815 root 20 0 1527m 69m 9.9m S 1 1.8 0:00.99 java}}
I am missing something?
> Cassandra uses 100% system CPU on Ubuntu Natty (11.04)
> ------------------------------------------------------
>
> Key: CASSANDRA-2845
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2845
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 0.8.0
> Environment: Default install of Ubuntu 11.04
> Reporter: Steve Corona
> Assignee: paul cannon
> Priority: Critical
> Fix For: 0.8.2
>
>
> Step 1. Boot up a brand new, default Ubuntu 11.04 Server install
> Step 2. Install Cassandra from Apache APT Respository (deb http://www.apache.org/dist/cassandra/debian 08x main)
> Step 3. apt-get install cassandra, as soon as it cassandra starts it will freeze the machine
> What's happening is that as soon as cassandra starts up it immediately sucks up 100% of CPU and starves the machine. This effectively bricks the box until you boot into single user mode and disable the cassandra init.d script.
> Under htop, the CPU usage shows up as "system" cpu, not user.
> The machine I'm testing this on is a Quad-Core Sandy Bridge w/ 16GB of Memory, so it's not a system resource issue. I've also tested this on completely different hardware (Dual 64-Bit Xeons & AMD X4) and it has the same effect.
> Ubuntu 10.10 does not exhibit the same issue. I have only tested 0.8 and 0.8.1.
> root@cassandra01:/# java -version
> java version "1.6.0_22"
> OpenJDK Runtime Environment (IcedTea6 1.10.2) (6b22-1.10.2-0ubuntu1~11.04.1)
> OpenJDK 64-Bit Server VM (build 20.0-b11, mixed mode)
> root@cassandra:/# uname -a
> Linux cassandra01 2.6.38-8-generic #42-Ubuntu SMP Mon Apr 11 03:31:24 UTC 2011 x86_64 x86_64 x86_64 GNU/Linux
> /proc/cpu
> Intel(R) Xeon(R) CPU E31270 @ 3.40GHz
> /proc/meminfo
> MemTotal: 16459776 kB
> MemFree: 14190708 kB
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Issue Comment Edited] (CASSANDRA-2845) Cassandra uses 100%
system CPU on Ubuntu Natty (11.04)
Posted by "tyler cheung (Issue Comment Edited) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13220627#comment-13220627 ]
tyler cheung edited comment on CASSANDRA-2845 at 3/2/12 2:46 AM:
-----------------------------------------------------------------
OK - so what happened was I manually put in libjna 3.4.0 files (copied the tarball and redid the symlinks). The /etc/init.d script didn't work but the sudo /usr/sbin/cassandra did, and things seem to work a lot better.
They just moved my office and I have a new core i5 w/ 4 gb RAM. I just redid the cassandra install w/ vanilla 11.10 (libjna 3.2.7), openjre6, jsvc1.0.6.
There was a brief hiccup but its running. Top shows jsvc running cassandra consuming 35% memory as follows:
{{Cpu(s): 0.2%us, 0.2%sy, 0.0%ni, 99.6%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st}}
{{Mem: 3934168k total, 3805184k used, 128984k free, 175792k buffers}}
{{Swap: 4071420k total, 26532k used, 4044888k free, 1083252k cached}}
{{ PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND}}
{{20452 root 20 0 166m 13m 8640 S 1 0.4 1:37.09 Xorg}}
{{21906 tylerc 20 0 453m 16m 10m S 1 0.4 0:02.43 xfce4-terminal}}
{{21337 tylerc 20 0 172m 12m 8704 S 0 0.3 0:10.59 xfwm4}}
{{21433 tylerc 20 0 698m 105m 38m S 0 2.7 2:59.83 chrome}}
{{23067 tylerc 20 0 864m 59m 16m S 0 1.6 0:01.94 chrome}}
{{23735 cassandr 20 0 1518m 1.3g 18m S 0 35.1 0:01.90 jsvc}}
{{...}}
I'm going to try and get the newer libjna again and see if this helps memory usage. Kernel is 3.0.0.12 generic.
was (Author: tcheung):
OK - so what happened was I manually put in libjna 3.4.0 files (copied the tarball and redid the symlinks). The /etc/init.d script didn't work but the sudo /usr/sbin/cassandra did, and things seem to work a lot better.
They just moved my office and I have a new core i5 w/ 4 gb RAM. I just redid the cassandra install w/ vanilla 11.10 (libjna 3.2.7), openjre6, jsvc1.0.6.
There was a brief hiccup but its running. Top shows jsvc running cassandra consuming 35% memory as follows:
{{Cpu(s): 0.2%us, 0.2%sy, 0.0%ni, 99.6%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st}}
{{Mem: 3934168k total, 3805184k used, 128984k free, 175792k buffers}}
{{Swap: 4071420k total, 26532k used, 4044888k free, 1083252k cached}}
{{ PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND }}
{{20452 root 20 0 166m 13m 8640 S 1 0.4 1:37.09 Xorg}}
{{21906 tylerc 20 0 453m 16m 10m S 1 0.4 0:02.43 xfce4-terminal }}
{{21337 tylerc 20 0 172m 12m 8704 S 0 0.3 0:10.59 xfwm4 }}
{{21433 tylerc 20 0 698m 105m 38m S 0 2.7 2:59.83 chrome }}
{{23067 tylerc 20 0 864m 59m 16m S 0 1.6 0:01.94 chrome }}
{{23735 cassandr 20 0 1518m 1.3g 18m S 0 35.1 0:01.90 jsvc }}
{{...}}
I'm going to try and get the newer libjna again and see if this helps memory usage. Kernel is 3.0.0.12 generic.
> Cassandra uses 100% system CPU on Ubuntu Natty (11.04)
> ------------------------------------------------------
>
> Key: CASSANDRA-2845
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2845
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 0.8.0
> Environment: Default install of Ubuntu 11.04
> Reporter: Steve Corona
> Assignee: paul cannon
> Priority: Critical
> Fix For: 0.8.2
>
>
> Step 1. Boot up a brand new, default Ubuntu 11.04 Server install
> Step 2. Install Cassandra from Apache APT Respository (deb http://www.apache.org/dist/cassandra/debian 08x main)
> Step 3. apt-get install cassandra, as soon as it cassandra starts it will freeze the machine
> What's happening is that as soon as cassandra starts up it immediately sucks up 100% of CPU and starves the machine. This effectively bricks the box until you boot into single user mode and disable the cassandra init.d script.
> Under htop, the CPU usage shows up as "system" cpu, not user.
> The machine I'm testing this on is a Quad-Core Sandy Bridge w/ 16GB of Memory, so it's not a system resource issue. I've also tested this on completely different hardware (Dual 64-Bit Xeons & AMD X4) and it has the same effect.
> Ubuntu 10.10 does not exhibit the same issue. I have only tested 0.8 and 0.8.1.
> root@cassandra01:/# java -version
> java version "1.6.0_22"
> OpenJDK Runtime Environment (IcedTea6 1.10.2) (6b22-1.10.2-0ubuntu1~11.04.1)
> OpenJDK 64-Bit Server VM (build 20.0-b11, mixed mode)
> root@cassandra:/# uname -a
> Linux cassandra01 2.6.38-8-generic #42-Ubuntu SMP Mon Apr 11 03:31:24 UTC 2011 x86_64 x86_64 x86_64 GNU/Linux
> /proc/cpu
> Intel(R) Xeon(R) CPU E31270 @ 3.40GHz
> /proc/meminfo
> MemTotal: 16459776 kB
> MemFree: 14190708 kB
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-2845) Cassandra uses 100% system CPU
on Ubuntu Natty (11.04)
Posted by "tyler cheung (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13220627#comment-13220627 ]
tyler cheung commented on CASSANDRA-2845:
-----------------------------------------
OK - so what happened was I manually put in libjna 3.4.0 files (copied the tarball and redid the symlinks). The /etc/init.d script didn't work but the sudo /usr/sbin/cassandra did, and things seem to work a lot better.
They just moved my office and I have a new core i5 w/ 4 gb RAM. I just redid the cassandra install w/ vanilla 11.10 (libjna 3.2.7), openjre6, jsvc1.0.6.
There was a brief hiccup but its running. Top shows jsvc running cassandra consuming 35% memory as follows:
<code>
Cpu(s): 0.2%us, 0.2%sy, 0.0%ni, 99.6%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
Mem: 3934168k total, 3805184k used, 128984k free, 175792k buffers
Swap: 4071420k total, 26532k used, 4044888k free, 1083252k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
20452 root 20 0 166m 13m 8640 S 1 0.4 1:37.09 Xorg
21906 tylerc 20 0 453m 16m 10m S 1 0.4 0:02.43 xfce4-terminal
21337 tylerc 20 0 172m 12m 8704 S 0 0.3 0:10.59 xfwm4
21433 tylerc 20 0 698m 105m 38m S 0 2.7 2:59.83 chrome
23067 tylerc 20 0 864m 59m 16m S 0 1.6 0:01.94 chrome
23735 cassandr 20 0 1518m 1.3g 18m S 0 35.1 0:01.90 jsvc
...
</code>
I'm going to try and get the newer libjna again and see if this helps. Kernel is 3.0.0.12 generic.
> Cassandra uses 100% system CPU on Ubuntu Natty (11.04)
> ------------------------------------------------------
>
> Key: CASSANDRA-2845
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2845
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 0.8.0
> Environment: Default install of Ubuntu 11.04
> Reporter: Steve Corona
> Assignee: paul cannon
> Priority: Critical
> Fix For: 0.8.2
>
>
> Step 1. Boot up a brand new, default Ubuntu 11.04 Server install
> Step 2. Install Cassandra from Apache APT Respository (deb http://www.apache.org/dist/cassandra/debian 08x main)
> Step 3. apt-get install cassandra, as soon as it cassandra starts it will freeze the machine
> What's happening is that as soon as cassandra starts up it immediately sucks up 100% of CPU and starves the machine. This effectively bricks the box until you boot into single user mode and disable the cassandra init.d script.
> Under htop, the CPU usage shows up as "system" cpu, not user.
> The machine I'm testing this on is a Quad-Core Sandy Bridge w/ 16GB of Memory, so it's not a system resource issue. I've also tested this on completely different hardware (Dual 64-Bit Xeons & AMD X4) and it has the same effect.
> Ubuntu 10.10 does not exhibit the same issue. I have only tested 0.8 and 0.8.1.
> root@cassandra01:/# java -version
> java version "1.6.0_22"
> OpenJDK Runtime Environment (IcedTea6 1.10.2) (6b22-1.10.2-0ubuntu1~11.04.1)
> OpenJDK 64-Bit Server VM (build 20.0-b11, mixed mode)
> root@cassandra:/# uname -a
> Linux cassandra01 2.6.38-8-generic #42-Ubuntu SMP Mon Apr 11 03:31:24 UTC 2011 x86_64 x86_64 x86_64 GNU/Linux
> /proc/cpu
> Intel(R) Xeon(R) CPU E31270 @ 3.40GHz
> /proc/meminfo
> MemTotal: 16459776 kB
> MemFree: 14190708 kB
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Issue Comment Edited] (CASSANDRA-2845) Cassandra uses 100%
system CPU on Ubuntu Natty (11.04)
Posted by "tyler cheung (Issue Comment Edited) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13220627#comment-13220627 ]
tyler cheung edited comment on CASSANDRA-2845 at 3/2/12 2:46 AM:
-----------------------------------------------------------------
OK - so what happened was I manually put in libjna 3.4.0 files (copied the tarball and redid the symlinks). The /etc/init.d script didn't work but the sudo /usr/sbin/cassandra did, and things seem to work a lot better.
They just moved my office and I have a new core i5 w/ 4 gb RAM. I just redid the cassandra install w/ vanilla 11.10 (libjna 3.2.7), openjre6, jsvc1.0.6.
There was a brief hiccup but its running. Top shows jsvc running cassandra consuming 35% memory as follows:
{{Cpu(s): 0.2%us, 0.2%sy, 0.0%ni, 99.6%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st}}
{{Mem: 3934168k total, 3805184k used, 128984k free, 175792k buffers}}
{{Swap: 4071420k total, 26532k used, 4044888k free, 1083252k cached}}
{{ PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND }}
{{20452 root 20 0 166m 13m 8640 S 1 0.4 1:37.09 Xorg}}
{{21906 tylerc 20 0 453m 16m 10m S 1 0.4 0:02.43 xfce4-terminal }}
{{21337 tylerc 20 0 172m 12m 8704 S 0 0.3 0:10.59 xfwm4 }}
{{21433 tylerc 20 0 698m 105m 38m S 0 2.7 2:59.83 chrome }}
{{23067 tylerc 20 0 864m 59m 16m S 0 1.6 0:01.94 chrome }}
{{23735 cassandr 20 0 1518m 1.3g 18m S 0 35.1 0:01.90 jsvc }}
{{...}}
I'm going to try and get the newer libjna again and see if this helps memory usage. Kernel is 3.0.0.12 generic.
was (Author: tcheung):
OK - so what happened was I manually put in libjna 3.4.0 files (copied the tarball and redid the symlinks). The /etc/init.d script didn't work but the sudo /usr/sbin/cassandra did, and things seem to work a lot better.
They just moved my office and I have a new core i5 w/ 4 gb RAM. I just redid the cassandra install w/ vanilla 11.10 (libjna 3.2.7), openjre6, jsvc1.0.6.
There was a brief hiccup but its running. Top shows jsvc running cassandra consuming 35% memory as follows:
{{Cpu(s): 0.2%us, 0.2%sy, 0.0%ni, 99.6%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st}}
{{Mem: 3934168k total, 3805184k used, 128984k free, 175792k buffers}}
{{Swap: 4071420k total, 26532k used, 4044888k free, 1083252k cached}}
{{ PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND }}
{{20452 root 20 0 166m 13m 8640 S 1 0.4 1:37.09 Xorg }}
{{21906 tylerc 20 0 453m 16m 10m S 1 0.4 0:02.43 xfce4-terminal }}
{{21337 tylerc 20 0 172m 12m 8704 S 0 0.3 0:10.59 xfwm4 }}
{{21433 tylerc 20 0 698m 105m 38m S 0 2.7 2:59.83 chrome }}
{{23067 tylerc 20 0 864m 59m 16m S 0 1.6 0:01.94 chrome }}
{{23735 cassandr 20 0 1518m 1.3g 18m S 0 35.1 0:01.90 jsvc }}
{{...}}
I'm going to try and get the newer libjna again and see if this helps memory usage. Kernel is 3.0.0.12 generic.
> Cassandra uses 100% system CPU on Ubuntu Natty (11.04)
> ------------------------------------------------------
>
> Key: CASSANDRA-2845
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2845
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 0.8.0
> Environment: Default install of Ubuntu 11.04
> Reporter: Steve Corona
> Assignee: paul cannon
> Priority: Critical
> Fix For: 0.8.2
>
>
> Step 1. Boot up a brand new, default Ubuntu 11.04 Server install
> Step 2. Install Cassandra from Apache APT Respository (deb http://www.apache.org/dist/cassandra/debian 08x main)
> Step 3. apt-get install cassandra, as soon as it cassandra starts it will freeze the machine
> What's happening is that as soon as cassandra starts up it immediately sucks up 100% of CPU and starves the machine. This effectively bricks the box until you boot into single user mode and disable the cassandra init.d script.
> Under htop, the CPU usage shows up as "system" cpu, not user.
> The machine I'm testing this on is a Quad-Core Sandy Bridge w/ 16GB of Memory, so it's not a system resource issue. I've also tested this on completely different hardware (Dual 64-Bit Xeons & AMD X4) and it has the same effect.
> Ubuntu 10.10 does not exhibit the same issue. I have only tested 0.8 and 0.8.1.
> root@cassandra01:/# java -version
> java version "1.6.0_22"
> OpenJDK Runtime Environment (IcedTea6 1.10.2) (6b22-1.10.2-0ubuntu1~11.04.1)
> OpenJDK 64-Bit Server VM (build 20.0-b11, mixed mode)
> root@cassandra:/# uname -a
> Linux cassandra01 2.6.38-8-generic #42-Ubuntu SMP Mon Apr 11 03:31:24 UTC 2011 x86_64 x86_64 x86_64 GNU/Linux
> /proc/cpu
> Intel(R) Xeon(R) CPU E31270 @ 3.40GHz
> /proc/meminfo
> MemTotal: 16459776 kB
> MemFree: 14190708 kB
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira