You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Zenek Kraweznik (Created) (JIRA)" <ji...@apache.org> on 2012/01/04 13:53:38 UTC
[jira] [Created] (CASSANDRA-3693) stranger values of pending tasts
with compactionstats (below 0)
stranger values of pending tasts with compactionstats (below 0)
---------------------------------------------------------------
Key: CASSANDRA-3693
URL: https://issues.apache.org/jira/browse/CASSANDRA-3693
Project: Cassandra
Issue Type: Bug
Components: Core, Tools
Affects Versions: 1.0.6
Environment: linux, oracle java 1.6.26
Reporter: Zenek Kraweznik
Priority: Minor
Every 2.0s: for i in 1 2 3; do nodetool -h 192.168.2.$i compactionstats; done Wed Jan 4 13:48:13 2012
pending tasks: 2147483646
compaction type keyspace column family bytes compacted bytes total progress
Compaction Archive Messages 28034971475 72393139120 38.73%
pending tasks: -2147483647
compaction type keyspace column family bytes compacted bytes total progress
Compaction Archive Messages 24575687282 72385305067 33.95%
pending tasks: 0
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3693) strange values of pending tasts
with compactionstats (below 0)
Posted by "Zenek Kraweznik (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zenek Kraweznik updated CASSANDRA-3693:
---------------------------------------
Summary: strange values of pending tasts with compactionstats (below 0) (was: stranger values of pending tasts with compactionstats (below 0))
> strange values of pending tasts with compactionstats (below 0)
> --------------------------------------------------------------
>
> Key: CASSANDRA-3693
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3693
> Project: Cassandra
> Issue Type: Bug
> Components: Core, Tools
> Affects Versions: 1.0.6
> Environment: linux, oracle java 1.6.26
> Reporter: Zenek Kraweznik
> Priority: Minor
>
> Every 2.0s: for i in 1 2 3; do nodetool -h 192.168.2.$i compactionstats; done Wed Jan 4 13:48:13 2012
> pending tasks: 2147483646
> compaction type keyspace column family bytes compacted bytes total progress
> Compaction Archive Messages 28034971475 72393139120 38.73%
> pending tasks: -2147483647
> compaction type keyspace column family bytes compacted bytes total progress
> Compaction Archive Messages 24575687282 72385305067 33.95%
> pending tasks: 0
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3693) strange values of pending tasks
with compactionstats (below 0)
Posted by "Zenek Kraweznik (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13180255#comment-13180255 ]
Zenek Kraweznik commented on CASSANDRA-3693:
--------------------------------------------
Also my cassandra is doing compactions on two nodes in loop. restart of cassandra service doesn't fix this. After restart compaction is also started.
> strange values of pending tasks with compactionstats (below 0)
> --------------------------------------------------------------
>
> Key: CASSANDRA-3693
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3693
> Project: Cassandra
> Issue Type: Bug
> Components: Core, Tools
> Affects Versions: 1.0.6
> Environment: linux, oracle java 1.6.26
> Reporter: Zenek Kraweznik
> Priority: Minor
>
> during scrub:
> Every 2.0s: for i in 1 2 3; do nodetool -h 192.168.2.$i compactionstats; done Wed Jan 4 13:48:13 2012
> pending tasks: 2147483646
> compaction type keyspace column family bytes compacted bytes total progress
> Compaction Archive Messages 28034971475 72393139120 38.73%
> pending tasks: -2147483647
> compaction type keyspace column family bytes compacted bytes total progress
> Compaction Archive Messages 24575687282 72385305067 33.95%
> pending tasks: 0
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3693) strange values of pending tasks
with compactionstats (below 0)
Posted by "Zenek Kraweznik (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zenek Kraweznik updated CASSANDRA-3693:
---------------------------------------
Description:
during scrub:
Every 2.0s: for i in 1 2 3; do nodetool -h 192.168.2.$i compactionstats; done Wed Jan 4 13:48:13 2012
pending tasks: 2147483646
compaction type keyspace column family bytes compacted bytes total progress
Compaction Archive Messages 28034971475 72393139120 38.73%
pending tasks: -2147483647
compaction type keyspace column family bytes compacted bytes total progress
Compaction Archive Messages 24575687282 72385305067 33.95%
pending tasks: 0
was:
Every 2.0s: for i in 1 2 3; do nodetool -h 192.168.2.$i compactionstats; done Wed Jan 4 13:48:13 2012
pending tasks: 2147483646
compaction type keyspace column family bytes compacted bytes total progress
Compaction Archive Messages 28034971475 72393139120 38.73%
pending tasks: -2147483647
compaction type keyspace column family bytes compacted bytes total progress
Compaction Archive Messages 24575687282 72385305067 33.95%
pending tasks: 0
Summary: strange values of pending tasks with compactionstats (below 0) (was: strange values of pending tasts with compactionstats (below 0))
> strange values of pending tasks with compactionstats (below 0)
> --------------------------------------------------------------
>
> Key: CASSANDRA-3693
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3693
> Project: Cassandra
> Issue Type: Bug
> Components: Core, Tools
> Affects Versions: 1.0.6
> Environment: linux, oracle java 1.6.26
> Reporter: Zenek Kraweznik
> Priority: Minor
>
> during scrub:
> Every 2.0s: for i in 1 2 3; do nodetool -h 192.168.2.$i compactionstats; done Wed Jan 4 13:48:13 2012
> pending tasks: 2147483646
> compaction type keyspace column family bytes compacted bytes total progress
> Compaction Archive Messages 28034971475 72393139120 38.73%
> pending tasks: -2147483647
> compaction type keyspace column family bytes compacted bytes total progress
> Compaction Archive Messages 24575687282 72385305067 33.95%
> pending tasks: 0
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3693) strange values of pending tasks
with compactionstats (below 0)
Posted by "Jonathan Ellis (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Ellis updated CASSANDRA-3693:
--------------------------------------
Attachment: 3693.txt
Patch to keep compaction task count arithmetic as a long until after the division by sstable size has been done.
> strange values of pending tasks with compactionstats (below 0)
> --------------------------------------------------------------
>
> Key: CASSANDRA-3693
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3693
> Project: Cassandra
> Issue Type: Bug
> Components: Core, Tools
> Affects Versions: 1.0.0
> Environment: linux, oracle java 1.6.26
> Reporter: Zenek Kraweznik
> Priority: Minor
> Labels: compaction
> Fix For: 1.0.7
>
> Attachments: 3693.txt
>
>
> during scrub:
> Every 2.0s: for i in 1 2 3; do nodetool -h 192.168.2.$i compactionstats; done Wed Jan 4 13:48:13 2012
> pending tasks: 2147483646
> compaction type keyspace column family bytes compacted bytes total progress
> Compaction Archive Messages 28034971475 72393139120 38.73%
> pending tasks: -2147483647
> compaction type keyspace column family bytes compacted bytes total progress
> Compaction Archive Messages 24575687282 72385305067 33.95%
> pending tasks: 0
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3693) strange values of pending tasks
with compactionstats (below 0)
Posted by "Jonathan Ellis (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13180930#comment-13180930 ]
Jonathan Ellis commented on CASSANDRA-3693:
-------------------------------------------
Are you using LeveledCompaction?
How much data do you have on disk? How many sstables?
> strange values of pending tasks with compactionstats (below 0)
> --------------------------------------------------------------
>
> Key: CASSANDRA-3693
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3693
> Project: Cassandra
> Issue Type: Bug
> Components: Core, Tools
> Affects Versions: 1.0.6
> Environment: linux, oracle java 1.6.26
> Reporter: Zenek Kraweznik
> Priority: Minor
>
> during scrub:
> Every 2.0s: for i in 1 2 3; do nodetool -h 192.168.2.$i compactionstats; done Wed Jan 4 13:48:13 2012
> pending tasks: 2147483646
> compaction type keyspace column family bytes compacted bytes total progress
> Compaction Archive Messages 28034971475 72393139120 38.73%
> pending tasks: -2147483647
> compaction type keyspace column family bytes compacted bytes total progress
> Compaction Archive Messages 24575687282 72385305067 33.95%
> pending tasks: 0
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3693) strange values of pending tasks
with compactionstats (below 0)
Posted by "Zenek Kraweznik (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13182293#comment-13182293 ]
Zenek Kraweznik commented on CASSANDRA-3693:
--------------------------------------------
I'm using leveled compaction (with 4096mb limit, but with compression sstables are smaller).
There's a 80GB per node (3 nodes, replication factor=3).
# find /var/lib/cassandra/data -type f | wc -l
273
#
=> 273 sstables
compactionstats looks now like this:
pending tasks: -2147483648
compaction type keyspace column family bytes compacted bytes total progress
Compaction Archive Messages 35050352366 0 n/a
I wonder why 0 bytes total is visible on this node (nodetool ring is reporting 37.18GB).
> strange values of pending tasks with compactionstats (below 0)
> --------------------------------------------------------------
>
> Key: CASSANDRA-3693
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3693
> Project: Cassandra
> Issue Type: Bug
> Components: Core, Tools
> Affects Versions: 1.0.6
> Environment: linux, oracle java 1.6.26
> Reporter: Zenek Kraweznik
> Priority: Minor
>
> during scrub:
> Every 2.0s: for i in 1 2 3; do nodetool -h 192.168.2.$i compactionstats; done Wed Jan 4 13:48:13 2012
> pending tasks: 2147483646
> compaction type keyspace column family bytes compacted bytes total progress
> Compaction Archive Messages 28034971475 72393139120 38.73%
> pending tasks: -2147483647
> compaction type keyspace column family bytes compacted bytes total progress
> Compaction Archive Messages 24575687282 72385305067 33.95%
> pending tasks: 0
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3693) strange values of pending tasks
with compactionstats (below 0)
Posted by "Zenek Kraweznik (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13183983#comment-13183983 ]
Zenek Kraweznik commented on CASSANDRA-3693:
--------------------------------------------
ok, thanks. I'll chech it after ugprade to 1.0.7
And second question from my last comment: "I wonder why 0 bytes total is visible on this node during compaction (nodetool ring is reporting 37.18GB)."
> strange values of pending tasks with compactionstats (below 0)
> --------------------------------------------------------------
>
> Key: CASSANDRA-3693
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3693
> Project: Cassandra
> Issue Type: Bug
> Components: Core, Tools
> Affects Versions: 1.0.0
> Environment: linux, oracle java 1.6.26
> Reporter: Zenek Kraweznik
> Assignee: Jonathan Ellis
> Priority: Minor
> Labels: compaction
> Fix For: 1.0.7
>
> Attachments: 3693.txt
>
>
> during scrub:
> Every 2.0s: for i in 1 2 3; do nodetool -h 192.168.2.$i compactionstats; done Wed Jan 4 13:48:13 2012
> pending tasks: 2147483646
> compaction type keyspace column family bytes compacted bytes total progress
> Compaction Archive Messages 28034971475 72393139120 38.73%
> pending tasks: -2147483647
> compaction type keyspace column family bytes compacted bytes total progress
> Compaction Archive Messages 24575687282 72385305067 33.95%
> pending tasks: 0
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Issue Comment Edited] (CASSANDRA-3693) strange values of
pending tasks with compactionstats (below 0)
Posted by "Zenek Kraweznik (Issue Comment Edited) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13182293#comment-13182293 ]
Zenek Kraweznik edited comment on CASSANDRA-3693 at 1/9/12 9:02 PM:
--------------------------------------------------------------------
I'm using leveled compaction (with 4096mb limit, but with compression sstables are smaller).
There's a 80GB per node (3 nodes, replication factor=3).
# find /var/lib/cassandra/data -type f | wc -l
273
#
=> 273 sstables
compactionstats looks now like this:
pending tasks: -2147483648
compaction type keyspace column family bytes compacted bytes total progress
Compaction Archive Messages 35050352366 0 n/a
I wonder why 0 bytes total is visible on this node (nodetool ring is reporting 37.18GB).
After every compactions bytes total is about 73xxxxxxxxx (i guess it is not compress data size), but this value isn't saved anywhere.
was (Author: zenek_kraweznik0):
I'm using leveled compaction (with 4096mb limit, but with compression sstables are smaller).
There's a 80GB per node (3 nodes, replication factor=3).
# find /var/lib/cassandra/data -type f | wc -l
273
#
=> 273 sstables
compactionstats looks now like this:
pending tasks: -2147483648
compaction type keyspace column family bytes compacted bytes total progress
Compaction Archive Messages 35050352366 0 n/a
I wonder why 0 bytes total is visible on this node (nodetool ring is reporting 37.18GB).
> strange values of pending tasks with compactionstats (below 0)
> --------------------------------------------------------------
>
> Key: CASSANDRA-3693
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3693
> Project: Cassandra
> Issue Type: Bug
> Components: Core, Tools
> Affects Versions: 1.0.6
> Environment: linux, oracle java 1.6.26
> Reporter: Zenek Kraweznik
> Priority: Minor
>
> during scrub:
> Every 2.0s: for i in 1 2 3; do nodetool -h 192.168.2.$i compactionstats; done Wed Jan 4 13:48:13 2012
> pending tasks: 2147483646
> compaction type keyspace column family bytes compacted bytes total progress
> Compaction Archive Messages 28034971475 72393139120 38.73%
> pending tasks: -2147483647
> compaction type keyspace column family bytes compacted bytes total progress
> Compaction Archive Messages 24575687282 72385305067 33.95%
> pending tasks: 0
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira