You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Michael Shuler (JIRA)" <ji...@apache.org> on 2014/07/30 20:18:38 UTC
[jira] [Updated] (CASSANDRA-7419) Compactions not utilizing full
compactionthroughput
[ https://issues.apache.org/jira/browse/CASSANDRA-7419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Michael Shuler updated CASSANDRA-7419:
--------------------------------------
Reproduced In: 2.0.8
Fix Version/s: (was: 2.0.8)
This sounds to me like a system/cluster tuning comment than a concrete improvement suggestion. Without detailed knowledge of the environment hardware, configurations, and specific workload, it would be hard to guess at how you might eek out more resource utilization from your systems. You are looking for Cassandra to work harder? Honestly, my first thought is, "your system is running great - you could throw more data/clients at it."
Closing as not a problem and suggesting this conversation might be best suited for the cassandra user mailing list. Bottom of the page: http://cassandra.apache.org/
> Compactions not utilizing full compactionthroughput
> ---------------------------------------------------
>
> Key: CASSANDRA-7419
> URL: https://issues.apache.org/jira/browse/CASSANDRA-7419
> Project: Cassandra
> Issue Type: Improvement
> Environment: Ubuntu 12.04, kernel 3.13
> Reporter: Matt Robenolt
> Priority: Minor
>
> compactionthroughput has been set to 128MB/s, but we never see utilization that high during compactions. Also while compacting does not seem to utilize a single core of CPU either. So not sure what the limitation actually is, but would expect to get all 128MB/s (or close to it).
> Here is a sample of mpstat during a series of compactions after a nodetool cleanup:
> {code}
> $ sudo mpstat -P ALL 1
> Linux 3.13.0-24-generic (cass-activity-4.disqus.net) 06/19/2014 _x86_64_ (24 CPU)
> 04:55:10 PM CPU %usr %nice %sys %iowait %irq %soft %steal %guest %idle
> 04:55:11 PM all 1.42 7.36 3.43 0.04 0.33 0.00 0.00 0.00 87.41
> 04:55:11 PM 0 3.06 13.27 6.12 0.00 3.06 0.00 0.00 0.00 74.49
> 04:55:11 PM 1 2.00 23.00 6.00 0.00 0.00 0.00 0.00 0.00 69.00
> 04:55:11 PM 2 2.02 18.18 8.08 0.00 0.00 0.00 0.00 0.00 71.72
> 04:55:11 PM 3 1.98 15.84 4.95 0.00 0.99 0.00 0.00 0.00 76.24
> 04:55:11 PM 4 2.00 9.00 3.00 0.00 0.00 0.00 0.00 0.00 86.00
> 04:55:11 PM 5 1.02 22.45 10.20 0.00 0.00 0.00 0.00 0.00 66.33
> 04:55:11 PM 6 1.98 8.91 5.94 0.00 0.00 0.00 0.00 0.00 83.17
> 04:55:11 PM 7 1.00 8.00 3.00 0.00 1.00 0.00 0.00 0.00 87.00
> 04:55:11 PM 8 3.96 12.87 7.92 0.00 0.00 0.00 0.00 0.00 75.25
> 04:55:11 PM 9 2.02 5.05 2.02 0.00 0.00 0.00 0.00 0.00 90.91
> 04:55:11 PM 10 1.01 14.14 6.06 0.00 0.00 0.00 0.00 0.00 78.79
> 04:55:11 PM 11 2.00 2.00 2.00 1.00 0.00 0.00 0.00 0.00 93.00
> 04:55:11 PM 12 0.00 3.00 1.00 0.00 0.00 0.00 0.00 0.00 96.00
> 04:55:11 PM 13 2.00 0.00 2.00 0.00 1.00 0.00 0.00 0.00 95.00
> 04:55:11 PM 14 1.01 1.01 1.01 0.00 0.00 0.00 0.00 0.00 96.97
> 04:55:11 PM 15 3.03 4.04 2.02 0.00 1.01 0.00 0.00 0.00 89.90
> 04:55:11 PM 16 2.00 2.00 3.00 0.00 1.00 0.00 0.00 0.00 92.00
> 04:55:11 PM 17 1.00 2.00 0.00 0.00 0.00 0.00 0.00 0.00 97.00
> 04:55:11 PM 18 1.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 99.00
> 04:55:11 PM 19 1.00 6.00 5.00 0.00 1.00 0.00 0.00 0.00 87.00
> 04:55:11 PM 20 0.00 1.01 0.00 0.00 0.00 0.00 0.00 0.00 98.99
> 04:55:11 PM 21 0.00 1.01 1.01 0.00 0.00 0.00 0.00 0.00 97.98
> 04:55:11 PM 22 0.00 2.00 1.00 0.00 0.00 0.00 0.00 0.00 97.00
> 04:55:11 PM 23 0.00 1.00 1.00 0.00 0.00 0.00 0.00 0.00 98.00
> 04:55:11 PM CPU %usr %nice %sys %iowait %irq %soft %steal %guest %idle
> 04:55:12 PM all 0.88 7.44 3.01 0.00 0.17 0.00 0.00 0.00 88.50
> 04:55:12 PM 0 4.04 5.05 3.03 0.00 2.02 0.00 0.00 0.00 85.86
> 04:55:12 PM 1 0.99 12.87 5.94 0.00 0.99 0.00 0.00 0.00 79.21
> 04:55:12 PM 2 0.00 15.15 4.04 0.00 0.00 0.00 0.00 0.00 80.81
> 04:55:12 PM 3 0.00 17.17 8.08 0.00 0.00 0.00 0.00 0.00 74.75
> 04:55:12 PM 4 1.01 8.08 2.02 0.00 0.00 0.00 0.00 0.00 88.89
> 04:55:12 PM 5 1.00 20.00 3.00 0.00 0.00 0.00 0.00 0.00 76.00
> 04:55:12 PM 6 1.00 6.00 1.00 0.00 0.00 0.00 0.00 0.00 92.00
> 04:55:12 PM 7 1.01 10.10 2.02 0.00 0.00 0.00 0.00 0.00 86.87
> 04:55:12 PM 8 2.00 28.00 17.00 0.00 0.00 0.00 0.00 0.00 53.00
> 04:55:12 PM 9 1.00 18.00 9.00 1.00 0.00 0.00 0.00 0.00 71.00
> 04:55:12 PM 10 1.00 12.00 5.00 0.00 0.00 0.00 0.00 0.00 82.00
> 04:55:12 PM 11 1.00 3.00 1.00 0.00 0.00 0.00 0.00 0.00 95.00
> 04:55:12 PM 12 0.00 1.02 0.00 0.00 0.00 0.00 0.00 0.00 98.98
> 04:55:12 PM 13 1.00 1.00 2.00 0.00 1.00 0.00 0.00 0.00 95.00
> 04:55:12 PM 14 1.00 5.00 2.00 0.00 1.00 0.00 0.00 0.00 91.00
> 04:55:12 PM 15 0.99 2.97 0.99 0.00 0.99 0.00 0.00 0.00 94.06
> 04:55:12 PM 16 0.00 1.01 1.01 0.00 0.00 0.00 0.00 0.00 97.98
> 04:55:12 PM 17 0.00 3.00 1.00 0.00 0.00 0.00 0.00 0.00 96.00
> 04:55:12 PM 18 0.00 1.00 1.00 0.00 0.00 0.00 0.00 0.00 98.00
> 04:55:12 PM 19 2.00 0.00 2.00 0.00 0.00 0.00 0.00 0.00 96.00
> 04:55:12 PM 20 0.00 2.97 0.99 0.00 0.00 0.00 0.00 0.00 96.04
> 04:55:12 PM 21 0.00 3.03 0.00 0.00 0.00 0.00 0.00 0.00 96.97
> 04:55:12 PM 22 0.00 1.01 0.00 0.00 0.00 0.00 0.00 0.00 98.99
> 04:55:12 PM 23 0.00 1.01 0.00 0.00 0.00 0.00 0.00 0.00 98.99
> 04:55:12 PM CPU %usr %nice %sys %iowait %irq %soft %steal %guest %idle
> 04:55:13 PM all 1.84 7.23 3.01 0.04 0.25 0.00 0.00 0.00 87.64
> 04:55:13 PM 0 3.03 6.06 3.03 0.00 2.02 0.00 0.00 0.00 85.86
> 04:55:13 PM 1 3.03 5.05 2.02 0.00 0.00 0.00 0.00 0.00 89.90
> 04:55:13 PM 2 2.97 15.84 4.95 0.00 0.00 0.00 0.00 0.00 76.24
> 04:55:13 PM 3 2.00 22.00 5.00 0.00 0.00 0.00 0.00 0.00 71.00
> 04:55:13 PM 4 2.02 23.23 11.11 0.00 0.00 0.00 0.00 0.00 63.64
> 04:55:13 PM 5 1.98 17.82 3.96 0.99 0.99 0.00 0.00 0.00 74.26
> 04:55:13 PM 6 2.02 10.10 5.05 0.00 0.00 0.00 0.00 0.00 82.83
> 04:55:13 PM 7 2.97 2.97 0.99 0.00 0.00 0.00 0.00 0.00 93.07
> 04:55:13 PM 8 1.02 6.12 0.00 0.00 0.00 0.00 0.00 0.00 92.86
> 04:55:13 PM 9 1.00 4.00 2.00 0.00 0.00 0.00 0.00 0.00 93.00
> 04:55:13 PM 10 3.00 3.00 2.00 0.00 0.00 0.00 0.00 0.00 92.00
> 04:55:13 PM 11 1.01 4.04 2.02 0.00 0.00 0.00 0.00 0.00 92.93
> 04:55:13 PM 12 0.00 1.96 0.98 0.00 0.00 0.00 0.00 0.00 97.06
> 04:55:13 PM 13 1.01 0.00 1.01 0.00 0.00 0.00 0.00 0.00 97.98
> 04:55:13 PM 14 2.00 1.00 1.00 0.00 0.00 0.00 0.00 0.00 96.00
> 04:55:13 PM 15 0.00 0.00 1.02 0.00 0.00 0.00 0.00 0.00 98.98
> 04:55:13 PM 16 3.00 0.00 1.00 0.00 1.00 0.00 0.00 0.00 95.00
> 04:55:13 PM 17 1.00 0.00 1.00 0.00 0.00 0.00 0.00 0.00 98.00
> 04:55:13 PM 18 1.00 1.00 0.00 0.00 0.00 0.00 0.00 0.00 98.00
> 04:55:13 PM 19 2.00 1.00 1.00 0.00 1.00 0.00 0.00 0.00 95.00
> 04:55:13 PM 20 1.01 46.46 21.21 0.00 0.00 0.00 0.00 0.00 31.31
> 04:55:13 PM 21 2.00 1.00 1.00 0.00 0.00 0.00 0.00 0.00 96.00
> 04:55:13 PM 22 1.00 1.00 1.00 0.00 0.00 0.00 0.00 0.00 97.00
> 04:55:13 PM 23 2.00 1.00 1.00 0.00 0.00 0.00 0.00 0.00 96.00
> 04:55:13 PM CPU %usr %nice %sys %iowait %irq %soft %steal %guest %idle
> 04:55:14 PM all 0.75 7.45 3.22 0.04 0.21 0.00 0.00 0.00 88.33
> 04:55:14 PM 0 3.00 5.00 3.00 0.00 3.00 0.00 0.00 0.00 86.00
> 04:55:14 PM 1 1.01 13.13 5.05 0.00 0.00 0.00 0.00 0.00 80.81
> 04:55:14 PM 2 1.01 25.25 14.14 0.00 0.00 0.00 0.00 0.00 59.60
> 04:55:14 PM 3 2.02 13.13 3.03 0.00 0.00 0.00 0.00 0.00 81.82
> 04:55:14 PM 4 2.00 11.00 2.00 0.00 0.00 0.00 0.00 0.00 85.00
> 04:55:14 PM 5 1.00 17.00 5.00 0.00 0.00 0.00 0.00 0.00 77.00
> 04:55:14 PM 6 1.01 26.26 10.10 0.00 0.00 0.00 0.00 0.00 62.63
> 04:55:14 PM 7 1.01 4.04 2.02 0.00 0.00 0.00 0.00 0.00 92.93
> 04:55:14 PM 8 1.00 4.00 2.00 0.00 0.00 0.00 0.00 0.00 93.00
> 04:55:14 PM 9 1.01 19.19 9.09 0.00 0.00 0.00 0.00 0.00 70.71
> 04:55:14 PM 10 1.01 5.05 2.02 0.00 0.00 0.00 0.00 0.00 91.92
> 04:55:14 PM 11 1.98 5.94 1.98 0.00 0.00 0.00 0.00 0.00 90.10
> 04:55:14 PM 12 1.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 99.00
> 04:55:14 PM 13 0.00 0.00 2.00 0.00 1.00 0.00 0.00 0.00 97.00
> 04:55:14 PM 14 0.00 7.07 5.05 0.00 0.00 0.00 0.00 0.00 87.88
> 04:55:14 PM 15 0.99 0.00 0.99 0.00 0.99 0.00 0.00 0.00 97.03
> 04:55:14 PM 16 1.00 0.00 2.00 0.00 0.00 0.00 0.00 0.00 97.00
> 04:55:14 PM 17 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 100.00
> 04:55:14 PM 18 0.00 4.04 1.01 0.00 0.00 0.00 0.00 0.00 94.95
> 04:55:14 PM 19 0.00 1.00 1.00 0.00 1.00 0.00 0.00 0.00 97.00
> 04:55:14 PM 20 0.00 13.13 3.03 0.00 0.00 0.00 0.00 0.00 83.84
> 04:55:14 PM 21 0.00 1.00 1.00 0.00 0.00 0.00 0.00 0.00 98.00
> 04:55:14 PM 22 1.00 1.00 1.00 0.00 0.00 0.00 0.00 0.00 97.00
> 04:55:14 PM 23 0.00 1.98 0.99 0.00 0.00 0.00 0.00 0.00 97.03
> {code}
> During this time, we're seeing ~10-20MB/s on the disk which amounts to ~10% utilization.
--
This message was sent by Atlassian JIRA
(v6.2#6252)