You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Brandon Williams (Created) (JIRA)" <ji...@apache.org> on 2011/11/03 21:01:33 UTC
[jira] [Created] (CASSANDRA-3452) Create an 'infinite bootstrap'
mode for sampling live traffic
Create an 'infinite bootstrap' mode for sampling live traffic
-------------------------------------------------------------
Key: CASSANDRA-3452
URL: https://issues.apache.org/jira/browse/CASSANDRA-3452
Project: Cassandra
Issue Type: New Feature
Reporter: Brandon Williams
Assignee: Brandon Williams
You may want to, for example, test a new compaction strategy with live traffic to see how it will fare. In this mode, the node would follow the bootstrap procedure as normal, but never fully join the ring.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3452) Create an 'infinite bootstrap'
mode for sampling live traffic
Posted by "Jonathan Ellis (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Ellis updated CASSANDRA-3452:
--------------------------------------
Fix Version/s: (was: 1.0.7)
1.1
> Create an 'infinite bootstrap' mode for sampling live traffic
> -------------------------------------------------------------
>
> Key: CASSANDRA-3452
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3452
> Project: Cassandra
> Issue Type: New Feature
> Reporter: Brandon Williams
> Assignee: Brandon Williams
> Fix For: 1.1
>
> Attachments: 0001-Ability-to-set-compaction-strategy-via-mbean.txt, 0002-Allow-survey-only-mode-after-bootstrapping.txt
>
>
> You may want to, for example, test a new compaction strategy with live traffic to see how it will fare. In this mode, the node would follow the bootstrap procedure as normal, but never fully join the ring.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3452) Create an 'infinite bootstrap'
mode for sampling live traffic
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13175202#comment-13175202 ]
Hudson commented on CASSANDRA-3452:
-----------------------------------
Integrated in Cassandra #1266 (See [https://builds.apache.org/job/Cassandra/1266/])
Add 'write survey' mode that bootstraps but does not join.
Patch by brandonwilliams, reviewed by jbellis for CASSANDRA-3452
brandonwilliams : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1222425
Files :
* /cassandra/trunk/src/java/org/apache/cassandra/service/StorageService.java
> Create an 'infinite bootstrap' mode for sampling live traffic
> -------------------------------------------------------------
>
> Key: CASSANDRA-3452
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3452
> Project: Cassandra
> Issue Type: New Feature
> Reporter: Brandon Williams
> Assignee: Brandon Williams
> Fix For: 1.1
>
> Attachments: 0001-Ability-to-set-compaction-strategy-via-mbean.txt, 0002-Allow-survey-only-mode-after-bootstrapping.txt
>
>
> You may want to, for example, test a new compaction strategy with live traffic to see how it will fare. In this mode, the node would follow the bootstrap procedure as normal, but never fully join the ring.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3452) Create an 'infinite bootstrap'
mode for sampling live traffic
Posted by "Edward Capriolo (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13143505#comment-13143505 ]
Edward Capriolo commented on CASSANDRA-3452:
--------------------------------------------
This is pretty interesting. Ideally I was thinking of being able to do a head to head test.
IE. You could convert a single node to a compressed LCS node. It would take reads and writes, but you would not do any repairs, or joins, or moves or possibly any other schema changes. At some point you would evaluate the performance vs another node in your cluster, look at your performance and make the decision. If you want the change to happen across the cluster or be undone.
I know my request is asking something to the effect of 'Help me test in production', But coming up with hardware and a system to do an actual test of production load is difficult. If we were able to restrict a schema update to one node we have a way to mitigate risk. For a major change like compression or LCS that will drastically reshape a lot of physical data on disk and could drastically change performance hopefully in a good way, but if it did not work out well, performance could suffer for a long time while the underlying data tables rewrite themselves and you get back to where you started.
> Create an 'infinite bootstrap' mode for sampling live traffic
> -------------------------------------------------------------
>
> Key: CASSANDRA-3452
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3452
> Project: Cassandra
> Issue Type: New Feature
> Reporter: Brandon Williams
> Assignee: Brandon Williams
>
> You may want to, for example, test a new compaction strategy with live traffic to see how it will fare. In this mode, the node would follow the bootstrap procedure as normal, but never fully join the ring.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3452) Create an 'infinite bootstrap'
mode for sampling live traffic
Posted by "Brandon Williams (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13143516#comment-13143516 ]
Brandon Williams commented on CASSANDRA-3452:
---------------------------------------------
bq. IE. You could convert a single node to a compressed LCS node. It would take reads and writes, but you would not do any repairs, or joins, or moves or possibly any other schema changes. At some point you would evaluate the performance vs another node in your cluster, look at your performance and make the decision. If you want the change to happen across the cluster or be undone.
If you want to localize changes to a node then JMX is the way to do it. If the node is going to take reads, it might as well be part of the cluster.
> Create an 'infinite bootstrap' mode for sampling live traffic
> -------------------------------------------------------------
>
> Key: CASSANDRA-3452
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3452
> Project: Cassandra
> Issue Type: New Feature
> Reporter: Brandon Williams
> Assignee: Brandon Williams
>
> You may want to, for example, test a new compaction strategy with live traffic to see how it will fare. In this mode, the node would follow the bootstrap procedure as normal, but never fully join the ring.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3452) Create an 'infinite bootstrap'
mode for sampling live traffic
Posted by "Brandon Williams (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Brandon Williams updated CASSANDRA-3452:
----------------------------------------
Attachment: 0002-Allow-survey-only-mode-after-bootstrapping.txt
0001-Ability-to-set-compaction-strategy-via-mbean.txt
Patch to create a "write survey" mode enabled via -Dcassandra.write_survey=true, where the node will bootstrap as usual but NOT join the ring unless SS.joinRing is called later (as you would with cassandra.join_ring=false. Also a patch jmx-enable the setting of the compaction strategy on a CF so these are more useful as a whole.
> Create an 'infinite bootstrap' mode for sampling live traffic
> -------------------------------------------------------------
>
> Key: CASSANDRA-3452
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3452
> Project: Cassandra
> Issue Type: New Feature
> Reporter: Brandon Williams
> Assignee: Brandon Williams
> Attachments: 0001-Ability-to-set-compaction-strategy-via-mbean.txt, 0002-Allow-survey-only-mode-after-bootstrapping.txt
>
>
> You may want to, for example, test a new compaction strategy with live traffic to see how it will fare. In this mode, the node would follow the bootstrap procedure as normal, but never fully join the ring.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3452) Create an 'infinite bootstrap'
mode for sampling live traffic
Posted by "Jonathan Ellis (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13175029#comment-13175029 ]
Jonathan Ellis commented on CASSANDRA-3452:
-------------------------------------------
+1
(I'd be okay with 01 in 1.0.7, but 02 should be 1.1 IMO)
> Create an 'infinite bootstrap' mode for sampling live traffic
> -------------------------------------------------------------
>
> Key: CASSANDRA-3452
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3452
> Project: Cassandra
> Issue Type: New Feature
> Reporter: Brandon Williams
> Assignee: Brandon Williams
> Fix For: 1.1
>
> Attachments: 0001-Ability-to-set-compaction-strategy-via-mbean.txt, 0002-Allow-survey-only-mode-after-bootstrapping.txt
>
>
> You may want to, for example, test a new compaction strategy with live traffic to see how it will fare. In this mode, the node would follow the bootstrap procedure as normal, but never fully join the ring.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira