You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Jonathan Ellis (JIRA)" <ji...@apache.org> on 2010/01/18 05:24:54 UTC
[jira] Created: (CASSANDRA-709) Add jmx progress indicators for
streaming & bootstrap operations
Add jmx progress indicators for streaming & bootstrap operations
----------------------------------------------------------------
Key: CASSANDRA-709
URL: https://issues.apache.org/jira/browse/CASSANDRA-709
Project: Cassandra
Issue Type: New Feature
Reporter: Jonathan Ellis
Priority: Minor
Fix For: 0.9
Currently there is no way to get information about how close unbootstrap or bootstrap is to being done w/o turning on debug logging
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CASSANDRA-709) Add jmx progress indicators for
streaming & bootstrap operations
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Ellis updated CASSANDRA-709:
-------------------------------------
Component/s: Tools
> Add jmx progress indicators for streaming & bootstrap operations
> ----------------------------------------------------------------
>
> Key: CASSANDRA-709
> URL: https://issues.apache.org/jira/browse/CASSANDRA-709
> Project: Cassandra
> Issue Type: New Feature
> Components: Tools
> Reporter: Jonathan Ellis
> Assignee: Jonathan Ellis
> Priority: Minor
> Fix For: 0.6
>
>
> Currently there is no way to get information about how close unbootstrap or bootstrap is to being done w/o turning on debug logging
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CASSANDRA-709) Add jmx progress indicators for
streaming & bootstrap operations
Posted by "Stu Hood (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12831741#action_12831741 ]
Stu Hood commented on CASSANDRA-709:
------------------------------------
* StorageService.operationMode is set inconsistently: sometimes with setMode, sometimes directly.
* Sometimes the mode contains a description, sometimes it doesn't. To make the JMX api straightforward, and not require too much string parsing, it should probably always be a one word mode. static Strings somewhere might be a good idea.
* IncomingStreamReader updates pendingFiles to 'bytesRead + FileStreamTask.CHUNK_SIZE': shouldn't it just be bytesRead?
* FileStreamTask should update to start + bytesTransferred
* StreamOutManager should use streaming.PendingFile rather than creating StreamFile
> Add jmx progress indicators for streaming & bootstrap operations
> ----------------------------------------------------------------
>
> Key: CASSANDRA-709
> URL: https://issues.apache.org/jira/browse/CASSANDRA-709
> Project: Cassandra
> Issue Type: New Feature
> Components: Tools
> Reporter: Jonathan Ellis
> Assignee: Gary Dusbabek
> Priority: Minor
> Fix For: 0.6
>
> Attachments: 0001-getOperationMode.patch, 0002-track-outgoing-streams.patch, 0003-track-incoming-streams.patch, 709-scratch.txt
>
>
> Currently there is no way to get information about how close unbootstrap or bootstrap is to being done w/o turning on debug logging
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CASSANDRA-709) Add jmx progress indicators for
streaming & bootstrap operations
Posted by "Gary Dusbabek (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gary Dusbabek updated CASSANDRA-709:
------------------------------------
Attachment: 0003-track-incoming-streams.patch
0002-track-outgoing-streams.patch
0001-getOperationMode.patch
> Add jmx progress indicators for streaming & bootstrap operations
> ----------------------------------------------------------------
>
> Key: CASSANDRA-709
> URL: https://issues.apache.org/jira/browse/CASSANDRA-709
> Project: Cassandra
> Issue Type: New Feature
> Components: Tools
> Reporter: Jonathan Ellis
> Assignee: Gary Dusbabek
> Priority: Minor
> Fix For: 0.6
>
> Attachments: 0001-getOperationMode.patch, 0002-track-outgoing-streams.patch, 0003-track-incoming-streams.patch, 709-scratch.txt
>
>
> Currently there is no way to get information about how close unbootstrap or bootstrap is to being done w/o turning on debug logging
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CASSANDRA-709) Add jmx progress indicators for
streaming & bootstrap operations
Posted by "Gary Dusbabek (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gary Dusbabek updated CASSANDRA-709:
------------------------------------
Attachment: (was: 0004-make-operation-mode-consistent.-fix-bad-stream-value.patch)
> Add jmx progress indicators for streaming & bootstrap operations
> ----------------------------------------------------------------
>
> Key: CASSANDRA-709
> URL: https://issues.apache.org/jira/browse/CASSANDRA-709
> Project: Cassandra
> Issue Type: New Feature
> Components: Tools
> Reporter: Jonathan Ellis
> Assignee: Gary Dusbabek
> Priority: Minor
> Fix For: 0.6
>
> Attachments: 0001-getOperationMode.patch, 0002-track-outgoing-streams.patch, 0003-track-incoming-streams.patch, 0004-make-operation-mode-consistent.-fix-bad-stream-value.patch, 709-scratch.txt
>
>
> Currently there is no way to get information about how close unbootstrap or bootstrap is to being done w/o turning on debug logging
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CASSANDRA-709) Add jmx progress indicators for
streaming & bootstrap operations
Posted by "Gary Dusbabek (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gary Dusbabek updated CASSANDRA-709:
------------------------------------
Attachment: 0004-make-operation-mode-consistent.-fix-bad-stream-value.patch
> Add jmx progress indicators for streaming & bootstrap operations
> ----------------------------------------------------------------
>
> Key: CASSANDRA-709
> URL: https://issues.apache.org/jira/browse/CASSANDRA-709
> Project: Cassandra
> Issue Type: New Feature
> Components: Tools
> Reporter: Jonathan Ellis
> Assignee: Gary Dusbabek
> Priority: Minor
> Fix For: 0.6
>
> Attachments: 0001-getOperationMode.patch, 0002-track-outgoing-streams.patch, 0003-track-incoming-streams.patch, 0004-make-operation-mode-consistent.-fix-bad-stream-value.patch, 709-scratch.txt
>
>
> Currently there is no way to get information about how close unbootstrap or bootstrap is to being done w/o turning on debug logging
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CASSANDRA-709) Add jmx progress indicators for
streaming & bootstrap operations
Posted by "Gary Dusbabek (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gary Dusbabek updated CASSANDRA-709:
------------------------------------
Attachment: 0003-track-incoming-streams.patch
0002-track-outgoing-streams.patch
0001-getOperationMode.patch
> Add jmx progress indicators for streaming & bootstrap operations
> ----------------------------------------------------------------
>
> Key: CASSANDRA-709
> URL: https://issues.apache.org/jira/browse/CASSANDRA-709
> Project: Cassandra
> Issue Type: New Feature
> Components: Tools
> Reporter: Jonathan Ellis
> Assignee: Gary Dusbabek
> Priority: Minor
> Fix For: 0.6
>
> Attachments: 0001-getOperationMode.patch, 0002-track-outgoing-streams.patch, 0003-track-incoming-streams.patch, 0004-make-operation-mode-consistent.-fix-bad-stream-value.patch, 709-scratch.txt
>
>
> Currently there is no way to get information about how close unbootstrap or bootstrap is to being done w/o turning on debug logging
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CASSANDRA-709) Add jmx progress indicators for
streaming & bootstrap operations
Posted by "Gary Dusbabek (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832006#action_12832006 ]
Gary Dusbabek commented on CASSANDRA-709:
-----------------------------------------
Thanks for the review stu. Please check out 0004.
* Run all operationMode updates through setOperationMode, but with a flag to indicate whether or not to log (was the intent of setting it directly).
* Fix errors updating byte counts.
* Replace StreamFile with PendingFile. This required introducing a files map in StreamOutManager since we need both sequential and random access to the files (or else use PendingFile throughout, which would have been awkward IMO).
> Add jmx progress indicators for streaming & bootstrap operations
> ----------------------------------------------------------------
>
> Key: CASSANDRA-709
> URL: https://issues.apache.org/jira/browse/CASSANDRA-709
> Project: Cassandra
> Issue Type: New Feature
> Components: Tools
> Reporter: Jonathan Ellis
> Assignee: Gary Dusbabek
> Priority: Minor
> Fix For: 0.6
>
> Attachments: 0001-getOperationMode.patch, 0002-track-outgoing-streams.patch, 0003-track-incoming-streams.patch, 0004-make-operation-mode-consistent.-fix-bad-stream-value.patch, 709-scratch.txt
>
>
> Currently there is no way to get information about how close unbootstrap or bootstrap is to being done w/o turning on debug logging
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CASSANDRA-709) Add jmx progress indicators for
streaming & bootstrap operations
Posted by "Gary Dusbabek (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gary Dusbabek updated CASSANDRA-709:
------------------------------------
Attachment: 0004-make-operation-mode-consistent.-fix-bad-stream-value.patch
> Add jmx progress indicators for streaming & bootstrap operations
> ----------------------------------------------------------------
>
> Key: CASSANDRA-709
> URL: https://issues.apache.org/jira/browse/CASSANDRA-709
> Project: Cassandra
> Issue Type: New Feature
> Components: Tools
> Reporter: Jonathan Ellis
> Assignee: Gary Dusbabek
> Priority: Minor
> Fix For: 0.6
>
> Attachments: 0001-getOperationMode.patch, 0002-track-outgoing-streams.patch, 0003-track-incoming-streams.patch, 0004-make-operation-mode-consistent.-fix-bad-stream-value.patch, 709-scratch.txt
>
>
> Currently there is no way to get information about how close unbootstrap or bootstrap is to being done w/o turning on debug logging
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CASSANDRA-709) Add jmx progress indicators for
streaming & bootstrap operations
Posted by "Gary Dusbabek (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gary Dusbabek updated CASSANDRA-709:
------------------------------------
Attachment: (was: 0003-track-incoming-streams.patch)
> Add jmx progress indicators for streaming & bootstrap operations
> ----------------------------------------------------------------
>
> Key: CASSANDRA-709
> URL: https://issues.apache.org/jira/browse/CASSANDRA-709
> Project: Cassandra
> Issue Type: New Feature
> Components: Tools
> Reporter: Jonathan Ellis
> Assignee: Gary Dusbabek
> Priority: Minor
> Fix For: 0.6
>
> Attachments: 0001-getOperationMode.patch, 0002-track-outgoing-streams.patch, 0003-track-incoming-streams.patch, 0004-make-operation-mode-consistent.-fix-bad-stream-value.patch, 709-scratch.txt
>
>
> Currently there is no way to get information about how close unbootstrap or bootstrap is to being done w/o turning on debug logging
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CASSANDRA-709) Add jmx progress indicators for
streaming & bootstrap operations
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12834888#action_12834888 ]
Hudson commented on CASSANDRA-709:
----------------------------------
Integrated in Cassandra #357 (See [http://hudson.zones.apache.org/hudson/job/Cassandra/357/])
> Add jmx progress indicators for streaming & bootstrap operations
> ----------------------------------------------------------------
>
> Key: CASSANDRA-709
> URL: https://issues.apache.org/jira/browse/CASSANDRA-709
> Project: Cassandra
> Issue Type: New Feature
> Components: Tools
> Reporter: Jonathan Ellis
> Assignee: Gary Dusbabek
> Priority: Minor
> Fix For: 0.6
>
> Attachments: 0001-getOperationMode.patch, 0002-track-outgoing-streams.patch, 0003-track-incoming-streams.patch, 0004-make-operation-mode-consistent.-fix-bad-stream-value.patch, 709-scratch.txt
>
>
> Currently there is no way to get information about how close unbootstrap or bootstrap is to being done w/o turning on debug logging
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CASSANDRA-709) Add jmx progress indicators for
streaming & bootstrap operations
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12831751#action_12831751 ]
Jonathan Ellis commented on CASSANDRA-709:
------------------------------------------
operation is intended to be human-readable, not machine parse-able (graphing it seems kinda useless). i'd rather have descriptions.
> Add jmx progress indicators for streaming & bootstrap operations
> ----------------------------------------------------------------
>
> Key: CASSANDRA-709
> URL: https://issues.apache.org/jira/browse/CASSANDRA-709
> Project: Cassandra
> Issue Type: New Feature
> Components: Tools
> Reporter: Jonathan Ellis
> Assignee: Gary Dusbabek
> Priority: Minor
> Fix For: 0.6
>
> Attachments: 0001-getOperationMode.patch, 0002-track-outgoing-streams.patch, 0003-track-incoming-streams.patch, 709-scratch.txt
>
>
> Currently there is no way to get information about how close unbootstrap or bootstrap is to being done w/o turning on debug logging
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (CASSANDRA-709) Add jmx progress indicators for
streaming & bootstrap operations
Posted by "Gary Dusbabek (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gary Dusbabek reassigned CASSANDRA-709:
---------------------------------------
Assignee: Gary Dusbabek (was: Jonathan Ellis)
> Add jmx progress indicators for streaming & bootstrap operations
> ----------------------------------------------------------------
>
> Key: CASSANDRA-709
> URL: https://issues.apache.org/jira/browse/CASSANDRA-709
> Project: Cassandra
> Issue Type: New Feature
> Components: Tools
> Reporter: Jonathan Ellis
> Assignee: Gary Dusbabek
> Priority: Minor
> Fix For: 0.6
>
>
> Currently there is no way to get information about how close unbootstrap or bootstrap is to being done w/o turning on debug logging
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CASSANDRA-709) Add jmx progress indicators for
streaming & bootstrap operations
Posted by "Gary Dusbabek (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gary Dusbabek updated CASSANDRA-709:
------------------------------------
Attachment: (was: 0002-track-outgoing-streams.patch)
> Add jmx progress indicators for streaming & bootstrap operations
> ----------------------------------------------------------------
>
> Key: CASSANDRA-709
> URL: https://issues.apache.org/jira/browse/CASSANDRA-709
> Project: Cassandra
> Issue Type: New Feature
> Components: Tools
> Reporter: Jonathan Ellis
> Assignee: Gary Dusbabek
> Priority: Minor
> Fix For: 0.6
>
> Attachments: 0001-getOperationMode.patch, 0002-track-outgoing-streams.patch, 0003-track-incoming-streams.patch, 0004-make-operation-mode-consistent.-fix-bad-stream-value.patch, 709-scratch.txt
>
>
> Currently there is no way to get information about how close unbootstrap or bootstrap is to being done w/o turning on debug logging
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CASSANDRA-709) Add jmx progress indicators for
streaming & bootstrap operations
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Ellis updated CASSANDRA-709:
-------------------------------------
Attachment: 709-scratch.txt
here's the first patch in the set i was thinking of. (might need rebasing now.) it adds a "operation mode" status that you can check via jmx.
the next part was going to be adding to both sides of Streaming (out and in) showing files to be transferred (on the in side, this would have entries from multiple hosts, i think the out side is serialized so there will only be one target node at a time?), and the progress on the active one.
> Add jmx progress indicators for streaming & bootstrap operations
> ----------------------------------------------------------------
>
> Key: CASSANDRA-709
> URL: https://issues.apache.org/jira/browse/CASSANDRA-709
> Project: Cassandra
> Issue Type: New Feature
> Components: Tools
> Reporter: Jonathan Ellis
> Assignee: Gary Dusbabek
> Priority: Minor
> Fix For: 0.6
>
> Attachments: 709-scratch.txt
>
>
> Currently there is no way to get information about how close unbootstrap or bootstrap is to being done w/o turning on debug logging
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (CASSANDRA-709) Add jmx progress indicators for
streaming & bootstrap operations
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Ellis reassigned CASSANDRA-709:
----------------------------------------
Assignee: Jonathan Ellis
> Add jmx progress indicators for streaming & bootstrap operations
> ----------------------------------------------------------------
>
> Key: CASSANDRA-709
> URL: https://issues.apache.org/jira/browse/CASSANDRA-709
> Project: Cassandra
> Issue Type: New Feature
> Components: Tools
> Reporter: Jonathan Ellis
> Assignee: Jonathan Ellis
> Priority: Minor
> Fix For: 0.6
>
>
> Currently there is no way to get information about how close unbootstrap or bootstrap is to being done w/o turning on debug logging
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CASSANDRA-709) Add jmx progress indicators for
streaming & bootstrap operations
Posted by "Stu Hood (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832137#action_12832137 ]
Stu Hood commented on CASSANDRA-709:
------------------------------------
> since we need both sequential and random access to the files
Another option would be java.util.LinkedHashMap
+1, thanks!
> Add jmx progress indicators for streaming & bootstrap operations
> ----------------------------------------------------------------
>
> Key: CASSANDRA-709
> URL: https://issues.apache.org/jira/browse/CASSANDRA-709
> Project: Cassandra
> Issue Type: New Feature
> Components: Tools
> Reporter: Jonathan Ellis
> Assignee: Gary Dusbabek
> Priority: Minor
> Fix For: 0.6
>
> Attachments: 0001-getOperationMode.patch, 0002-track-outgoing-streams.patch, 0003-track-incoming-streams.patch, 0004-make-operation-mode-consistent.-fix-bad-stream-value.patch, 709-scratch.txt
>
>
> Currently there is no way to get information about how close unbootstrap or bootstrap is to being done w/o turning on debug logging
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CASSANDRA-709) Add jmx progress indicators for
streaming & bootstrap operations
Posted by "Gary Dusbabek (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gary Dusbabek updated CASSANDRA-709:
------------------------------------
Attachment: (was: 0001-getOperationMode.patch)
> Add jmx progress indicators for streaming & bootstrap operations
> ----------------------------------------------------------------
>
> Key: CASSANDRA-709
> URL: https://issues.apache.org/jira/browse/CASSANDRA-709
> Project: Cassandra
> Issue Type: New Feature
> Components: Tools
> Reporter: Jonathan Ellis
> Assignee: Gary Dusbabek
> Priority: Minor
> Fix For: 0.6
>
> Attachments: 0001-getOperationMode.patch, 0002-track-outgoing-streams.patch, 0003-track-incoming-streams.patch, 0004-make-operation-mode-consistent.-fix-bad-stream-value.patch, 709-scratch.txt
>
>
> Currently there is no way to get information about how close unbootstrap or bootstrap is to being done w/o turning on debug logging
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.