You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "paul cannon (JIRA)" <ji...@apache.org> on 2010/09/09 22:38:34 UTC
[jira] Created: (CASSANDRA-1489) Expose progress made on
PendingStreams through JMX
Expose progress made on PendingStreams through JMX
--------------------------------------------------
Key: CASSANDRA-1489
URL: https://issues.apache.org/jira/browse/CASSANDRA-1489
Project: Cassandra
Issue Type: New Feature
Components: Core
Affects Versions: 0.7 beta 1, 0.7 beta 2, 0.7.0, 0.7.1, 0.8
Reporter: paul cannon
Priority: Minor
So I thought originally that the pairs of numbers shown after filenames returned from org.apache.cassandra.service:type=StreamingService's getOutgoingFiles/getIncomingFiles calls were (octetsSent, totalSizeInOctets). Now I know that they are ranges, and that there can be several of them with one file, and that makes sense, but there doesn't seem to be any way to query the progress made on a PendingFile stream.
We would very much like to be able to inspect that from the outside, in whatever way makes sense.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CASSANDRA-1489) Expose progress made on
PendingStreams through JMX
Posted by "Gary Dusbabek (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-1489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12907780#action_12907780 ]
Gary Dusbabek commented on CASSANDRA-1489:
------------------------------------------
as observed from the sender or receiver? From the receiver this shouldn't be too hard, but from the sender it gets difficult, especially when the PendingFile.sections are not very granular.
An idea I had some time ago was to let the receiver send periodic feedback messages to the sender ("I've read x bytes").
BTW, it used to track octets before we switched to sending file sections instead of entire sstables.
> Expose progress made on PendingStreams through JMX
> --------------------------------------------------
>
> Key: CASSANDRA-1489
> URL: https://issues.apache.org/jira/browse/CASSANDRA-1489
> Project: Cassandra
> Issue Type: New Feature
> Components: Core
> Affects Versions: 0.7 beta 1, 0.7 beta 2, 0.7.0, 0.7.1, 0.8
> Reporter: paul cannon
> Priority: Minor
> Original Estimate: 2h
> Remaining Estimate: 2h
>
> So I thought originally that the pairs of numbers shown after filenames returned from org.apache.cassandra.service:type=StreamingService's getOutgoingFiles/getIncomingFiles calls were (octetsSent, totalSizeInOctets). Now I know that they are ranges, and that there can be several of them with one file, and that makes sense, but there doesn't seem to be any way to query the progress made on a PendingFile stream.
> We would very much like to be able to inspect that from the outside, in whatever way makes sense.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CASSANDRA-1489) Expose progress made on
PendingStreams through JMX
Posted by "Nick Bailey (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-1489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nick Bailey updated CASSANDRA-1489:
-----------------------------------
Attachment: 0001-Progress-added-to-incoming-streams.patch
0002-Progess-added-to-outgoing-streams.patch
0003-Moved-FileStreamTask-to-streaming.patch
I think this pretty much accomplishes what you want. The output is similar to:
{noformat}
Receiving from:
Sending to:
127.0.0.1:
/var/folders/Jf/JfRRRNwbE68TqmlnMrMc+3OrLLI/-Tmp-/Keyspace14260283256390104155Standard1/Keyspace1/Standard1-e-0-Data.db/[(0,143), (289,435)]
progress=289/289
/var/folders/Jf/JfRRRNwbE68TqmlnMrMc+3OrLLI/-Tmp-/Keyspace14260283256390104155Standard1/Keyspace1/Standard1-e-0-Data.db/[(0,143), (289,435)]
progress=289/289
{noformat}
> Expose progress made on PendingStreams through JMX
> --------------------------------------------------
>
> Key: CASSANDRA-1489
> URL: https://issues.apache.org/jira/browse/CASSANDRA-1489
> Project: Cassandra
> Issue Type: New Feature
> Components: Tools
> Reporter: paul cannon
> Priority: Minor
> Fix For: 0.7.0
>
> Attachments: 0001-Progress-added-to-incoming-streams.patch, 0002-Progess-added-to-outgoing-streams.patch, 0003-Moved-FileStreamTask-to-streaming.patch
>
> Original Estimate: 2h
> Remaining Estimate: 2h
>
> So I thought originally that the pairs of numbers shown after filenames returned from org.apache.cassandra.service:type=StreamingService's getOutgoingFiles/getIncomingFiles calls were (octetsSent, totalSizeInOctets). Now I know that they are ranges, and that there can be several of them with one file, and that makes sense, but there doesn't seem to be any way to query the progress made on a PendingFile stream.
> We would very much like to be able to inspect that from the outside, in whatever way makes sense.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CASSANDRA-1489) Expose progress made on
PendingStreams through JMX
Posted by "Nick Bailey (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-1489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nick Bailey updated CASSANDRA-1489:
-----------------------------------
Attachment: (was: 0002-Moving-FileStreamTask-to-streaming.patch)
> Expose progress made on PendingStreams through JMX
> --------------------------------------------------
>
> Key: CASSANDRA-1489
> URL: https://issues.apache.org/jira/browse/CASSANDRA-1489
> Project: Cassandra
> Issue Type: New Feature
> Components: Tools
> Affects Versions: 0.7.0
> Reporter: paul cannon
> Assignee: Nick Bailey
> Priority: Minor
> Fix For: 0.7.0
>
> Attachments: 0001-Adding-progress-to-streams.patch, 0002-Moving-FileStreamTask-to-streaming.patch
>
> Original Estimate: 2h
> Remaining Estimate: 2h
>
> So I thought originally that the pairs of numbers shown after filenames returned from org.apache.cassandra.service:type=StreamingService's getOutgoingFiles/getIncomingFiles calls were (octetsSent, totalSizeInOctets). Now I know that they are ranges, and that there can be several of them with one file, and that makes sense, but there doesn't seem to be any way to query the progress made on a PendingFile stream.
> We would very much like to be able to inspect that from the outside, in whatever way makes sense.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CASSANDRA-1489) Expose progress made on
PendingStreams through JMX
Posted by "Nick Bailey (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-1489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nick Bailey updated CASSANDRA-1489:
-----------------------------------
Attachment: (was: 0001-Progress-added-to-incoming-streams.patch)
> Expose progress made on PendingStreams through JMX
> --------------------------------------------------
>
> Key: CASSANDRA-1489
> URL: https://issues.apache.org/jira/browse/CASSANDRA-1489
> Project: Cassandra
> Issue Type: New Feature
> Components: Tools
> Affects Versions: 0.7.0
> Reporter: paul cannon
> Assignee: Nick Bailey
> Priority: Minor
> Fix For: 0.7.0
>
> Original Estimate: 2h
> Remaining Estimate: 2h
>
> So I thought originally that the pairs of numbers shown after filenames returned from org.apache.cassandra.service:type=StreamingService's getOutgoingFiles/getIncomingFiles calls were (octetsSent, totalSizeInOctets). Now I know that they are ranges, and that there can be several of them with one file, and that makes sense, but there doesn't seem to be any way to query the progress made on a PendingFile stream.
> We would very much like to be able to inspect that from the outside, in whatever way makes sense.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CASSANDRA-1489) Expose progress made on
PendingStreams through JMX
Posted by "Nick Bailey (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-1489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nick Bailey updated CASSANDRA-1489:
-----------------------------------
Attachment: 0001-Adding-progress-to-streams.patch
0002-Moving-FileStreamTask-to-streaming.patch
rebased
> Expose progress made on PendingStreams through JMX
> --------------------------------------------------
>
> Key: CASSANDRA-1489
> URL: https://issues.apache.org/jira/browse/CASSANDRA-1489
> Project: Cassandra
> Issue Type: New Feature
> Components: Tools
> Affects Versions: 0.7.0
> Reporter: paul cannon
> Assignee: Nick Bailey
> Priority: Minor
> Fix For: 0.7.0
>
> Attachments: 0001-Adding-progress-to-streams.patch, 0002-Moving-FileStreamTask-to-streaming.patch
>
> Original Estimate: 2h
> Remaining Estimate: 2h
>
> So I thought originally that the pairs of numbers shown after filenames returned from org.apache.cassandra.service:type=StreamingService's getOutgoingFiles/getIncomingFiles calls were (octetsSent, totalSizeInOctets). Now I know that they are ranges, and that there can be several of them with one file, and that makes sense, but there doesn't seem to be any way to query the progress made on a PendingFile stream.
> We would very much like to be able to inspect that from the outside, in whatever way makes sense.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CASSANDRA-1489) Expose progress made on
PendingStreams through JMX
Posted by "paul cannon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-1489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12907784#action_12907784 ]
paul cannon commented on CASSANDRA-1489:
----------------------------------------
bq. as observed from the sender or receiver?
Doesn't matter for our purposes, although ideally it would be both.
> Expose progress made on PendingStreams through JMX
> --------------------------------------------------
>
> Key: CASSANDRA-1489
> URL: https://issues.apache.org/jira/browse/CASSANDRA-1489
> Project: Cassandra
> Issue Type: New Feature
> Components: Core
> Affects Versions: 0.7 beta 1, 0.7 beta 2, 0.7.0, 0.7.1, 0.8
> Reporter: paul cannon
> Priority: Minor
> Original Estimate: 2h
> Remaining Estimate: 2h
>
> So I thought originally that the pairs of numbers shown after filenames returned from org.apache.cassandra.service:type=StreamingService's getOutgoingFiles/getIncomingFiles calls were (octetsSent, totalSizeInOctets). Now I know that they are ranges, and that there can be several of them with one file, and that makes sense, but there doesn't seem to be any way to query the progress made on a PendingFile stream.
> We would very much like to be able to inspect that from the outside, in whatever way makes sense.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CASSANDRA-1489) Expose progress made on
PendingStreams through JMX
Posted by "Nick Bailey (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-1489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nick Bailey updated CASSANDRA-1489:
-----------------------------------
Attachment: (was: 0001-Adding-progress-to-streams.patch)
> Expose progress made on PendingStreams through JMX
> --------------------------------------------------
>
> Key: CASSANDRA-1489
> URL: https://issues.apache.org/jira/browse/CASSANDRA-1489
> Project: Cassandra
> Issue Type: New Feature
> Components: Tools
> Affects Versions: 0.7.0
> Reporter: paul cannon
> Assignee: Nick Bailey
> Priority: Minor
> Fix For: 0.7.0
>
> Attachments: 0001-Adding-progress-to-streams.patch, 0002-Moving-FileStreamTask-to-streaming.patch
>
> Original Estimate: 2h
> Remaining Estimate: 2h
>
> So I thought originally that the pairs of numbers shown after filenames returned from org.apache.cassandra.service:type=StreamingService's getOutgoingFiles/getIncomingFiles calls were (octetsSent, totalSizeInOctets). Now I know that they are ranges, and that there can be several of them with one file, and that makes sense, but there doesn't seem to be any way to query the progress made on a PendingFile stream.
> We would very much like to be able to inspect that from the outside, in whatever way makes sense.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CASSANDRA-1489) Expose progress made on
PendingStreams through JMX
Posted by "Nick Bailey (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-1489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12908203#action_12908203 ]
Nick Bailey commented on CASSANDRA-1489:
----------------------------------------
The current patch doesn't break up the sending and receiving any so the progress will jump randomly. We could set a limit on the number of bytes we try to read or write at a time but I'm not sure if there is much overhead with each call.
> Expose progress made on PendingStreams through JMX
> --------------------------------------------------
>
> Key: CASSANDRA-1489
> URL: https://issues.apache.org/jira/browse/CASSANDRA-1489
> Project: Cassandra
> Issue Type: New Feature
> Components: Tools
> Affects Versions: 0.7.0
> Reporter: paul cannon
> Priority: Minor
> Fix For: 0.7.0
>
> Attachments: 0001-Progress-added-to-incoming-streams.patch, 0002-Progess-added-to-outgoing-streams.patch, 0003-Moved-FileStreamTask-to-streaming.patch
>
> Original Estimate: 2h
> Remaining Estimate: 2h
>
> So I thought originally that the pairs of numbers shown after filenames returned from org.apache.cassandra.service:type=StreamingService's getOutgoingFiles/getIncomingFiles calls were (octetsSent, totalSizeInOctets). Now I know that they are ranges, and that there can be several of them with one file, and that makes sense, but there doesn't seem to be any way to query the progress made on a PendingFile stream.
> We would very much like to be able to inspect that from the outside, in whatever way makes sense.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CASSANDRA-1489) Expose progress made on
PendingStreams through JMX
Posted by "Nick Bailey (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-1489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12908071#action_12908071 ]
Nick Bailey commented on CASSANDRA-1489:
----------------------------------------
It doesn't seem like this should be too hard from either the sending or receiving side. Both have a list of pending files they are expecting to send/receive. Granularity can be easily readded to the read/write commands. After each read or write the streamcontext or pending file just needs to be updated and then can be presented in jmx.
> Expose progress made on PendingStreams through JMX
> --------------------------------------------------
>
> Key: CASSANDRA-1489
> URL: https://issues.apache.org/jira/browse/CASSANDRA-1489
> Project: Cassandra
> Issue Type: New Feature
> Components: Tools
> Reporter: paul cannon
> Priority: Minor
> Fix For: 0.7.0
>
> Original Estimate: 2h
> Remaining Estimate: 2h
>
> So I thought originally that the pairs of numbers shown after filenames returned from org.apache.cassandra.service:type=StreamingService's getOutgoingFiles/getIncomingFiles calls were (octetsSent, totalSizeInOctets). Now I know that they are ranges, and that there can be several of them with one file, and that makes sense, but there doesn't seem to be any way to query the progress made on a PendingFile stream.
> We would very much like to be able to inspect that from the outside, in whatever way makes sense.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CASSANDRA-1489) Expose progress made on
PendingStreams through JMX
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-1489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Ellis updated CASSANDRA-1489:
--------------------------------------
Assignee: Nirmal Ranganathan
Reviewer: gdusbabek
> Expose progress made on PendingStreams through JMX
> --------------------------------------------------
>
> Key: CASSANDRA-1489
> URL: https://issues.apache.org/jira/browse/CASSANDRA-1489
> Project: Cassandra
> Issue Type: New Feature
> Components: Tools
> Affects Versions: 0.7.0
> Reporter: paul cannon
> Assignee: Nirmal Ranganathan
> Priority: Minor
> Fix For: 0.7.0
>
> Attachments: 0001-Progress-added-to-incoming-streams.patch, 0002-Progess-added-to-outgoing-streams.patch, 0003-Moved-FileStreamTask-to-streaming.patch
>
> Original Estimate: 2h
> Remaining Estimate: 2h
>
> So I thought originally that the pairs of numbers shown after filenames returned from org.apache.cassandra.service:type=StreamingService's getOutgoingFiles/getIncomingFiles calls were (octetsSent, totalSizeInOctets). Now I know that they are ranges, and that there can be several of them with one file, and that makes sense, but there doesn't seem to be any way to query the progress made on a PendingFile stream.
> We would very much like to be able to inspect that from the outside, in whatever way makes sense.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CASSANDRA-1489) Expose progress made on
PendingStreams through JMX
Posted by "Nick Bailey (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-1489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nick Bailey updated CASSANDRA-1489:
-----------------------------------
Attachment: (was: 0002-Progess-added-to-outgoing-streams.patch)
> Expose progress made on PendingStreams through JMX
> --------------------------------------------------
>
> Key: CASSANDRA-1489
> URL: https://issues.apache.org/jira/browse/CASSANDRA-1489
> Project: Cassandra
> Issue Type: New Feature
> Components: Tools
> Affects Versions: 0.7.0
> Reporter: paul cannon
> Assignee: Nick Bailey
> Priority: Minor
> Fix For: 0.7.0
>
> Original Estimate: 2h
> Remaining Estimate: 2h
>
> So I thought originally that the pairs of numbers shown after filenames returned from org.apache.cassandra.service:type=StreamingService's getOutgoingFiles/getIncomingFiles calls were (octetsSent, totalSizeInOctets). Now I know that they are ranges, and that there can be several of them with one file, and that makes sense, but there doesn't seem to be any way to query the progress made on a PendingFile stream.
> We would very much like to be able to inspect that from the outside, in whatever way makes sense.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CASSANDRA-1489) Expose progress made on
PendingStreams through JMX
Posted by "Nick Bailey (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-1489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nick Bailey updated CASSANDRA-1489:
-----------------------------------
Attachment: (was: 0003-Moved-FileStreamTask-to-streaming.patch)
> Expose progress made on PendingStreams through JMX
> --------------------------------------------------
>
> Key: CASSANDRA-1489
> URL: https://issues.apache.org/jira/browse/CASSANDRA-1489
> Project: Cassandra
> Issue Type: New Feature
> Components: Tools
> Affects Versions: 0.7.0
> Reporter: paul cannon
> Assignee: Nick Bailey
> Priority: Minor
> Fix For: 0.7.0
>
> Original Estimate: 2h
> Remaining Estimate: 2h
>
> So I thought originally that the pairs of numbers shown after filenames returned from org.apache.cassandra.service:type=StreamingService's getOutgoingFiles/getIncomingFiles calls were (octetsSent, totalSizeInOctets). Now I know that they are ranges, and that there can be several of them with one file, and that makes sense, but there doesn't seem to be any way to query the progress made on a PendingFile stream.
> We would very much like to be able to inspect that from the outside, in whatever way makes sense.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CASSANDRA-1489) Expose progress made on
PendingStreams through JMX
Posted by "Nirmal Ranganathan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-1489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12909528#action_12909528 ]
Nirmal Ranganathan commented on CASSANDRA-1489:
-----------------------------------------------
Just some minor additions would be nice:
* PendingFile.toString() - could print getFilename() + "/" + sections + " progress + "/" + size + " - " + progress*100/size + "% completed". This is the message that appears in JMX for streamStatus.
* Add that info to logging in FileStreamTask too for bytes transferred.
* Change getIncomingFiles and getOutgoingFiles in StreamIn/OutSession to a Set if adding the pending file and activeStreams to it. The List duplicates those values as the active stream is contained in the pendingFiles too.
> Expose progress made on PendingStreams through JMX
> --------------------------------------------------
>
> Key: CASSANDRA-1489
> URL: https://issues.apache.org/jira/browse/CASSANDRA-1489
> Project: Cassandra
> Issue Type: New Feature
> Components: Tools
> Affects Versions: 0.7.0
> Reporter: paul cannon
> Assignee: Nick Bailey
> Priority: Minor
> Fix For: 0.7.0
>
> Attachments: 0001-Progress-added-to-incoming-streams.patch, 0002-Progess-added-to-outgoing-streams.patch, 0003-Moved-FileStreamTask-to-streaming.patch
>
> Original Estimate: 2h
> Remaining Estimate: 2h
>
> So I thought originally that the pairs of numbers shown after filenames returned from org.apache.cassandra.service:type=StreamingService's getOutgoingFiles/getIncomingFiles calls were (octetsSent, totalSizeInOctets). Now I know that they are ranges, and that there can be several of them with one file, and that makes sense, but there doesn't seem to be any way to query the progress made on a PendingFile stream.
> We would very much like to be able to inspect that from the outside, in whatever way makes sense.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CASSANDRA-1489) Expose progress made on
PendingStreams through JMX
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-1489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Ellis updated CASSANDRA-1489:
--------------------------------------
Fix Version/s: 0.7.0
Affects Version/s: (was: 0.7 beta 1)
(was: 0.8)
(was: 0.7.1)
(was: 0.7.0)
(was: 0.7 beta 2)
Component/s: Tools
(was: Core)
> Expose progress made on PendingStreams through JMX
> --------------------------------------------------
>
> Key: CASSANDRA-1489
> URL: https://issues.apache.org/jira/browse/CASSANDRA-1489
> Project: Cassandra
> Issue Type: New Feature
> Components: Tools
> Reporter: paul cannon
> Priority: Minor
> Fix For: 0.7.0
>
> Original Estimate: 2h
> Remaining Estimate: 2h
>
> So I thought originally that the pairs of numbers shown after filenames returned from org.apache.cassandra.service:type=StreamingService's getOutgoingFiles/getIncomingFiles calls were (octetsSent, totalSizeInOctets). Now I know that they are ranges, and that there can be several of them with one file, and that makes sense, but there doesn't seem to be any way to query the progress made on a PendingFile stream.
> We would very much like to be able to inspect that from the outside, in whatever way makes sense.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (CASSANDRA-1489) Expose progress made on
PendingStreams through JMX
Posted by "Nick Bailey (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-1489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nick Bailey reassigned CASSANDRA-1489:
--------------------------------------
Assignee: Nick Bailey (was: Nirmal Ranganathan)
> Expose progress made on PendingStreams through JMX
> --------------------------------------------------
>
> Key: CASSANDRA-1489
> URL: https://issues.apache.org/jira/browse/CASSANDRA-1489
> Project: Cassandra
> Issue Type: New Feature
> Components: Tools
> Affects Versions: 0.7.0
> Reporter: paul cannon
> Assignee: Nick Bailey
> Priority: Minor
> Fix For: 0.7.0
>
> Attachments: 0001-Progress-added-to-incoming-streams.patch, 0002-Progess-added-to-outgoing-streams.patch, 0003-Moved-FileStreamTask-to-streaming.patch
>
> Original Estimate: 2h
> Remaining Estimate: 2h
>
> So I thought originally that the pairs of numbers shown after filenames returned from org.apache.cassandra.service:type=StreamingService's getOutgoingFiles/getIncomingFiles calls were (octetsSent, totalSizeInOctets). Now I know that they are ranges, and that there can be several of them with one file, and that makes sense, but there doesn't seem to be any way to query the progress made on a PendingFile stream.
> We would very much like to be able to inspect that from the outside, in whatever way makes sense.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CASSANDRA-1489) Expose progress made on
PendingStreams through JMX
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-1489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12915299#action_12915299 ]
Hudson commented on CASSANDRA-1489:
-----------------------------------
Integrated in Cassandra #548 (See [https://hudson.apache.org/hudson/job/Cassandra/548/])
move FileStreamTask to streaming. patch by Nick Bailey, reviewed by Gary Dusbabek. CASSANDRA-1489
add progress to streams. patch by Nick Bailey, reviewed by Gary Dusbabek. CASSANDRA-1489
> Expose progress made on PendingStreams through JMX
> --------------------------------------------------
>
> Key: CASSANDRA-1489
> URL: https://issues.apache.org/jira/browse/CASSANDRA-1489
> Project: Cassandra
> Issue Type: New Feature
> Components: Tools
> Affects Versions: 0.7.0
> Reporter: paul cannon
> Assignee: Nick Bailey
> Priority: Minor
> Fix For: 0.7.0
>
> Attachments: 0001-Adding-progress-to-streams.patch, 0002-Moving-FileStreamTask-to-streaming.patch
>
> Original Estimate: 2h
> Remaining Estimate: 2h
>
> So I thought originally that the pairs of numbers shown after filenames returned from org.apache.cassandra.service:type=StreamingService's getOutgoingFiles/getIncomingFiles calls were (octetsSent, totalSizeInOctets). Now I know that they are ranges, and that there can be several of them with one file, and that makes sense, but there doesn't seem to be any way to query the progress made on a PendingFile stream.
> We would very much like to be able to inspect that from the outside, in whatever way makes sense.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CASSANDRA-1489) Expose progress made on
PendingStreams through JMX
Posted by "Nick Bailey (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-1489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nick Bailey updated CASSANDRA-1489:
-----------------------------------
Attachment: 0001-Adding-progress-to-streams.patch
0002-Moving-FileStreamTask-to-streaming.patch
Rebased with all the recent changes in streaming and updated to include Nirmal's comments. A 10MB chunk size was added as well. Doesn't seem to be a good way of monitoring progress besides chunking.
> Expose progress made on PendingStreams through JMX
> --------------------------------------------------
>
> Key: CASSANDRA-1489
> URL: https://issues.apache.org/jira/browse/CASSANDRA-1489
> Project: Cassandra
> Issue Type: New Feature
> Components: Tools
> Affects Versions: 0.7.0
> Reporter: paul cannon
> Assignee: Nick Bailey
> Priority: Minor
> Fix For: 0.7.0
>
> Attachments: 0001-Adding-progress-to-streams.patch, 0002-Moving-FileStreamTask-to-streaming.patch
>
> Original Estimate: 2h
> Remaining Estimate: 2h
>
> So I thought originally that the pairs of numbers shown after filenames returned from org.apache.cassandra.service:type=StreamingService's getOutgoingFiles/getIncomingFiles calls were (octetsSent, totalSizeInOctets). Now I know that they are ranges, and that there can be several of them with one file, and that makes sense, but there doesn't seem to be any way to query the progress made on a PendingFile stream.
> We would very much like to be able to inspect that from the outside, in whatever way makes sense.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.