You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by "daxwang (王文军)" <da...@tencent.com> on 2017/02/24 03:33:05 UTC

what's means about __skipped-max-spout in metrics

what's means about __skipped-max-spout,__skipped-inactive and __skipped-throttle in metric?  any documents?

2017-02-24 11:30:04,015 455816   1487907004   test-heron-01:6728     37:639_data_id_5175    __fail-count            {}
2017-02-24 11:30:04,015 455816   1487907004   test-heron-01:6728     37:639_data_id_5175    __sendqueue             {arrival_rate_secs=0.0, overflow=0, read_pos=7231, write_pos=7231, sojourn_time_ms=0.0, capacity=512, population=0}
2017-02-24 11:30:04,015 455816   1487907004   test-heron-01:6728     37:639_data_id_5175    kafkaOffset             {totalSpoutLag=11835886, totalLatestEmittedOffset=24667179, partition_36/earliestTimeOffset=24649023, partition_36/latestTimeOffset=36503065, partition_36/spoutLag=11835886, totalEarliestTimeOffset=24649023, totalLatestTimeOffset=36503065, partition_36/latestEmittedOffset=24667179}
2017-02-24 11:30:04,015 455816   1487907004   test-heron-01:6728     37:639_data_id_5175    __skipped-max-spout     1075920
2017-02-24 11:30:04,015 455816   1487907004   test-heron-01:6728     37:639_data_id_5175    __skipped-inactive      0
2017-02-24 11:30:04,015 455816   1487907004   test-heron-01:6728     37:639_data_id_5175    __skipped-throttle      0


________________________________
[cid:_Foxmail.1@43b0a646-23c8-fef7-e621-c98a918e50b6]

Re: what's means about __skipped-max-spout in metrics

Posted by Gireesh Ramji <gi...@yahoo.com>.
I think skipped-max-spout captures how often the spout had something to emit, but did not because the # of tuples in flight was already at max-spout-pending. Not sure about the other 2, I think skipped-throttle comes into play when you set backpressure.enable = true and doesn't matter if you have turned off backpressure

      From: daxwang(王文军) <da...@tencent.com>
 To: user <us...@storm.apache.org> 
 Sent: Friday, February 24, 2017 11:33 AM
 Subject: what's means about __skipped-max-spout in metrics
   
 #yiv6999716970 body {line-height:1.5;}#yiv6999716970 body {font-size:10.5pt;color:rgb(0, 0, 0);line-height:1.5;}
what's means about __skipped-max-spout,__skipped-inactive and __skipped-throttle in metric?  any documents?
2017-02-24 11:30:04,015 455816   1487907004   test-heron-01:6728     37:639_data_id_5175    __fail-count            {}
2017-02-24 11:30:04,015 455816   1487907004   test-heron-01:6728     37:639_data_id_5175    __sendqueue             {arrival_rate_secs=0.0, overflow=0, read_pos=7231, write_pos=7231, sojourn_time_ms=0.0, capacity=512, population=0}
2017-02-24 11:30:04,015 455816   1487907004   test-heron-01:6728     37:639_data_id_5175    kafkaOffset             {totalSpoutLag=11835886, totalLatestEmittedOffset=24667179, partition_36/earliestTimeOffset=24649023, partition_36/latestTimeOffset=36503065, partition_36/spoutLag=11835886, totalEarliestTimeOffset=24649023, totalLatestTimeOffset=36503065, partition_36/latestEmittedOffset=24667179}
2017-02-24 11:30:04,015 455816   1487907004   test-heron-01:6728     37:639_data_id_5175    __skipped-max-spout     1075920
2017-02-24 11:30:04,015 455816   1487907004   test-heron-01:6728     37:639_data_id_5175    __skipped-inactive      0     
2017-02-24 11:30:04,015 455816   1487907004   test-heron-01:6728     37:639_data_id_5175    __skipped-throttle      0