You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by GitBox <gi...@apache.org> on 2021/02/02 13:33:01 UTC
[GitHub] [incubator-pinot] daniellavoie opened a new issue #6520: Expose segment reload status as JMX Metric
daniellavoie opened a new issue #6520:
URL: https://github.com/apache/incubator-pinot/issues/6520
It would be very helpful for operation purpose to have the ability to get quick overview on the reload status of a table.
All I could find for now is the `GET /segments/{tableName}_OFFLINE/metadata?type=OFFLINE`. As I'm exploring its output, I realize that the reload status is specific to each individual segments. While providing a startree status there would be a good step forward, a global status would greatly improve the operation experience.
### Output from metadata endpoint
```
"myTable_OFFLINE_1602111600000_1602111600000_2670" : {
"segmentName" : "myTable_OFFLINE_1602111600000_1602111600000_2670",
...
"columns" : [ ],
"indexes" : {
"column1" : {
"bloom-filter" : "NO",
"dictionary" : "YES",
"forward-index" : "YES",
"inverted-index" : "NO",
"null-value-vector-reader" : "NO",
"range-index" : "NO"
},
"column2" : {
"bloom-filter" : "NO",
"dictionary" : "YES",
"forward-index" : "YES",
"inverted-index" : "NO",
"null-value-vector-reader" : "NO",
"range-index" : "NO"
},
}
}
```
## Exposing reload status as JMX Metrics
In addition to a global status, exposing the individual reload status as well as the global status would be very helpful in regards to configuration alerts on a prometheus stack.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] fx19880617 edited a comment on issue #6520: Expose segment reload status as JMX Metric
Posted by GitBox <gi...@apache.org>.
fx19880617 edited a comment on issue #6520:
URL: https://github.com/apache/incubator-pinot/issues/6520#issuecomment-772069028
Got it, then I think we can add a gauge value in pinot server per <table, column, index-type>.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] fx19880617 commented on issue #6520: Expose segment reload status as JMX Metric
Posted by GitBox <gi...@apache.org>.
fx19880617 commented on issue #6520:
URL: https://github.com/apache/incubator-pinot/issues/6520#issuecomment-772059592
I feel it might be too much overhead to expose segment level status.
But possible to provide aggregated metrics at table level and maybe table/column level.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] daniellavoie commented on issue #6520: Expose segment reload status as JMX Metric
Posted by GitBox <gi...@apache.org>.
daniellavoie commented on issue #6520:
URL: https://github.com/apache/incubator-pinot/issues/6520#issuecomment-772061131
Yes aggregated would be fine. Mostly, this metric is to answer `Is it down yet?`
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] daniellavoie edited a comment on issue #6520: Expose segment reload status as JMX Metric
Posted by GitBox <gi...@apache.org>.
daniellavoie edited a comment on issue #6520:
URL: https://github.com/apache/incubator-pinot/issues/6520#issuecomment-772061131
Yes aggregated would be fine. Mostly, this metric is to answer `Is it done yet?`
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] fx19880617 edited a comment on issue #6520: Expose segment reload status as JMX Metric
Posted by GitBox <gi...@apache.org>.
fx19880617 edited a comment on issue #6520:
URL: https://github.com/apache/incubator-pinot/issues/6520#issuecomment-772069028
Got it, then I think we can add a gauge value in pinot server per table/column/index-type.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] daniellavoie commented on issue #6520: Expose segment reload status as JMX Metric
Posted by GitBox <gi...@apache.org>.
daniellavoie commented on issue #6520:
URL: https://github.com/apache/incubator-pinot/issues/6520#issuecomment-772061131
Yes aggregated would be fine. Mostly, this metric is to answer `Is it down yet?`
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] fx19880617 commented on issue #6520: Expose segment reload status as JMX Metric
Posted by GitBox <gi...@apache.org>.
fx19880617 commented on issue #6520:
URL: https://github.com/apache/incubator-pinot/issues/6520#issuecomment-772059592
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] fx19880617 edited a comment on issue #6520: Expose segment reload status as JMX Metric
Posted by GitBox <gi...@apache.org>.
fx19880617 edited a comment on issue #6520:
URL: https://github.com/apache/incubator-pinot/issues/6520#issuecomment-772069028
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] fx19880617 commented on issue #6520: Expose segment reload status as JMX Metric
Posted by GitBox <gi...@apache.org>.
fx19880617 commented on issue #6520:
URL: https://github.com/apache/incubator-pinot/issues/6520#issuecomment-772069028
Got it, then I think we can add a gauge value in pinot server per table/column/index.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] daniellavoie edited a comment on issue #6520: Expose segment reload status as JMX Metric
Posted by GitBox <gi...@apache.org>.
daniellavoie edited a comment on issue #6520:
URL: https://github.com/apache/incubator-pinot/issues/6520#issuecomment-772061131
Yes aggregated would be fine. Mostly, this metric is to answer `Is it done yet?`
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org