You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@accumulo.apache.org by GitBox <gi...@apache.org> on 2022/03/10 15:54:27 UTC
[GitHub] [accumulo] milleruntime opened a new issue #2561: Provide Insight into queued compactions
milleruntime opened a new issue #2561:
URL: https://github.com/apache/accumulo/issues/2561
**Is your feature request related to a problem? Please describe.**
When there are lots of compactions running, they get queued up in the tservers? (possibly the CompactionManger) and can only be seen through the Monitor. The only reason an Admin knows that there are compactions queued is in the monitor showing the number in parenthesis.
**Describe the solution you'd like**
Someway for an admin to know the types of the compactions queued and get more information about queued compactions.
**Describe alternatives you've considered**
The Shell provides information about running compactions through the `listcompactions` command and the `fate` command. But the `fate` command will only show user compactions and `listcompactions` will only show running compactions.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@accumulo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [accumulo] keith-turner commented on issue #2561: Provide Insight into queued compactions
Posted by GitBox <gi...@apache.org>.
keith-turner commented on issue #2561:
URL: https://github.com/apache/accumulo/issues/2561#issuecomment-1065295371
Per executor metrics for running and queued are emitted for each tserver. I think that is done by [this code](https://github.com/apache/accumulo/blob/main/server/tserver/src/main/java/org/apache/accumulo/tserver/metrics/CompactionExecutorsMetrics.java). The blog post about external compactions plotted these metrics in the [ingest section](https://accumulo.apache.org/blog/2021/07/08/external-compactions.html#ingesting-data), in that section look for the compaction queued plot and the description under it. We also have documentation that [briefly mentions these metrics exists](https://github.com/apache/accumulo-website/blob/next-release/_docs-2/administration/compaction.md#metrics), however it does not give any information about how to use them. Would these metrics meet your needs? If your are looking for detailed info about what is qeueud (like tablets and files to compact, which subject to change at any time before it runs like Dave mentioned) then would possibly need new APIs
to expose this information to the shell.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@accumulo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [accumulo] dlmarion commented on issue #2561: Provide Insight into queued compactions
Posted by GitBox <gi...@apache.org>.
dlmarion commented on issue #2561:
URL: https://github.com/apache/accumulo/issues/2561#issuecomment-1064239146
IIRC, the thing that is queued is that a tablet needs compacting. The actual details, which files are going to be compacted, are determined later when it's going to be run. Something to keep in mind is that if external compactions are enabled, then a queued compaction on a tserver may not get run on the tserver.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@accumulo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [accumulo] EdColeman commented on issue #2561: Provide Insight into queued compactions
Posted by GitBox <gi...@apache.org>.
EdColeman commented on issue #2561:
URL: https://github.com/apache/accumulo/issues/2561#issuecomment-1065315737
+1 for leveraging metrics. If this information is useful (and I think it is) making it externally available via metrics makes it possible for monitoring, alerting and possibly trending. While it could be useful to have the values available via the shell during troubleshooting and development - operators should not need to use the shell to perform routine monitoring.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@accumulo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org