You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "jojochuang (via GitHub)" <gi...@apache.org> on 2026/04/02 01:24:47 UTC
[PR] HDDS-14960. OM Web UI dashboard for Ozone Snapshot [ozone]
jojochuang opened a new pull request, #10027:
URL: https://github.com/apache/ozone/pull/10027
## What changes were proposed in this pull request?
HDDS-14960. OM Web UI dashboard for Ozone Snapshot
Please describe your PR in detail:
* Create a Ozone Snapshot dashboard tab in OM Web UI, that displays:
1. Usage statstics – number of active, deleted snapshots, size of current snapshot cache.
2. List of snapshot diff jobs – status text, progress, creation time; search&sort capabilities.
3. Snapshot internal metrics in OmSnapshotInternalMetrics.
The implementation includes:
1. Frontend code to display usage statistics, snapshot diff jobs, internal metrics, code to support search and sort capabilities.
2. Backend code: SnapshotDiffManager implements SnapshotDiffManagerMXBean and register it with the runtime.
3. Test code to ensure the MXBean is registered correctly, and the values is expected.
SnapshotDiffJob getCodec() renamed to codec() to avoid clashes with JMXBean conventions.
## What is the link to the Apache JIRA
https://issues.apache.org/jira/browse/HDDS-14960
## How was this patch tested?
Unit tests, manually inspected frontend web UI after executing this command (screen shot attached)
```
ozone sh volume create vol1
ozone sh bucket create vol1/bucket1
ozone sh snapshot create vol1/bucket1 snap1
ozone sh key put vol1/bucket1/key1 /etc/krb5.conf
ozone sh snapshot create vol1/bucket1 snap2
ozone sh snapshot diff vol1/bucket1 snap1 snap2
ozone sh snapshot lsDiff vol1/bucket1 -a
ozone sh key delete vol1/bucket1/key1
ozone sh snapshot create vol1/bucket1 snap3
ozone sh snapshot diff vol1/bucket1 snap2 snap3
ozone sh snapshot diff vol1/bucket1 snap1 snap3
ozone sh snapshot lsDiff vol1/bucket1 -a```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
Re: [PR] HDDS-14960. OM Web UI dashboard for Ozone Snapshot [ozone]
Posted by "errose28 (via GitHub)" <gi...@apache.org>.
errose28 commented on PR #10027:
URL: https://github.com/apache/ozone/pull/10027#issuecomment-4193590095
Hi @jojochuang I don't think we should duplicate metrics on the web UIs. The page will become overloaded with too much information which Grafana can display better. I suggest making a Grafana dashboard for snapdiff (which AI can also do easily) which contains `Usage statstics`, `Snapshot internal metrics`, and any other relevant metrics.
The list of snapdiff jobs is categorical information so that makes sense to put in the Web UI for now, since Recon is not pulling this information.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
Re: [PR] HDDS-14960. OM Web UI dashboard for Ozone Snapshot [ozone]
Posted by "jojochuang (via GitHub)" <gi...@apache.org>.
jojochuang commented on PR #10027:
URL: https://github.com/apache/ozone/pull/10027#issuecomment-4194719106
Updated. This is the current screenshot.
<img width="1702" height="389" alt="Screenshot 2026-04-06 at 1 08 00 PM" src="https://github.com/user-attachments/assets/d01a7226-de94-46a4-816b-aa3826d7e45f" />
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
Re: [PR] HDDS-14960. OM Web UI dashboard for Ozone Snapshot [ozone]
Posted by "smengcl (via GitHub)" <gi...@apache.org>.
smengcl commented on PR #10027:
URL: https://github.com/apache/ozone/pull/10027#issuecomment-4217622982
Is this a subset of https://github.com/apache/ozone/pull/10055 ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
Re: [PR] HDDS-14960. OM Web UI dashboard for Ozone Snapshot [ozone]
Posted by "smengcl (via GitHub)" <gi...@apache.org>.
smengcl commented on PR #10027:
URL: https://github.com/apache/ozone/pull/10027#issuecomment-4217770513
On a side note, the search box does not quite work as one would expect. It only filters the currently displayed entries, not the entire set. At least this is the case on SCM Web UI Node Status section as I tried earlier. Filed HDDS-15007
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
Re: [PR] HDDS-14960. OM Web UI dashboard for Ozone Snapshot [ozone]
Posted by "smengcl (via GitHub)" <gi...@apache.org>.
smengcl commented on PR #10027:
URL: https://github.com/apache/ozone/pull/10027#issuecomment-4238574515
Thanks @jojochuang for the PR. Thanks @sadanand48 and @errose28 for the reviews.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
Re: [PR] HDDS-14960. OM Web UI dashboard for Ozone Snapshot [ozone]
Posted by "jojochuang (via GitHub)" <gi...@apache.org>.
jojochuang commented on PR #10027:
URL: https://github.com/apache/ozone/pull/10027#issuecomment-4194115274
> don't think we should duplicate metrics on the web UIs. The page will become overloaded with too much information which Grafana can display better. I suggest making a Grafana dashboard for snapdiff (which AI can also do easily) which contains Usage statstics, Snapshot internal metrics, and any other relevant metrics.
>
> The list of snapdiff jobs is categorical information so that makes sense to put in the Web UI for now, since Recon is not pulling this information.
I'll keep the list of snapshot diff jobs. We don't yet have the Grafana dashboards tracking Snapshot internal metrics, which is why I put it here initially. That being said, these internal metrics aren't that self explanatory. I would like to make a page that integrates these metrics and present in a way that helps administrators understand, because the internals of Snapshots are asynchronous.
Also reminded me there are a few snapshot related metrics within DeletingServiceMetrics that should be included.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
Re: [PR] HDDS-14960. OM Web UI dashboard for Ozone Snapshot [ozone]
Posted by "jojochuang (via GitHub)" <gi...@apache.org>.
jojochuang commented on PR #10027:
URL: https://github.com/apache/ozone/pull/10027#issuecomment-4201289406
https://issues.apache.org/jira/browse/HDDS-13181 added the OM Snapshot internal metrics to Grafana.
It doesn't include numSnapshotSetProperties, numSnapshotSetPropertyFails, and no defragmentation metrics.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
Re: [PR] HDDS-14960. OM Web UI dashboard for Ozone Snapshot [ozone]
Posted by "smengcl (via GitHub)" <gi...@apache.org>.
smengcl merged PR #10027:
URL: https://github.com/apache/ozone/pull/10027
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
Re: [PR] HDDS-14960. OM Web UI dashboard for Ozone Snapshot [ozone]
Posted by "jojochuang (via GitHub)" <gi...@apache.org>.
jojochuang commented on PR #10027:
URL: https://github.com/apache/ozone/pull/10027#issuecomment-4217834337
> Is this a subset of https://github.com/apache/ozone/pull/10055 ? Or should this be merged first before that one. Looks to be the latter
Yes I want to implement these in steps.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org
Re: [PR] HDDS-14960. OM Web UI dashboard for Ozone Snapshot [ozone]
Posted by "sadanand48 (via GitHub)" <gi...@apache.org>.
sadanand48 commented on code in PR #10027:
URL: https://github.com/apache/ozone/pull/10027#discussion_r3039040898
##########
hadoop-ozone/ozone-manager/src/main/resources/webapps/ozoneManager/om-snapshots.html:
##########
@@ -0,0 +1,165 @@
+<!--
+ Licensed to the Apache Software Foundation (ASF) under one or more
+ contributor license agreements. See the NOTICE file distributed with
+ this work for additional information regarding copyright ownership.
+ The ASF licenses this file to You under the Apache License, Version 2.0
+ (the "License"); you may not use this file except in compliance with
+ the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License.
+-->
+<h1>Usage Statistics</h1>
+<table class="table table-bordered table-striped">
+ <thead>
+ <tr>
+ <th>Metric</th>
+ <th>Value</th>
+ </tr>
+ </thead>
+ <tbody>
+ <tr>
+ <td>Number of Active Snapshots</td>
+ <td>{{$ctrl.snapshotUsageMetrics.NumSnapshotActive}}</td>
Review Comment:
These metrics capture the num of active/deleted snapshots created since the last restart of OM. I think we should indicate that accordingly
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org