You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Ethan Rose (Jira)" <ji...@apache.org> on 2025/02/04 23:57:00 UTC

[jira] [Created] (HDDS-12206) Create an `ozone debug` command to run checks on all replicas

Ethan Rose created HDDS-12206:
---------------------------------

             Summary: Create an `ozone debug` command to run checks on all replicas
                 Key: HDDS-12206
                 URL: https://issues.apache.org/jira/browse/HDDS-12206
             Project: Apache Ozone
          Issue Type: Improvement
            Reporter: Ethan Rose


Add a command that can be used to check the state of all replicas in a portion of the namespace. For example, something like {{ozone debug replicas verify <URI>... [--checksums] [--metadata] [--padding]}} where:
 * {{ozone debug replicas verify}} does one iteration through the namespace provided in {{{}<URI>{}}}. It may use multiple threads to work through all the keys.
 * For each key under {{{}<URI>{}}}, the client does checks on all the replicas based on the flags provided. At least one flag is required.
 * Client uses the block info to checks on the replicas as specified by the flags:
 ** {{{}--checksums{}}}: Download data from the datanode to do client side checksum verification. Replaces the {{read-replicas}} commad.
 ** {{{}--padding{}}}: Check for EC missing padding. Replaces the {{find-missing-padding}} command and is a no-op for non-EC keys.
 ** {{{}--metadata{}}}: Only check block existence by {{GetBlock}} calls to the datanodes without downloading data.

More flags can be added as we come up with new checks that would be good to have. The command should output results in json format grouped by key and the results of the checks run. It may optionally omit results from keys with no issues.

This would replace other {{ozone debug}} tools like {{find-missing-padding}} and {{read-replicas.}}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org