[jira] [Created] (HDDS-6235) Empty KeyValueContainers cannot be replicated

["Ethan Rose (Jira)" <ji...@apache.org>]

Ethan Rose created HDDS-6235:
--------------------------------

             Summary: Empty KeyValueContainers cannot be replicated
                 Key: HDDS-6235
                 URL: https://issues.apache.org/jira/browse/HDDS-6235
             Project: Apache Ozone
          Issue Type: Bug
          Components: Ozone Datanode
            Reporter: Ethan Rose
            Assignee: Ethan Rose


An empty KeyValueContainer will have an empty chunks directory. TarContainerPacker#pack recurses into directories adding files into containers, but if the chunks directory is empty, it will not be included in the tar. The receiver will unpack the tar successfully, but the resulting container will not have a chunks directory. After this, the container will not be able to replicated further, as the tar packing step requires all container pieces to be present on disk. The container may also be marked unhealthy by the background container scanner. This issue is more likely to occur due to HDDS-5359, which causes many empty containers to be tracked by SCM indefinitely.

This Jira will fix the issue with the tar packer, and also add a repair step on datanode startup to create the chunks directory for containers that do not have one. This step should be a quick addition to datanode startup that already iterates all the containers, and should not impact startup time.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org