[jira] [Created] (KUDU-1764) Log block manager leaks disk space at the end of full containers

["Todd Lipcon (JIRA)" <ji...@apache.org>]

Todd Lipcon created KUDU-1764:
---------------------------------

             Summary: Log block manager leaks disk space at the end of full containers
                 Key: KUDU-1764
                 URL: https://issues.apache.org/jira/browse/KUDU-1764
             Project: Kudu
          Issue Type: Bug
          Components: fs
    Affects Versions: 1.0.0, 1.1.0
            Reporter: Todd Lipcon
            Assignee: Adar Dembo
            Priority: Critical


阿香 reported on the mailing list that his total disk space usage is significantly more than the metric reported by the LBM usage metric.

Adar and I investigated and found the likely cause: when writing to LBM containers, the LBM preallocates disk space at the end of the file where the next blocks will be written. However, the preallocated space can extend past the "full" container size, and when the container is declared full, we don't truncate or punch away that preallocated space.

Thus, even when a container has been mostly punched out, we still end up with ~15-30MB of wasted disk space at the end.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)