You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@kudu.apache.org by "Andrew Wong (JIRA)" <ji...@apache.org> on 2018/01/31 20:56:00 UTC

[jira] [Created] (KUDU-2278) Improve IO for writing deltas

Andrew Wong created KUDU-2278:
---------------------------------

             Summary: Improve IO for writing deltas
                 Key: KUDU-2278
                 URL: https://issues.apache.org/jira/browse/KUDU-2278
             Project: Kudu
          Issue Type: Improvement
          Components: cfile, tablet
            Reporter: Andrew Wong


Today, writing new deltas entails rewriting entire tablet metadata files in order to track the newly-created block ids. Even if the delta were on the order of kilobytes, the tablet metadata files could be on the order of megabytes, so the relative cost for this small amount of data is quite high, considering the amount of the metadata.

This could be improved by batching such delta flushes, or by revamping tablet metadata entirely to batch any operations that require metadata updates.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)