You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@kudu.apache.org by "Adar Dembo (JIRA)" <ji...@apache.org> on 2018/02/26 19:09:00 UTC

[jira] [Commented] (KUDU-2278) Improve IO for writing deltas

    [ https://issues.apache.org/jira/browse/KUDU-2278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16377387#comment-16377387 ] 

Adar Dembo commented on KUDU-2278:
----------------------------------

The same is true for flushing an MRS, right? I would imagine that like MRS flushes, DMS flushes are deferred until the DMS is sufficiently "meaty". Is the DMS flush policy different than the MRS flush policy?


> Improve IO for writing deltas
> -----------------------------
>
>                 Key: KUDU-2278
>                 URL: https://issues.apache.org/jira/browse/KUDU-2278
>             Project: Kudu
>          Issue Type: Improvement
>          Components: cfile, tablet
>            Reporter: Andrew Wong
>            Priority: Major
>
> Today, writing new deltas entails rewriting entire tablet metadata files in order to track the newly-created block ids. Even if the delta were on the order of kilobytes, the tablet metadata files could be on the order of megabytes, so the relative cost for this small amount of data is quite high, considering the amount of the metadata.
> This could be improved by batching such delta flushes, or by revamping tablet metadata entirely to batch any operations that require metadata updates.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)