You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kudu.apache.org by "Andrew Wong (Jira)" <ji...@apache.org> on 2020/06/02 21:42:00 UTC

[jira] [Commented] (KUDU-1728) Parallelize tablet copy operations

    [ https://issues.apache.org/jira/browse/KUDU-1728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17124338#comment-17124338 ] 

Andrew Wong commented on KUDU-1728:
-----------------------------------

To get a sense for how serial this process is, you can walk through {{TabletCopyClient::DownloadBlocks}} and note how we download and subsequently write a single block at a time. While this doesn't incur an fsync until all blocks are downloaded, on account of the block manager transaction, we could still probably push this a bit and try requesting more blocks be sent in parallel.

> Parallelize tablet copy operations
> ----------------------------------
>
>                 Key: KUDU-1728
>                 URL: https://issues.apache.org/jira/browse/KUDU-1728
>             Project: Kudu
>          Issue Type: Bug
>          Components: consensus, tablet
>            Reporter: Mike Percy
>            Priority: Major
>              Labels: roadmap-candidate
>
> Parallelize tablet copy operations. Right now all data is copied serially. We may want to consider throttling on either side if we want to budget IO.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)