You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kudu.apache.org by "Andrew Wong (Jira)" <ji...@apache.org> on 2020/06/02 21:42:00 UTC
[jira] [Commented] (KUDU-1728) Parallelize tablet copy operations
[ https://issues.apache.org/jira/browse/KUDU-1728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17124338#comment-17124338 ]
Andrew Wong commented on KUDU-1728:
-----------------------------------
To get a sense for how serial this process is, you can walk through {{TabletCopyClient::DownloadBlocks}} and note how we download and subsequently write a single block at a time. While this doesn't incur an fsync until all blocks are downloaded, on account of the block manager transaction, we could still probably push this a bit and try requesting more blocks be sent in parallel.
> Parallelize tablet copy operations
> ----------------------------------
>
> Key: KUDU-1728
> URL: https://issues.apache.org/jira/browse/KUDU-1728
> Project: Kudu
> Issue Type: Bug
> Components: consensus, tablet
> Reporter: Mike Percy
> Priority: Major
> Labels: roadmap-candidate
>
> Parallelize tablet copy operations. Right now all data is copied serially. We may want to consider throttling on either side if we want to budget IO.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)