You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Anu Engineer (JIRA)" <ji...@apache.org> on 2018/05/14 18:44:00 UTC
[jira] [Updated] (HDDS-58) Optimize number of allocated block rpc
by aggregating multiple block allocation requests
[ https://issues.apache.org/jira/browse/HDDS-58?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Anu Engineer updated HDDS-58:
-----------------------------
Summary: Optimize number of allocated block rpc by aggregating multiple block allocation requests (was: Ozone: Optimize number of allocated block rpc by aggregating multiple block allocation requests)
> Optimize number of allocated block rpc by aggregating multiple block allocation requests
> ----------------------------------------------------------------------------------------
>
> Key: HDDS-58
> URL: https://issues.apache.org/jira/browse/HDDS-58
> Project: Hadoop Distributed Data Store
> Issue Type: Improvement
> Components: Ozone Manager
> Affects Versions: 0.2.1
> Reporter: Mukul Kumar Singh
> Assignee: Mukul Kumar Singh
> Priority: Major
> Fix For: 0.2.1
>
> Attachments: HDFS-12838-HDFS-7240.001.patch, HDFS-12838-HDFS-7240.002.patch, HDFS-12838-HDFS-7240.003.patch, HDFS-12838-HDFS-7240.004.patch, HDFS-12838-HDFS-7240.005.patch, HDFS-12838-HDFS-7240.006.patch
>
>
> Currently KeySpaceManager allocates multiple blocks by sending multiple block allocation requests over the RPC. This can be optimized to aggregate multiple block allocation request over one rpc.
> {code}
> while (requestedSize > 0) {
> long allocateSize = Math.min(scmBlockSize, requestedSize);
> AllocatedBlock allocatedBlock =
> scmBlockClient.allocateBlock(allocateSize, type, factor);
> KsmKeyLocationInfo subKeyInfo = new KsmKeyLocationInfo.Builder()
> .setContainerName(allocatedBlock.getPipeline().getContainerName())
> .setBlockID(allocatedBlock.getKey())
> .setShouldCreateContainer(allocatedBlock.getCreateContainer())
> .setIndex(idx++)
> .setLength(allocateSize)
> .setOffset(0)
> .build();
> locations.add(subKeyInfo);
> requestedSize -= allocateSize;
> }
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org