You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Yang Yun (Jira)" <ji...@apache.org> on 2020/05/27 02:59:00 UTC
[jira] [Updated] (HDFS-15377) BlockScanner scans one part per
round, expect full scans after several rounds
[ https://issues.apache.org/jira/browse/HDFS-15377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yang Yun updated HDFS-15377:
----------------------------
Description:
For reducing disk IO, one block is separated to multiple parts, BlockScanner scans only one part per round. Expect that after several rounds, the full block should be scanned
Add a new option "dfs.block.scanner.part.size". the maximum data size per scan by the block scanner. this value should be the multiple of chunk size, for example, 512, 1024, 4096 ...
Default value is -1, will disable partial scan.
was:For reducing disk IO, one block is separated to multiple parts, BlockScanner scans only one part per round. Expect that after several rounds, the full block should be scanned.
> BlockScanner scans one part per round, expect full scans after several rounds
> -----------------------------------------------------------------------------
>
> Key: HDFS-15377
> URL: https://issues.apache.org/jira/browse/HDFS-15377
> Project: Hadoop HDFS
> Issue Type: Improvement
> Reporter: Yang Yun
> Assignee: Yang Yun
> Priority: Minor
>
> For reducing disk IO, one block is separated to multiple parts, BlockScanner scans only one part per round. Expect that after several rounds, the full block should be scanned
> Add a new option "dfs.block.scanner.part.size". the maximum data size per scan by the block scanner. this value should be the multiple of chunk size, for example, 512, 1024, 4096 ...
> Default value is -1, will disable partial scan.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org