You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "Colin Patrick McCabe (JIRA)" <ji...@apache.org> on 2014/11/24 05:36:12 UTC
[jira] [Created] (HDFS-7430) Refactor the BlockScanner to use O(1)
memory and use multiple threads
Colin Patrick McCabe created HDFS-7430:
------------------------------------------
Summary: Refactor the BlockScanner to use O(1) memory and use multiple threads
Key: HDFS-7430
URL: https://issues.apache.org/jira/browse/HDFS-7430
Project: Hadoop HDFS
Issue Type: Improvement
Affects Versions: 2.7.0
Reporter: Colin Patrick McCabe
We should update the BlockScanner to use a constant amount of memory by keeping track of what block was scanned last, rather than by tracking the scan status of all blocks in memory. Also, instead of having just one thread, we should have a verification thread per hard disk (or other volume), scanning at a configurable rate of bytes per second.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)