You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "Supratim Deka (JIRA)" <ji...@apache.org> on 2019/02/22 06:40:00 UTC
[jira] [Created] (HDDS-1163) Basic framework for Ozone Data
Scrubber
Supratim Deka created HDDS-1163:
-----------------------------------
Summary: Basic framework for Ozone Data Scrubber
Key: HDDS-1163
URL: https://issues.apache.org/jira/browse/HDDS-1163
Project: Hadoop Distributed Data Store
Issue Type: Sub-task
Components: Ozone Datanode
Reporter: Supratim Deka
Assignee: Supratim Deka
Included in the scope:
1. Background scanner thread to iterate over container set and dispatch check tasks for individual containers
2. Fixed rate scheduling - dispatch tasks at a pre-determined rate (for example 1 container/s)
3. Check disk layout of Container - basic check for integrity of the directory hierarchy inside the container, include chunk directory and metadata directories
4. Check container file - basic sanity checks for the container metafile
5. Check Block Database - iterate over entries in the container block database and check for the existence and accessibility of the chunks for each block
Not in scope (will be done as separate subtasks):
1. Dynamic scheduling/pacing of background scan based on system load and available resources.
2. Detection and handling of orphan chunks
3. Checksum verification for Chunks
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org