You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Bharat Viswanadham (JIRA)" <ji...@apache.org> on 2018/05/12 16:59:00 UTC

[jira] [Commented] (HDDS-48) ContainerIO - Storage Management

    [ https://issues.apache.org/jira/browse/HDDS-48?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16473197#comment-16473197 ] 

Bharat Viswanadham commented on HDDS-48:
----------------------------------------

Attached the design document of Datanode Disk Layout refactoring.

Pls have a look at it and provide your comments. 

 

> ContainerIO - Storage Management
> --------------------------------
>
>                 Key: HDDS-48
>                 URL: https://issues.apache.org/jira/browse/HDDS-48
>             Project: Hadoop Distributed Data Store
>          Issue Type: Improvement
>            Reporter: Hanisha Koneru
>            Assignee: Hanisha Koneru
>            Priority: Major
>         Attachments: ContainerIO-StorageManagement-DesignDoc.pdf, HDDS DataNode Disk Layout.pdf
>
>
> We propose refactoring the HDDS DataNode IO path to enforce clean separation between the Container management and the Storage layers. All components requiring access to HDDS containers on a Datanode should do so via this Storage layer.
> The proposed Storage layer would be responsible for end-to-end disk and volume management. This involves running disk checks and detecting disk failures, distributing data across disks as per the configured policy, collecting performance statistics and verifying the integrity of the data. 
> Attached Design Doc gives an overview of the proposed class diagram.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org