You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@ozone.apache.org by "Krishna Kumar Asawa (Jira)" <ji...@apache.org> on 2023/08/02 10:29:00 UTC

[jira] [Assigned] (HDDS-4689) Autoclose pipeline after 'n' containers to distribute pipeline and containers over multiple datanodes

     [ https://issues.apache.org/jira/browse/HDDS-4689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Krishna Kumar Asawa reassigned HDDS-4689:
-----------------------------------------

    Assignee: Nandakumar  (was: Mukul Kumar Singh)

> Autoclose pipeline after 'n' containers to distribute pipeline and containers over multiple datanodes
> -----------------------------------------------------------------------------------------------------
>
>                 Key: HDDS-4689
>                 URL: https://issues.apache.org/jira/browse/HDDS-4689
>             Project: Apache Ozone
>          Issue Type: Bug
>          Components: SCM
>            Reporter: Mukul Kumar Singh
>            Assignee: Nandakumar
>            Priority: Major
>
> Currently, Ozone pipelines are long-lived i.e. a pipeline is normally on 3 DN's and it stays there till the pipeline fails or the DN restarts.
> This Jira proposes to close the pipeline after let's say 20 containers have been created and then closed on a pipeline. Once the pipeline is closed, the DN's are released and a new pipeline can be created using the set of available nodes during that time.
> This patch will hopefully help in increasing the skew of the containers on the DN's and will help in error recovery and data loss cases when 3 DN's are lost.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org