You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Aravindan Vijayan (Jira)" <ji...@apache.org> on 2020/03/17 05:08:00 UTC

[jira] [Updated] (HDDS-3214) Unhealthy datanodes repeatedly participate in pipeline creation

     [ https://issues.apache.org/jira/browse/HDDS-3214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Aravindan Vijayan updated HDDS-3214:
------------------------------------
    Summary: Unhealthy datanodes repeatedly participate in pipeline creation  (was: unhealthy datanodes repeatedly participate in pipeline creation)

> Unhealthy datanodes repeatedly participate in pipeline creation
> ---------------------------------------------------------------
>
>                 Key: HDDS-3214
>                 URL: https://issues.apache.org/jira/browse/HDDS-3214
>             Project: Hadoop Distributed Data Store
>          Issue Type: Bug
>            Reporter: Nilotpal Nandi
>            Priority: Major
>              Labels: fault_injection
>
> steps taken :
> 1) Mounted noise injection FUSE on all datanodes
> 2) Selected 1 datanode from each open pipeline (factor=3)
> 3) Injected WRITE FAILURE noise with error code - ENOENT on "hdds.datanode.dir" path of list of datanodes selected in step 2)
> 4) start PUT key operation of size  32 MB.
>  
> Observation :
> ----------------
>  # Commit failed, pipelines were moved to exclusion list.
>  # Client retries , new pipeline is created with same set of datanodes. Container creation fails as WRITE  FAILURE injection present.
>  # Pipeline is closed and the process is repeated for "ozone.client.max.retries" retries.
> Everytime, same set of datanodes are selected for pipeline creation which include 1 unhealthy datanode. 
> Expectation - pipeline should have been created by selecting 3 healthy  datanodes available.
>  
> cc - [~ljain]
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org