[jira] [Commented] (HDDS-4472) Pipeline Scrubber should delete open pipelines never reported by any dns

["Duong (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HDDS-4472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17624621#comment-17624621 ] 

Duong commented on HDDS-4472:
-----------------------------

Confirmed that even when Ratis directory is deleted, the pipeline is still functioning due to the fact that Ratis already open the logs file, open files can be read/written normally after deleting. 

We have to restart the datanode service to make deleted ratis log make effect, yet in that case the node is already reported missing and the pipeline will be closed by SCM.

I'm closing this ticket for now. Please reopen for any further concerns or questions.



> Pipeline Scrubber should delete open pipelines never reported by any dns
> ------------------------------------------------------------------------
>
>                 Key: HDDS-4472
>                 URL: https://issues.apache.org/jira/browse/HDDS-4472
>             Project: Apache Ozone
>          Issue Type: Bug
>          Components: SCM
>    Affects Versions: 1.1.0
>            Reporter: Shashikant Banerjee
>            Assignee: Duong
>            Priority: Major
>
> Currently, pipeline scrubber deletes pipelines in allocated state after timeout post safe mode exit. However, a pipeline can remain in open state but never gets reported by any of the constituent datanodes(cases where raft log directory is explicitly removed from all datanodes or none of the constituent datanode discover the raft log disk). In such cases, scrubber should delete such pipleines as well and free up the datanodes.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org