[jira] [Commented] (HDFS-6929) NN periodically unlinks lazy persist files with missing replicas from namespace

["Jitendra Nath Pandey (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HDFS-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14109830#comment-14109830 ] 

Jitendra Nath Pandey commented on HDFS-6929:
--------------------------------------------

Does this patch add the global config to disable the scrubbing of corrupted lazy-persist files or is it planned for a later patch?

> NN periodically unlinks lazy persist files with missing replicas from namespace
> -------------------------------------------------------------------------------
>
>                 Key: HDFS-6929
>                 URL: https://issues.apache.org/jira/browse/HDFS-6929
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: datanode
>            Reporter: Arpit Agarwal
>            Assignee: Arpit Agarwal
>             Fix For: HDFS-6581
>
>         Attachments: HDFS-6929.01.patch
>
>
> Occasional data loss is expected when using the lazy persist flag due to node restarts. The NN will optionally unlink lazy persist files from the namespace to avoid them from showing up as corrupt files.
> This behavior can be turned off with a global option. In the future this may be made a per-file option controllable by the client.



--
This message was sent by Atlassian JIRA
(v6.2#6252)