[jira] [Created] (HDFS-15760) Validate the target indices in ErasureCoding worker in reconstruction process

["Uma Maheswara Rao G (Jira)" <ji...@apache.org>]

Uma Maheswara Rao G created HDFS-15760:
------------------------------------------

             Summary: Validate the target indices in ErasureCoding worker in reconstruction process
                 Key: HDFS-15760
                 URL: https://issues.apache.org/jira/browse/HDFS-15760
             Project: Hadoop HDFS
          Issue Type: Improvement
          Components: ec
    Affects Versions: 3.4.0
            Reporter: Uma Maheswara Rao G


As we have seen issues like 
 # HDFS-15186
 # HDFS-14768

It is a good idea to validate the indices at the ECWorker side and skip the unintended in indices from target list.

Both of the issues triggered because, NN accidentally scheduled for reconstruction in decom process due to busy node. We have fixed to make sure NN considers busy nodes as live replicas. However, it may be good idea to safe gaud the condition at ECWorker also in case if any other condition triggers and that leads ECWroker to calculate the indices similar the above issues, then EC function returns wrong o/p.  I think it's ok to recover only the missing indices from the given src indices.

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org