[jira] [Created] (HDFS-8428) Erasure Coding: Fix the NullPointerException when deleting file

["Yi Liu (JIRA)" <ji...@apache.org>]

Yi Liu created HDFS-8428:
----------------------------

             Summary: Erasure Coding: Fix the NullPointerException when deleting file
                 Key: HDFS-8428
                 URL: https://issues.apache.org/jira/browse/HDFS-8428
             Project: Hadoop HDFS
          Issue Type: Sub-task
            Reporter: Yi Liu
            Assignee: Yi Liu


In HDFS, when removing some file, NN will also remove all its blocks from {{BlocksMap}}, and send {{DNA_INVALIDATE}} (invalidate blocks) commands to datanodes.  After datanodes successfully delete the block replicas, will report {{DELETED_BLOCK}} to NameNode.

snippet code logic in {{BlockManager#processIncrementalBlockReport}} is as following
{code}
case DELETED_BLOCK:
        removeStoredBlock(storageInfo, getStoredBlock(rdbi.getBlock()), node);
        ...
{code}
{code}
private void removeStoredBlock(DatanodeStorageInfo storageInfo, Block block,
      DatanodeDescriptor node) {
    if (shouldPostponeBlocksFromFuture &&
        namesystem.isGenStampInFuture(block)) {
      queueReportedBlock(storageInfo, block, null,
          QUEUE_REASON_FUTURE_GENSTAMP);
      return;
    }
    removeStoredBlock(getStoredBlock(block), node);
  }
{code}

In EC branch, we add {{getStoredBlock}}. There is {{NullPointerException}} when handling {{DELETED_BLOCK}} of incrementalBlockReport from DataNode after delete a file, since the block is already removed, we need to check.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)