[jira] [Created] (HDFS-16105) Edit log corruption due to mismatch between fileId and path

["Hui Fei (Jira)" <ji...@apache.org>]

Hui Fei created HDFS-16105:
------------------------------

             Summary: Edit log corruption due to mismatch between fileId and path
                 Key: HDFS-16105
                 URL: https://issues.apache.org/jira/browse/HDFS-16105
             Project: Hadoop HDFS
          Issue Type: Bug
          Components: namanode
    Affects Versions: 3.3.1, 3.2.2
            Reporter: Hui Fei


We do stress testing in FUSE with HDFS, Standby Namenode crashes.

The log is following

{quote}

2021-06-25 17:13:02,953 ERROR org.apache.hadoop.hdfs.server.namenode.FSEditLogLoader: Encountered exception on operation AddBlockOp [path=/xxx/fiotest_write.354.46, penultimateBlock=xxx, lastBlock=xxx, numOfBytes=0}, RpcClientId=, RpcCallId=-2]
java.io.FileNotFoundException: File /xxx/fiotest_write.354.46 does not exist.

{quote}

The following steps can reproduce it (Illegal writes).

1 create file A (fileId X) (1st block is being written)

2 rename file A to file B(stile fileId X)

3 continue to write file A(using above the same outputstream, 2nd block need to be written)

4 standby namenode load the above edits and would crash



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org