[jira] [Created] (HBASE-28278) FileSystem.getFileStatus can not get the correct file length for files which are being written

["Duo Zhang (Jira)" <ji...@apache.org>]

Duo Zhang created HBASE-28278:
---------------------------------

             Summary: FileSystem.getFileStatus can not get the correct file length for files which are being written
                 Key: HBASE-28278
                 URL: https://issues.apache.org/jira/browse/HBASE-28278
             Project: HBase
          Issue Type: Bug
          Components: Replication
            Reporter: Duo Zhang


When reading from a opening WAL file in replication, we will use FileSystem.getFileStatus to get the file length and then use it to calculate the trailer's position. But if a file is being written, you can not get the correct length from namenode, you could even get a 0 if the file has only one block(for most WAL files).

This will not lead to real data loss as we do not rely on the file length to determine whether we should read the file, but since it will mess up the trailer's position, it may lead to incorrect metrics, like un cleanly closed wal files, and fail some UTs, and also output some confusing logs.

We should find a way to make it better.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)