You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Felix N (Jira)" <ji...@apache.org> on 2021/04/13 04:00:00 UTC

[jira] [Created] (HADOOP-17634) Fedbalance only copies data partially when there's existing opened file

Felix N created HADOOP-17634:
--------------------------------

             Summary: Fedbalance only copies data partially when there's existing opened file
                 Key: HADOOP-17634
                 URL: https://issues.apache.org/jira/browse/HADOOP-17634
             Project: Hadoop Common
          Issue Type: Bug
            Reporter: Felix N


If there are opened files when fedbalance is run and data is being written to these files, fedbalance might skip the newly written data.

Steps to recreate the issue:
 # Create a dummy file /test/file with some data: {{echo "start" | hdfs dfs -appendToFile /test/file}}
 # Start writing to the file: {{hdfs dfs -appendToFile /test/file}} but do not stop writing
 # Run fedbalance: {{hadoop fedbalance submit hdfs://ns1/test hdfs://ns2/test}}
 # Write something to the file while fedbalance is running, "end" for example, then stop writing
 # After fedbalance is done, {{hdfs://ns2/test/file}} should only contain "start" while {{hdfs://ns1/user/hadoop/.Trash/Current/test/file}} contains "start\nend"

Fedbalance is run with default configs and arguments so no diff should happen.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org