You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Felix N (Jira)" <ji...@apache.org> on 2021/04/13 04:00:00 UTC
[jira] [Created] (HADOOP-17634) Fedbalance only copies data
partially when there's existing opened file
Felix N created HADOOP-17634:
--------------------------------
Summary: Fedbalance only copies data partially when there's existing opened file
Key: HADOOP-17634
URL: https://issues.apache.org/jira/browse/HADOOP-17634
Project: Hadoop Common
Issue Type: Bug
Reporter: Felix N
If there are opened files when fedbalance is run and data is being written to these files, fedbalance might skip the newly written data.
Steps to recreate the issue:
# Create a dummy file /test/file with some data: {{echo "start" | hdfs dfs -appendToFile /test/file}}
# Start writing to the file: {{hdfs dfs -appendToFile /test/file}} but do not stop writing
# Run fedbalance: {{hadoop fedbalance submit hdfs://ns1/test hdfs://ns2/test}}
# Write something to the file while fedbalance is running, "end" for example, then stop writing
# After fedbalance is done, {{hdfs://ns2/test/file}} should only contain "start" while {{hdfs://ns1/user/hadoop/.Trash/Current/test/file}} contains "start\nend"
Fedbalance is run with default configs and arguments so no diff should happen.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org