You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-dev@hadoop.apache.org by "Steve Vaughan (Jira)" <ji...@apache.org> on 2022/08/24 00:52:00 UTC

[jira] [Created] (HDFS-16740) Mini cluster test flakiness

Steve Vaughan created HDFS-16740:
------------------------------------

             Summary: Mini cluster test flakiness
                 Key: HDFS-16740
                 URL: https://issues.apache.org/jira/browse/HDFS-16740
             Project: Hadoop HDFS
          Issue Type: Improvement
          Components: hdfs, test
    Affects Versions: 3.4.0, 3.3.9
            Reporter: Steve Vaughan
            Assignee: Steve Vaughan


Mini clusters used during HDFS unit tests are reporting test failures that do not appear to be directly related to submitted changes.  The failures are the result of either interactions between tests run in parallel, or tests which share common disk space for tests.  In all cases, the tests can be run individually serially without any errors.  Addressing this issue will simplify future submissions by eliminating the confusion introduced by these unrelated test failures.

We can apply lessons recently from TestRollingUpgrade, which was recently patched to unblock a recent submission.  The fixes involved changing the HDFS configuration to use temporary disk space for each individual tests, and using try-with-resources to ensure that clusters were shutdown cleanly.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org