[jira] [Created] (FLINK-8148) Test instability in YarnFileStageTest

["Nico Kruber (JIRA)" <ji...@apache.org>]

Nico Kruber created FLINK-8148:
----------------------------------

             Summary: Test instability in YarnFileStageTest
                 Key: FLINK-8148
                 URL: https://issues.apache.org/jira/browse/FLINK-8148
             Project: Flink
          Issue Type: Bug
          Components: Tests, YARN
    Affects Versions: 1.4.0
            Reporter: Nico Kruber
            Assignee: Nico Kruber
            Priority: Critical


{code}
Running org.apache.flink.yarn.YarnFileStageTestS3ITCase
Tests run: 3, Failures: 1, Errors: 0, Skipped: 1, Time elapsed: 13.152 sec <<< FAILURE! - in org.apache.flink.yarn.YarnFileStageTestS3ITCase
testRecursiveUploadForYarnS3(org.apache.flink.yarn.YarnFileStageTestS3ITCase)  Time elapsed: 8.515 sec  <<< FAILURE!
java.lang.AssertionError: null
	at org.junit.Assert.fail(Assert.java:86)
	at org.junit.Assert.assertTrue(Assert.java:41)
	at org.junit.Assert.assertFalse(Assert.java:64)
	at org.junit.Assert.assertFalse(Assert.java:74)
	at org.apache.flink.yarn.YarnFileStageTestS3ITCase.testRecursiveUploadForYarn(YarnFileStageTestS3ITCase.java:171)
	at org.apache.flink.yarn.YarnFileStageTestS3ITCase.testRecursiveUploadForYarnS3(YarnFileStageTestS3ITCase.java:192)
{code}

from https://travis-ci.org/apache/flink/jobs/305861539

{{YarnFileStageTestS3ITCase.testRecursiveUploadForYarn}} verifies that the test directory used is cleaned up by {{YarnFileStageTest.testCopyFromLocalRecursive}} which should clean up the directory (in a {{finally}} block). However, for S3, we may not always see our own deletes.

Quoting from https://aws.amazon.com/s3/faqs/ here:
{quote}Q: What data consistency model does Amazon S3 employ?
Amazon S3 buckets in all Regions provide read-after-write consistency for PUTS of new objects and eventual consistency for overwrite PUTS and DELETES.{quote}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)