You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2019/06/18 23:44:00 UTC

[jira] [Created] (SPARK-28101) Fix Flaky Test: `InputStreamsSuit.Modified files are correctly detected`

Dongjoon Hyun created SPARK-28101:
-------------------------------------

             Summary: Fix Flaky Test: `InputStreamsSuit.Modified files are correctly detected`
                 Key: SPARK-28101
                 URL: https://issues.apache.org/jira/browse/SPARK-28101
             Project: Spark
          Issue Type: Sub-task
          Components: DStreams, Tests
    Affects Versions: 3.0.0
            Reporter: Dongjoon Hyun


{code}
$ build/sbt "streaming/testOnly *.InputStreamsSuite"
[info] - Modified files are correctly detected. *** FAILED *** (134 milliseconds)
[info]   Set("renamed") did not equal Set() (InputStreamsSuite.scala:312)
[info]   org.scalatest.exceptions.TestFailedException:
{code}

{code}
Getting new files for time 1560896662000, ignoring files older than 1560896659679
file:/Users/dongjoon/PRS/SPARK-STEAM-TEST/target/tmp/spark-f34c23f6-9fb4-4ded-87f3-8cdfb57d85a6/streaming/subdir/renamed.txt not selected as mod time 1560896662679 > current time 1560896662000
file:/Users/dongjoon/PRS/SPARK-STEAM-TEST/target/tmp/spark-f34c23f6-9fb4-4ded-87f3-8cdfb57d85a6/streaming/subdir/existing ignored as mod time 1560896657679 <= ignore time 1560896659679
Finding new files took 0 ms
New files at time 1560896662000 ms:
{code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org