You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Imran Rashid (JIRA)" <ji...@apache.org> on 2017/03/16 02:55:42 UTC
[jira] [Commented] (SPARK-7420) Flaky test:
o.a.s.streaming.JobGeneratorSuite "Do not clear received block data too
soon"
[ https://issues.apache.org/jira/browse/SPARK-7420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15927385#comment-15927385 ]
Imran Rashid commented on SPARK-7420:
-------------------------------------
This just [failed again|https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74629/testReport/org.apache.spark.streaming.scheduler/JobGeneratorSuite/SPARK_6222__Do_not_clear_received_block_data_too_soon/]
{noformat}
sbt.ForkMain$ForkError: org.scalatest.exceptions.TestFailedDueToTimeoutException: The code passed to eventually never returned normally. Attempted 107 times over 10.248408676999999 seconds. Last failure message: getBlocksOfBatch(batchTime).nonEmpty was false.
at org.scalatest.concurrent.Eventually$class.tryTryAgain$1(Eventually.scala:420)
at org.scalatest.concurrent.Eventually$class.eventually(Eventually.scala:438)
at org.scalatest.concurrent.Eventually$.eventually(Eventually.scala:478)
at org.scalatest.concurrent.Eventually$class.eventually(Eventually.scala:336)
at org.scalatest.concurrent.Eventually$.eventually(Eventually.scala:478)
at org.apache.spark.streaming.scheduler.JobGeneratorSuite$$anonfun$1$$anonfun$apply$mcV$sp$1.org$apache$spark$streaming$scheduler$JobGeneratorSuite$$anonfun$$anonfun$$waitForBlocksToBeAllocatedToBatch$1(JobGeneratorSuite.scala:105)
at org.apache.spark.streaming.scheduler.JobGeneratorSuite$$anonfun$1$$anonfun$apply$mcV$sp$1$$anonfun$apply$1.apply$mcVI$sp(JobGeneratorSuite.scala:114)
at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:160)
at org.apache.spark.streaming.scheduler.JobGeneratorSuite$$anonfun$1$$anonfun$apply$mcV$sp$1.apply(JobGeneratorSuite.scala:111)
at org.apache.spark.streaming.scheduler.JobGeneratorSuite$$anonfun$1$$anonfun$apply$mcV$sp$1.apply(JobGeneratorSuite.scala:66)
at org.apache.spark.streaming.TestSuiteBase$class.withStreamingContext(TestSuiteBase.scala:279)
at ...
{noformat}
I'll also attach the relevant snippet from {{streaming/unit-test.log}}
> Flaky test: o.a.s.streaming.JobGeneratorSuite "Do not clear received block data too soon"
> -----------------------------------------------------------------------------------------
>
> Key: SPARK-7420
> URL: https://issues.apache.org/jira/browse/SPARK-7420
> Project: Spark
> Issue Type: Bug
> Components: Tests
> Affects Versions: 1.3.1, 1.4.0
> Reporter: Andrew Or
> Assignee: Tathagata Das
> Priority: Critical
> Labels: flaky-test
> Attachments: trimmed-unit-tests-74629.log
>
>
> {code}
> The code passed to eventually never returned normally. Attempted 18 times over 10.138036060000001 seconds. Last failure message: receiverTracker.hasUnallocatedBlocks was false.
> {code}
> It seems to be failing only in maven.
> https://amplab.cs.berkeley.edu/jenkins/job/Spark-1.3-Maven-pre-YARN/hadoop.version=2.0.0-mr1-cdh4.1.2,label=centos/458/
> https://amplab.cs.berkeley.edu/jenkins/job/Spark-1.3-Maven-pre-YARN/hadoop.version=1.0.4,label=centos/459/
> https://amplab.cs.berkeley.edu/jenkins/job/Spark-Master-Maven-pre-YARN/hadoop.version=1.0.4,label=centos/2173/
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org