You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2016/06/20 03:41:05 UTC
[jira] [Commented] (SPARK-16050) Flaky Test: Complete aggregation
with Console sink
[ https://issues.apache.org/jira/browse/SPARK-16050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15338950#comment-15338950 ]
Shixiong Zhu commented on SPARK-16050:
--------------------------------------
There may be some background threads outputting logs to stdout while ConsoleSinkSuite is running. Since ConsoleSinkSuite collects results from stdout and check them, it may fail.
I'm going to just delete ConsoleSinkSuite.
If we want to test ConsoleSinkSuite in future, we should refactoring ConsoleSink to make it testable instead of depending on stdout, because Spark may not stop some background threads at once and there is a race condition that other threads are outputting logs while ConsoleSinkSuite is running.
> Flaky Test: Complete aggregation with Console sink
> ---------------------------------------------------
>
> Key: SPARK-16050
> URL: https://issues.apache.org/jira/browse/SPARK-16050
> Project: Spark
> Issue Type: Test
> Components: SQL, Streaming
> Reporter: Burak Yavuz
> Priority: Critical
> Labels: Flaky
>
> Please refer to the multiple failures in the last day:
> https://amplab.cs.berkeley.edu/jenkins/job/spark-master-test-sbt-hadoop-2.7/1018/consoleFull
> https://amplab.cs.berkeley.edu/jenkins/job/spark-master-test-sbt-hadoop-2.7/1017/consoleFull
> https://amplab.cs.berkeley.edu/jenkins/job/spark-master-test-sbt-hadoop-2.7/1018/consoleFull
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org