You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/06/06 05:32:00 UTC
[jira] [Updated] (SPARK-39386) Flaky Test: BloomFilterAggregateQuerySuite
[ https://issues.apache.org/jira/browse/SPARK-39386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dongjoon Hyun updated SPARK-39386:
----------------------------------
Description:
During Apache Spark 3.3.0 RC5 tests, I found that this test case is very flaky in my environment.
{code:java}
[info] - Test bloom_filter_agg and might_contain *** FAILED *** (20 seconds, 370 milliseconds)
[info] Results do not match for query:
[info] Timezone: sun.util.calendar.ZoneInfo[id="America/Los_Angeles",offset=-28800000,dstSavings=3600000,useDaylight=true,transitions=185,lastRule=java.util.SimpleTimeZone[id=America/Los_Angeles,offset=-28800000,dstSavings=3600000,useDaylight=true,startYear=0,startMode=3,startMonth=2,startDay=8,startDayOfWeek=1,startTime=7200000,startTimeMode=0,endMode=3,endMonth=10,endDay=1,endDayOfWeek=1,endTime=7200000,endTimeMode=0]]
[info] Timezone Env:
...
== Results ==
[info] !== Correct Answer - 1 == == Spark Answer - 1 ==
[info] !struct<> struct<positive_membership_test:boolean,negative_membership_test:boolean>
[info] ![true,false] [true,true] (QueryTest.scala:244)
[info] org.scalatest.exceptions.TestFailedException:
[info] at org.scalatest.Assertions.newAssertionFailedException(Assertions.scala:472)
[info] at org.scalatest.Assertions.newAssertionFailedException$(Assertions.scala:471)
[info] at org.apache.spark.sql.QueryTest$.newAssertionFailedException(QueryTest.scala:234)
[info] at org.scalatest.Assertions.fail(Assertions.scala:933)
[info] at org.scalatest.Assertions.fail$(Assertions.scala:929)
[info] at org.apache.spark.sql.QueryTest$.fail(QueryTest.scala:234)
[info] at org.apache.spark.sql.QueryTest$.checkAnswer(QueryTest.scala:244)
[info] at org.apache.spark.sql.QueryTest.checkAnswer(QueryTest.scala:151)
[info] at org.apache.spark.sql.QueryTest.checkAnswer(QueryTest.scala:155)
[info] at org.apache.spark.sql.BloomFilterAggregateQuerySuite.$anonfun$new$4(BloomFilterAggregateQuerySuite.scala:98)
{code}
was:
{code}
[info] - Test bloom_filter_agg and might_contain *** FAILED *** (20 seconds, 370 milliseconds)
[info] Results do not match for query:
[info] Timezone: sun.util.calendar.ZoneInfo[id="America/Los_Angeles",offset=-28800000,dstSavings=3600000,useDaylight=true,transitions=185,lastRule=java.util.SimpleTimeZone[id=America/Los_Angeles,offset=-28800000,dstSavings=3600000,useDaylight=true,startYear=0,startMode=3,startMonth=2,startDay=8,startDayOfWeek=1,startTime=7200000,startTimeMode=0,endMode=3,endMonth=10,endDay=1,endDayOfWeek=1,endTime=7200000,endTimeMode=0]]
[info] Timezone Env:
...
== Results ==
[info] !== Correct Answer - 1 == == Spark Answer - 1 ==
[info] !struct<> struct<positive_membership_test:boolean,negative_membership_test:boolean>
[info] ![true,false] [true,true] (QueryTest.scala:244)
[info] org.scalatest.exceptions.TestFailedException:
[info] at org.scalatest.Assertions.newAssertionFailedException(Assertions.scala:472)
[info] at org.scalatest.Assertions.newAssertionFailedException$(Assertions.scala:471)
[info] at org.apache.spark.sql.QueryTest$.newAssertionFailedException(QueryTest.scala:234)
[info] at org.scalatest.Assertions.fail(Assertions.scala:933)
[info] at org.scalatest.Assertions.fail$(Assertions.scala:929)
[info] at org.apache.spark.sql.QueryTest$.fail(QueryTest.scala:234)
[info] at org.apache.spark.sql.QueryTest$.checkAnswer(QueryTest.scala:244)
[info] at org.apache.spark.sql.QueryTest.checkAnswer(QueryTest.scala:151)
[info] at org.apache.spark.sql.QueryTest.checkAnswer(QueryTest.scala:155)
[info] at org.apache.spark.sql.BloomFilterAggregateQuerySuite.$anonfun$new$4(BloomFilterAggregateQuerySuite.scala:98)
{code}
> Flaky Test: BloomFilterAggregateQuerySuite
> ------------------------------------------
>
> Key: SPARK-39386
> URL: https://issues.apache.org/jira/browse/SPARK-39386
> Project: Spark
> Issue Type: Bug
> Components: SQL, Tests
> Affects Versions: 3.3.0
> Reporter: Dongjoon Hyun
> Priority: Major
>
> During Apache Spark 3.3.0 RC5 tests, I found that this test case is very flaky in my environment.
> {code:java}
> [info] - Test bloom_filter_agg and might_contain *** FAILED *** (20 seconds, 370 milliseconds)
> [info] Results do not match for query:
> [info] Timezone: sun.util.calendar.ZoneInfo[id="America/Los_Angeles",offset=-28800000,dstSavings=3600000,useDaylight=true,transitions=185,lastRule=java.util.SimpleTimeZone[id=America/Los_Angeles,offset=-28800000,dstSavings=3600000,useDaylight=true,startYear=0,startMode=3,startMonth=2,startDay=8,startDayOfWeek=1,startTime=7200000,startTimeMode=0,endMode=3,endMonth=10,endDay=1,endDayOfWeek=1,endTime=7200000,endTimeMode=0]]
> [info] Timezone Env:
> ...
> == Results ==
> [info] !== Correct Answer - 1 == == Spark Answer - 1 ==
> [info] !struct<> struct<positive_membership_test:boolean,negative_membership_test:boolean>
> [info] ![true,false] [true,true] (QueryTest.scala:244)
> [info] org.scalatest.exceptions.TestFailedException:
> [info] at org.scalatest.Assertions.newAssertionFailedException(Assertions.scala:472)
> [info] at org.scalatest.Assertions.newAssertionFailedException$(Assertions.scala:471)
> [info] at org.apache.spark.sql.QueryTest$.newAssertionFailedException(QueryTest.scala:234)
> [info] at org.scalatest.Assertions.fail(Assertions.scala:933)
> [info] at org.scalatest.Assertions.fail$(Assertions.scala:929)
> [info] at org.apache.spark.sql.QueryTest$.fail(QueryTest.scala:234)
> [info] at org.apache.spark.sql.QueryTest$.checkAnswer(QueryTest.scala:244)
> [info] at org.apache.spark.sql.QueryTest.checkAnswer(QueryTest.scala:151)
> [info] at org.apache.spark.sql.QueryTest.checkAnswer(QueryTest.scala:155)
> [info] at org.apache.spark.sql.BloomFilterAggregateQuerySuite.$anonfun$new$4(BloomFilterAggregateQuerySuite.scala:98)
> {code}
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org