You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by ya...@apache.org on 2025/08/03 06:29:22 UTC
(spark) branch master updated: [SPARK-53076][CORE][TESTS] Disable `SparkBloomFilterSuite`
This is an automated email from the ASF dual-hosted git repository.
yangjie01 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 36a77f872007 [SPARK-53076][CORE][TESTS] Disable `SparkBloomFilterSuite`
36a77f872007 is described below
commit 36a77f87200714000d9008e265f5def6b373876c
Author: Dongjoon Hyun <do...@apache.org>
AuthorDate: Sun Aug 3 14:29:10 2025 +0800
[SPARK-53076][CORE][TESTS] Disable `SparkBloomFilterSuite`
### What changes were proposed in this pull request?
This PR aims to disable `SparkBloomFilterSuite` due to the excessive running time.
- SPARK-53077 is filed to re-enable this with the reasonable running time.
### Why are the changes needed?
Previously, `common/sketch` module took less than 10s.
```
$ mvn package --pl common/sketch
...
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 7.177 s
[INFO] Finished at: 2025-08-02T08:25:43-07:00
[INFO] ------------------------------------------------------------------------
```
After `SparkBloomFilterSuite` was added newly, `SparkBloomFilterSuite` took over 12 minutes. It's too long as a unit test.
- #50933
```
[info] Test org.apache.spark.util.sketch.SparkBloomFilterSuite#testAccuracyRandomDistribution(long, double, int, org.junit.jupiter.api.TestInfo):#1 started
[info] Test org.apache.spark.util.sketch.SparkBloomFilterSuite#testAccuracyEvenOdd(long, double, int, org.junit.jupiter.api.TestInfo):#1 started
[info] Test run finished: 0 failed, 0 ignored, 2 total, 721.939s
```
### Does this PR introduce _any_ user-facing change?
No, this is a test change.
### How was this patch tested?
Pass the CIs.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #51788 from dongjoon-hyun/SPARK-53076.
Authored-by: Dongjoon Hyun <do...@apache.org>
Signed-off-by: yangjie01 <ya...@baidu.com>
---
.../test/java/org/apache/spark/util/sketch/SparkBloomFilterSuite.java | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/common/sketch/src/test/java/org/apache/spark/util/sketch/SparkBloomFilterSuite.java b/common/sketch/src/test/java/org/apache/spark/util/sketch/SparkBloomFilterSuite.java
index ac574525d36b..529ba5419338 100644
--- a/common/sketch/src/test/java/org/apache/spark/util/sketch/SparkBloomFilterSuite.java
+++ b/common/sketch/src/test/java/org/apache/spark/util/sketch/SparkBloomFilterSuite.java
@@ -33,7 +33,7 @@ import java.util.concurrent.atomic.LongAdder;
import java.util.stream.LongStream;
import java.util.stream.Stream;
-
+@Disabled("TODO(SPARK-53077): Re-enable with a resonable test time.")
public class SparkBloomFilterSuite {
// the implemented fpp limit is only approximating the hard boundary,
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org