You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by gu...@apache.org on 2025/01/22 01:35:01 UTC
(spark) branch branch-4.0 updated: [SPARK-50912][PYTHON][TESTS] Skip FrameTakeAdvParityTests.test_take_adv because of OOM for now
This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a commit to branch branch-4.0
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-4.0 by this push:
new 0cb395780d47 [SPARK-50912][PYTHON][TESTS] Skip FrameTakeAdvParityTests.test_take_adv because of OOM for now
0cb395780d47 is described below
commit 0cb395780d47f4369798fb311015112c8d8dbbbe
Author: Hyukjin Kwon <gu...@apache.org>
AuthorDate: Wed Jan 22 10:34:41 2025 +0900
[SPARK-50912][PYTHON][TESTS] Skip FrameTakeAdvParityTests.test_take_adv because of OOM for now
### What changes were proposed in this pull request?
This PR proposes to skip `test_take_adv` in Spark Connect only build. Similar with https://github.com/apache/spark/pull/49565
### Why are the changes needed?
This particular test is flaky (https://github.com/apache/spark/actions/runs/12835248061/job/35794283521 and fails with OOM, which results in stopping all following tests. We should at least fix this build, and run other tests.
The build reuses single JVM for running all tests so it consumes more memory.
### Does this PR introduce _any_ user-facing change?
No, test-only.
### How was this patch tested?
Will monitor the build.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #49593 from HyukjinKwon/SPARK-50912.
Authored-by: Hyukjin Kwon <gu...@apache.org>
Signed-off-by: Hyukjin Kwon <gu...@apache.org>
(cherry picked from commit 42838a94153dc831718c31a10dbd63e27bafb100)
Signed-off-by: Hyukjin Kwon <gu...@apache.org>
---
python/pyspark/pandas/tests/connect/frame/test_parity_take_adv.py | 2 ++
1 file changed, 2 insertions(+)
diff --git a/python/pyspark/pandas/tests/connect/frame/test_parity_take_adv.py b/python/pyspark/pandas/tests/connect/frame/test_parity_take_adv.py
index 22b4aea4fd39..2d1958073b29 100644
--- a/python/pyspark/pandas/tests/connect/frame/test_parity_take_adv.py
+++ b/python/pyspark/pandas/tests/connect/frame/test_parity_take_adv.py
@@ -16,11 +16,13 @@
#
import unittest
+from pyspark import is_remote_only
from pyspark.pandas.tests.frame.test_take_adv import FrameTakeAdvMixin
from pyspark.testing.connectutils import ReusedConnectTestCase
from pyspark.testing.pandasutils import PandasOnSparkTestUtils
+@unittest.skipIf(is_remote_only(), "Flaky with OOM")
class FrameTakeAdvParityTests(
FrameTakeAdvMixin,
PandasOnSparkTestUtils,
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org