You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2025/11/21 15:56:37 UTC
(spark) branch branch-4.1 updated: [MINOR][PYTHON][TEST] test_install_spark` switch to Spark 3.5.7
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-4.1
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-4.1 by this push:
new f2f550dda131 [MINOR][PYTHON][TEST] test_install_spark` switch to Spark 3.5.7
f2f550dda131 is described below
commit f2f550dda131e314ffccf0ca994715e0f47f36d6
Author: Cheng Pan <ch...@apache.org>
AuthorDate: Fri Nov 21 18:29:11 2025 +0900
[MINOR][PYTHON][TEST] test_install_spark` switch to Spark 3.5.7
### What changes were proposed in this pull request?
Similar to https://github.com/apache/spark/pull/51103
### Why are the changes needed?
Avoid downloading from Apache archive site, which is pretty slow and unstable.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Pass GHA.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #53151 from pan3793/minor-pyspark-install-test.
Authored-by: Cheng Pan <ch...@apache.org>
Signed-off-by: Hyukjin Kwon <gu...@apache.org>
(cherry picked from commit 00dda2c8d03c3112096ccfabbff7118d803b676e)
Signed-off-by: Dongjoon Hyun <do...@apache.org>
---
python/pyspark/tests/test_install_spark.py | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/python/pyspark/tests/test_install_spark.py b/python/pyspark/tests/test_install_spark.py
index effbab6a9010..769876b46138 100644
--- a/python/pyspark/tests/test_install_spark.py
+++ b/python/pyspark/tests/test_install_spark.py
@@ -32,7 +32,7 @@ class SparkInstallationTestCase(unittest.TestCase):
def test_install_spark(self):
# Test only one case. Testing this is expensive because it needs to download
# the Spark distribution, ensure it is available at https://dlcdn.apache.org/spark/
- spark_version, hadoop_version, hive_version = checked_versions("3.5.6", "3", "2.3")
+ spark_version, hadoop_version, hive_version = checked_versions("3.5.7", "3", "2.3")
with tempfile.TemporaryDirectory(prefix="test_install_spark") as tmp_dir:
install_spark(
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org