You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by ga...@apache.org on 2026/09/23 23:09:02 UTC
(spark) branch master updated: [SPARK-59705][INFRA][FOLLOWUP] Fix pandas3 dependency conflict
This is an automated email from the ASF dual-hosted git repository.
gaogaotiantian pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new df2bc74dce50 [SPARK-59705][INFRA][FOLLOWUP] Fix pandas3 dependency conflict
df2bc74dce50 is described below
commit df2bc74dce5073fab46213a5444fa931e8635365
Author: Tian Gao <ga...@hotmail.com>
AuthorDate: Wed Sep 23 16:08:46 2026 -0700
[SPARK-59705][INFRA][FOLLOWUP] Fix pandas3 dependency conflict
### What changes were proposed in this pull request?
Fix the conflict dependency group for pandas 3. Removed all the groups that require pandas < 3.0.0
### Why are the changes needed?
The conflict caused the master failure.
### Does this PR introduce _any_ user-facing change?
`pip install --group ci_classic_pandas_3 --dry-run` passed locally.
### How was this patch tested?
No.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #59007 from gaogaotiantian/fix-pandas3-dependency.
Authored-by: Tian Gao <ga...@hotmail.com>
Signed-off-by: Tian Gao <ga...@hotmail.com>
---
pyproject.toml | 5 ++---
1 file changed, 2 insertions(+), 3 deletions(-)
diff --git a/pyproject.toml b/pyproject.toml
index 9b4233507f43..fad0ac4c7fcd 100644
--- a/pyproject.toml
+++ b/pyproject.toml
@@ -263,15 +263,14 @@ ci_classic_minimum = [
]
ci_classic_pandas_3 = [
+ {include-group = "internal_numpy"},
{include-group = "internal_pyspark_devtool"},
- {include-group = "sql"},
- {include-group = "pandas_on_spark"},
{include-group = "pandas_on_spark_extra"},
- {include-group = "ml"},
# torch should be installed with ml_torch group
{include-group = "ml_extra_base"},
{include-group = "internal_test"},
"pyarrow>=23.0.0",
+ # Make sure no other conflicts with pandas 3
"pandas>=3.0.0",
]
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org