(spark) branch branch-4.1 updated: [SPARK-56344][PYTHON][DOCS][4.1] Fix outdated PyArrow minimum version in arrow_pandas.rst

[ru...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

ruifengz pushed a commit to branch branch-4.1
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/branch-4.1 by this push:
     new decb1feff0f6 [SPARK-56344][PYTHON][DOCS][4.1] Fix outdated PyArrow minimum version in arrow_pandas.rst
decb1feff0f6 is described below

commit decb1feff0f6ce2f5fdd58c416345bae249ce293
Author: Yicong-Huang <17...@users.noreply.github.com>
AuthorDate: Fri Apr 3 15:12:31 2026 +0800

    [SPARK-56344][PYTHON][DOCS][4.1] Fix outdated PyArrow minimum version in arrow_pandas.rst
    
    ### What changes were proposed in this pull request?
    
    - Updated the minimum PyArrow version from 11.0.0 to 15.0.0 in `python/docs/source/tutorial/sql/arrow_pandas.rst`.
    - Added `python/docs/source/tutorial/sql/arrow_pandas.rst` to the version-change reminder comments in `python/packaging/classic/setup.py`, `python/packaging/client/setup.py`, and `python/packaging/connect/setup.py` so this file is not missed in future version bumps.
    
    ### Why are the changes needed?
    
    The documentation in `arrow_pandas.rst` still states the minimum PyArrow version is 11.0.0, but it was raised to 15.0.0 in Spark 4.1. The setup.py reminder comments also do not reference this doc file, which is why it was missed.
    
    ### Does this PR introduce _any_ user-facing change?
    
    No.
    
    ### How was this patch tested?
    
    Documentation-only change; no tests needed.
    
    ### Was this patch authored or co-authored using generative AI tooling?
    
    No.
    
    Closes #55176 from Yicong-Huang/SPARK-56344.
    
    Authored-by: Yicong-Huang <17...@users.noreply.github.com>
    Signed-off-by: Ruifeng Zheng <ru...@apache.org>
---
 python/docs/source/tutorial/sql/arrow_pandas.rst | 2 +-
 python/packaging/classic/setup.py                | 1 +
 python/packaging/client/setup.py                 | 1 +
 python/packaging/connect/setup.py                | 1 +
 4 files changed, 4 insertions(+), 1 deletion(-)

diff --git a/python/docs/source/tutorial/sql/arrow_pandas.rst b/python/docs/source/tutorial/sql/arrow_pandas.rst
index 3bef50874d7f..a4b7078c2b53 100644
--- a/python/docs/source/tutorial/sql/arrow_pandas.rst
+++ b/python/docs/source/tutorial/sql/arrow_pandas.rst
@@ -440,7 +440,7 @@ working with timestamps in ``pandas_udf``\s to get the best performance, see
 Recommended Pandas and PyArrow Versions
 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
 
-For usage with pyspark.sql, the minimum supported versions of Pandas is 2.2.0 and PyArrow is 11.0.0.
+For usage with pyspark.sql, the minimum supported versions of Pandas is 2.2.0 and PyArrow is 15.0.0.
 Higher versions may be used, however, compatibility and data correctness can not be guaranteed and should
 be verified by the user.
 
diff --git a/python/packaging/classic/setup.py b/python/packaging/classic/setup.py
index 54ec4abe3be9..c63188b58f4f 100755
--- a/python/packaging/classic/setup.py
+++ b/python/packaging/classic/setup.py
@@ -149,6 +149,7 @@ if in_spark:
 # For Arrow, you should also check ./pom.xml and ensure there are no breaking changes in the
 # binary format protocol with the Java version, see ARROW_HOME/format/* for specifications.
 # Also don't forget to update python/docs/source/getting_started/install.rst,
+# python/docs/source/tutorial/sql/arrow_pandas.rst,
 # python/packaging/client/setup.py, and python/packaging/connect/setup.py
 _minimum_pandas_version = "2.2.0"
 _minimum_numpy_version = "1.21"
diff --git a/python/packaging/client/setup.py b/python/packaging/client/setup.py
index ee404210f293..c1d0086f3c48 100755
--- a/python/packaging/client/setup.py
+++ b/python/packaging/client/setup.py
@@ -132,6 +132,7 @@ try:
     # For Arrow, you should also check ./pom.xml and ensure there are no breaking changes in the
     # binary format protocol with the Java version, see ARROW_HOME/format/* for specifications.
     # Also don't forget to update python/docs/source/getting_started/install.rst,
+    # python/docs/source/tutorial/sql/arrow_pandas.rst,
     # python/packaging/classic/setup.py, and python/packaging/connect/setup.py
     _minimum_pandas_version = "2.2.0"
     _minimum_numpy_version = "1.21"
diff --git a/python/packaging/connect/setup.py b/python/packaging/connect/setup.py
index fc3cfca739aa..1a6480ee1324 100755
--- a/python/packaging/connect/setup.py
+++ b/python/packaging/connect/setup.py
@@ -85,6 +85,7 @@ try:
     # For Arrow, you should also check ./pom.xml and ensure there are no breaking changes in the
     # binary format protocol with the Java version, see ARROW_HOME/format/* for specifications.
     # Also don't forget to update python/docs/source/getting_started/install.rst,
+    # python/docs/source/tutorial/sql/arrow_pandas.rst,
     # python/packaging/classic/setup.py, and python/packaging/client/setup.py
     _minimum_pandas_version = "2.2.0"
     _minimum_numpy_version = "1.21"


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org