You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by gu...@apache.org on 2023/04/17 01:12:17 UTC
[spark] branch branch-3.4 updated: [SPARK-43158][DOCS] Set upperbound of pandas version for Binder integration
This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a commit to branch branch-3.4
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.4 by this push:
new 23a10cb2e72 [SPARK-43158][DOCS] Set upperbound of pandas version for Binder integration
23a10cb2e72 is described below
commit 23a10cb2e72bd5a224138771b0752ea677f9329e
Author: Hyukjin Kwon <gu...@apache.org>
AuthorDate: Mon Apr 17 10:11:55 2023 +0900
[SPARK-43158][DOCS] Set upperbound of pandas version for Binder integration
### What changes were proposed in this pull request?
This PR proposes to set the upperbound for pandas in Binder integration. We don't currently support pandas 2.0.0 properly, see also https://issues.apache.org/jira/browse/SPARK-42618
### Why are the changes needed?
To make the quickstarts working.
### Does this PR introduce _any_ user-facing change?
Yes, it fixes the quickstart.
### How was this patch tested?
Tested in:
- https://mybinder.org/v2/gh/HyukjinKwon/spark/set-lower-bound-pandas?labpath=python%2Fdocs%2Fsource%2Fgetting_started%2Fquickstart_connect.ipynb
- https://mybinder.org/v2/gh/HyukjinKwon/spark/set-lower-bound-pandas?labpath=python%2Fdocs%2Fsource%2Fgetting_started%2Fquickstart_df.ipynb
- https://mybinder.org/v2/gh/HyukjinKwon/spark/set-lower-bound-pandas?labpath=python%2Fdocs%2Fsource%2Fgetting_started%2Fquickstart_ps.ipynb
Closes #40814 from HyukjinKwon/set-lower-bound-pandas.
Authored-by: Hyukjin Kwon <gu...@apache.org>
Signed-off-by: Hyukjin Kwon <gu...@apache.org>
(cherry picked from commit a2592e6d46caf82c642f4a01a3fd5c282bbe174e)
Signed-off-by: Hyukjin Kwon <gu...@apache.org>
---
binder/postBuild | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
diff --git a/binder/postBuild b/binder/postBuild
index 3246a7f04b2..70ae23b3937 100644
--- a/binder/postBuild
+++ b/binder/postBuild
@@ -33,9 +33,9 @@ else
fi
if [[ ! $VERSION < "3.4.0" ]]; then
- pip install plotly "pyspark[sql,ml,mllib,pandas_on_spark,connect]$SPECIFIER$VERSION"
+ pip install plotly "pandas<2.0.0" "pyspark[sql,ml,mllib,pandas_on_spark,connect]$SPECIFIER$VERSION"
else
- pip install plotly "pyspark[sql,ml,mllib,pandas_on_spark]$SPECIFIER$VERSION"
+ pip install plotly "pandas<2.0.0" "pyspark[sql,ml,mllib,pandas_on_spark]$SPECIFIER$VERSION"
fi
# Set 'PYARROW_IGNORE_TIMEZONE' to surpress warnings from PyArrow.
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org