[GitHub] [spark] HyukjinKwon commented on a change in pull request #30127: [SPARK-33216][INFRA][PYTHON][2.4] Set upper bound of Pandas version in GitHub Actions

[GitBox <gi...@apache.org>]

HyukjinKwon commented on a change in pull request #30127:
URL: https://github.com/apache/spark/pull/30127#discussion_r509853641



##########
File path: .github/workflows/build_and_test.yml
##########
@@ -131,16 +131,16 @@ jobs:
       # PyArrow is not supported in PyPy yet, see ARROW-2651.
       # TODO(SPARK-32247): scipy installation with PyPy fails for an unknown reason.
       run: |
-        python3.6 -m pip install numpy 'pyarrow<3.0.0' pandas scipy xmlrunner
+        python3.6 -m pip install numpy 'pyarrow<3.0.0' 'pandas<1.1.1' scipy xmlrunner

Review comment:
       Sure, either setting an upper bound or porting https://github.com/apache/spark/commit/07a9885f2792be1353f4a923d649e90bc431cb38 back should be fine. We're picking one version to test anyway.
   
   BTW, I think `DataFrame.from_item` was removed in pandas 1.0.0 (https://github.com/pandas-dev/pandas/blob/master/doc/source/whatsnew/v1.0.0.rst#removal-of-prior-version-deprecationschanges).




----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org