You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2020/02/14 21:23:23 UTC
[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27586:
[SPARK-30834][DOCS][PYTHON][2.4] Add note for recommended pandas and
pyarrow versions
dongjoon-hyun commented on a change in pull request #27586: [SPARK-30834][DOCS][PYTHON][2.4] Add note for recommended pandas and pyarrow versions
URL: https://github.com/apache/spark/pull/27586#discussion_r379650481
##########
File path: docs/sql-pyspark-pandas-with-arrow.md
##########
@@ -166,6 +166,12 @@ different than a Pandas timestamp. It is recommended to use Pandas time series f
working with timestamps in `pandas_udf`s to get the best performance, see
[here](https://pandas.pydata.org/pandas-docs/stable/timeseries.html) for details.
+### Recommended Pandas and PyArrow Versions
+
+For usage with pyspark.sql, the supported versions of Pandas is 0.19.2 and PyArrow is 0.8.0. Higher
Review comment:
BTW, I forgot the exact versions of the `branch-2.4` PR builders in AmpLab Jenkins. These are the community testing version. Did I understand correctly?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org