You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/11/12 19:30:00 UTC

[jira] [Commented] (SPARK-26022) PySpark Comparison with Pandas

    [ https://issues.apache.org/jira/browse/SPARK-26022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684283#comment-16684283 ] 

Xiao Li commented on SPARK-26022:
---------------------------------

[~hyukjin.kwon] Could you lead this effort to help the community create such a doc and show the API/semantics difference between PySpark and Pandas. It will help the community migrate their workloads from Pandas to PySpark.

> PySpark Comparison with Pandas
> ------------------------------
>
>                 Key: SPARK-26022
>                 URL: https://issues.apache.org/jira/browse/SPARK-26022
>             Project: Spark
>          Issue Type: Documentation
>          Components: PySpark
>    Affects Versions: 3.0.0
>            Reporter: Xiao Li
>            Priority: Major
>
> It would be very nice if we can have a doc like https://pandas.pydata.org/pandas-docs/stable/comparison_with_sql.html to show the API difference between PySpark and Pandas. 
> Reference:
> https://www.kdnuggets.com/2016/01/python-data-science-pandas-spark-dataframe-differences.html



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org