You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Chang chen (JIRA)" <ji...@apache.org> on 2017/03/13 15:10:41 UTC
[jira] [Commented] (SPARK-7460) Provide DataFrame.zip (analog of
RDD.zip) to merge two data frames
[ https://issues.apache.org/jira/browse/SPARK-7460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15907632#comment-15907632 ]
Chang chen commented on SPARK-7460:
-----------------------------------
+1 for supporting {{DataFrame.zip}}, python guys of my company usually use {{pandas.concat}} for appending columns, so they expect spark has this functionality also.
[~rxin], I just curious why did you say it is hard to get it right? Since there is {{RDD.zip}}, if you are right, then {{RDD.zip}} is also hard to get it right.
> Provide DataFrame.zip (analog of RDD.zip) to merge two data frames
> ------------------------------------------------------------------
>
> Key: SPARK-7460
> URL: https://issues.apache.org/jira/browse/SPARK-7460
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
> Reporter: Ram Sriharsha
> Assignee: Ram Sriharsha
> Priority: Minor
>
> an analog of RDD1.zip(RDD2) for data frames allows us to merge two data frames without stepping down to the RDD layer and back. (syntactic sugar)
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org