You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2017/01/26 05:43:25 UTC
[jira] [Commented] (SPARK-15505) Explode nested Array in DF Column
into Multiple Columns
[ https://issues.apache.org/jira/browse/SPARK-15505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839280#comment-15839280 ]
Hyukjin Kwon commented on SPARK-15505:
--------------------------------------
Can we just {{df.selectExpr("Col1", "Col2[0]", "Col2[1]", "Col2[2]").show()}}?
> Explode nested Array in DF Column into Multiple Columns
> --------------------------------------------------------
>
> Key: SPARK-15505
> URL: https://issues.apache.org/jira/browse/SPARK-15505
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 1.6.1
> Reporter: Jorge Machado
> Priority: Minor
>
> At the moment if we have a DF like this :
> {noformat}
> +------+---------+
> | Col1 | Col2 |
> +------+---------+
> | 1 |[2, 3, 4]|
> | 1 |[2, 3, 4]|
> +------+---------+
> {noformat}
> There is no way to directly transform it into :
> {noformat}
> +------+------+------+------+
> | Col1 | Col2 | Col3 | Col4 |
> +------+------+------+------+
> | 1 | 2 | 3 | 4 |
> | 1 | 2 | 3 | 4 |
> +------+------+------+------+
> {noformat}
> I think this should be easy to implement
> More infos here : http://stackoverflow.com/questions/37391241/explode-spark-columns/37392793#37392793
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org