[jira] [Commented] (SPARK-13721) Add support for LATERAL VIEW OUTER explode()

["Don Drake (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-13721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15459490#comment-15459490 ] 

Don Drake commented on SPARK-13721:
-----------------------------------

My nested structures aren't simple types, they are structs (case classes) and so this existing method works great for me. 

This ticket it about modifying the explode() call to support outer, not adding outer to the data frame api.

> Add support for LATERAL VIEW OUTER explode()
> --------------------------------------------
>
>                 Key: SPARK-13721
>                 URL: https://issues.apache.org/jira/browse/SPARK-13721
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>            Reporter: Ian Hellstrom
>
> Hive supports the [LATERAL VIEW OUTER|https://cwiki.apache.org/confluence/display/Hive/LanguageManual+LateralView#LanguageManualLateralView-OuterLateralViews] syntax to make sure that when an array is empty, the content from the outer table is still returned. 
> Within Spark, this is currently only possible within the HiveContext and executing HiveQL statements. It would be nice if the standard explode() DataFrame method allows the same. A possible signature would be: 
> {code:scala}
> explode[A, B](inputColumn: String, outputColumn: String, outer: Boolean = false)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org