You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Ian Hellstrom (JIRA)" <ji...@apache.org> on 2016/03/07 13:13:40 UTC

[jira] [Created] (SPARK-13721) Add support for LATERAL VIEW OUTER explode()

Ian Hellstrom created SPARK-13721:
-------------------------------------

             Summary: Add support for LATERAL VIEW OUTER explode()
                 Key: SPARK-13721
                 URL: https://issues.apache.org/jira/browse/SPARK-13721
             Project: Spark
          Issue Type: Improvement
          Components: SQL
            Reporter: Ian Hellstrom


Hive supports the [LATERAL VIEW OUTER|https://cwiki.apache.org/confluence/display/Hive/LanguageManual+LateralView#LanguageManualLateralView-OuterLateralViews] syntax to make sure that when an array is empty, the content from the outer table is still returned. 

Within Spark, this is currently only possible within the HiveContext and executing HiveQL statements. It would be nice if the standard explode() DataFrame method allows the same. A possible signature would be: 

{code:scala}
explode[A, B](inputColumn: String, outputColumn: String, outer: Boolean = false)
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org