You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Satyam Raj (Jira)" <ji...@apache.org> on 2024/06/15 20:29:00 UTC

[jira] [Commented] (SPARK-39089) Make unionByName null-filling behavior work with Array/Array of Structs columns

    [ https://issues.apache.org/jira/browse/SPARK-39089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17855256#comment-17855256 ] 

Satyam Raj commented on SPARK-39089:
------------------------------------

I want to pick this up [~viirya] 

> Make unionByName null-filling behavior work with Array/Array of Structs columns
> -------------------------------------------------------------------------------
>
>                 Key: SPARK-39089
>                 URL: https://issues.apache.org/jira/browse/SPARK-39089
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 3.1.0
>            Reporter: V. Nguyen
>            Assignee: L. C. Hsieh
>            Priority: Major
>             Fix For: 3.1.0
>
>
> https://issues.apache.org/jira/browse/SPARK-29358 added support for unionByName to work when the two datasets didn't necessarily have the same schema, but it does not work with nested array columns.
> This has been solved for Structs. https://issues.apache.org/jira/browse/SPARK-32376



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org