You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Van Nguyen (Jira)" <ji...@apache.org> on 2022/05/02 21:02:00 UTC
[jira] [Updated] (SPARK-39089) Make unionByName null-filling behavior work with Array/Array of Structs columns
[ https://issues.apache.org/jira/browse/SPARK-39089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Van Nguyen updated SPARK-39089:
-------------------------------
Description:
https://issues.apache.org/jira/browse/SPARK-29358 added support for unionByName to work when the two datasets didn't necessarily have the same schema, but it does not work with nested array columns.
This has been solved for Structs. https://issues.apache.org/jira/browse/SPARK-32376
was:https://issues.apache.org/jira/browse/SPARK-29358 added support for unionByName to work when the two datasets didn't necessarily have the same schema, but it does not work with nested columns like structs.
> Make unionByName null-filling behavior work with Array/Array of Structs columns
> -------------------------------------------------------------------------------
>
> Key: SPARK-39089
> URL: https://issues.apache.org/jira/browse/SPARK-39089
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 3.1.0
> Reporter: Van Nguyen
> Assignee: L. C. Hsieh
> Priority: Major
> Fix For: 3.1.0
>
>
> https://issues.apache.org/jira/browse/SPARK-29358 added support for unionByName to work when the two datasets didn't necessarily have the same schema, but it does not work with nested array columns.
> This has been solved for Structs. https://issues.apache.org/jira/browse/SPARK-32376
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org