You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Tathagata Das (Jira)" <ji...@apache.org> on 2020/01/23 03:22:00 UTC
[jira] [Assigned] (SPARK-30609) Allow default merge command
resolution to be bypassed by DSv2 sources
[ https://issues.apache.org/jira/browse/SPARK-30609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tathagata Das reassigned SPARK-30609:
-------------------------------------
Assignee: Tathagata Das
> Allow default merge command resolution to be bypassed by DSv2 sources
> ---------------------------------------------------------------------
>
> Key: SPARK-30609
> URL: https://issues.apache.org/jira/browse/SPARK-30609
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 2.4.4
> Reporter: Tathagata Das
> Assignee: Tathagata Das
> Priority: Major
>
> Problem: Some DSv2 sources may want to customize the merge resolution logic. For example, a table that can accept any schema (TableCapability.ACCEPT_ANY_SCHEMA) may want to allow certain merge queries that are blocked (that is, throws AnalysisError) by the default resolution logic. So there should be a way to completely bypass the merge resolution logic in the Analyzer.
> Potential solution: Skip resolving the merge expressions if the target is a DSv2 table with ACCEPT_ANY_SCHEMA capability.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org