You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Tathagata Das (Jira)" <ji...@apache.org> on 2020/01/22 20:58:00 UTC

[jira] [Created] (SPARK-30609) Allow default merge command resolution to be bypassed by DSv2 sources

Tathagata Das created SPARK-30609:
-------------------------------------

             Summary: Allow default merge command resolution to be bypassed by DSv2 sources
                 Key: SPARK-30609
                 URL: https://issues.apache.org/jira/browse/SPARK-30609
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 2.4.4
            Reporter: Tathagata Das


Problem: Some DSv2 sources may want to customize the merge resolution logic. For example, a table that can accept any schema (TableCapability.ACCEPT_ANY_SCHEMA) may want to allow certain merge queries that are blocked (that is, throws AnalysisError) by the default resolution logic. So there should be a way to completely bypass the merge resolution logic in the Analyzer. 

Potential solution: Skip resolving the merge expressions if the target is a DSv2 table with  ACCEPT_ANY_SCHEMA capability.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org