You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Alexey Kudinkin (Jira)" <ji...@apache.org> on 2022/07/27 21:26:00 UTC

[jira] [Created] (HUDI-4489) Break down HoodieAnalysis rules into Spark-specific components

Alexey Kudinkin created HUDI-4489:
-------------------------------------

             Summary: Break down HoodieAnalysis rules into Spark-specific components
                 Key: HUDI-4489
                 URL: https://issues.apache.org/jira/browse/HUDI-4489
             Project: Apache Hudi
          Issue Type: Bug
            Reporter: Alexey Kudinkin
            Assignee: Alexey Kudinkin
             Fix For: 0.13.0
         Attachments: image-2022-07-27-14-24-03-190.png

Currently, `HoodieAnalysis` hosts Rules that are going to be universally applied to all Spark versions even though they don't have to:

For ex, Hudi back-ports `DeleteFromTable`, `UpdateTable` commands to Spark 2, requiring corresponding resolution to occur:

!image-2022-07-27-14-24-03-190.png|width=512,height=144!

 

However, this rule should not be applied for Spark 3, which has its own rules applied to DeleteFromTable alas other commands



--
This message was sent by Atlassian Jira
(v8.20.10#820010)