You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Alexey Kudinkin (Jira)" <ji...@apache.org> on 2022/10/04 00:47:00 UTC

[jira] [Updated] (HUDI-4489) Break down HoodieAnalysis rules into Spark-specific components

     [ https://issues.apache.org/jira/browse/HUDI-4489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alexey Kudinkin updated HUDI-4489:
----------------------------------
    Sprint: 2022/10/04

> Break down HoodieAnalysis rules into Spark-specific components
> --------------------------------------------------------------
>
>                 Key: HUDI-4489
>                 URL: https://issues.apache.org/jira/browse/HUDI-4489
>             Project: Apache Hudi
>          Issue Type: Bug
>            Reporter: Alexey Kudinkin
>            Assignee: Alexey Kudinkin
>            Priority: Blocker
>             Fix For: 0.13.0
>
>         Attachments: image-2022-07-27-14-24-03-190.png
>
>
> Currently, `HoodieAnalysis` hosts Rules that are going to be universally applied to all Spark versions even though they don't have to:
> For ex, Hudi back-ports `DeleteFromTable`, `UpdateTable` commands to Spark 2, requiring corresponding resolution to occur:
> !image-2022-07-27-14-24-03-190.png|width=512,height=144!
>  
> However, this rule should not be applied for Spark 3, which has its own rules applied to DeleteFromTable alas other commands



--
This message was sent by Atlassian Jira
(v8.20.10#820010)