You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Ethan Guo (Jira)" <ji...@apache.org> on 2023/02/07 22:53:01 UTC

[jira] [Updated] (HUDI-4690) Remove code duplicated over from Spark

     [ https://issues.apache.org/jira/browse/HUDI-4690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ethan Guo updated HUDI-4690:
----------------------------
    Fix Version/s: 0.14.0
                       (was: 0.13.0)

> Remove code duplicated over from Spark
> --------------------------------------
>
>                 Key: HUDI-4690
>                 URL: https://issues.apache.org/jira/browse/HUDI-4690
>             Project: Apache Hudi
>          Issue Type: Bug
>          Components: reader-core, writer-core
>    Affects Versions: 0.12.0
>            Reporter: Alexey Kudinkin
>            Assignee: Alexey Kudinkin
>            Priority: Blocker
>              Labels: pull-request-available
>             Fix For: 0.14.0
>
>
> At present, a lot of code in `HoodieAnalysis` is unnecessarily duplicating the resolution logic from Spark that leads to interference w/ normal operations of Spark's Analyzer and leading to non-trivial issues (like HUDI-4503) when dealing w/ Spark or Spark SQL
>  
> We should minimize the amount of logic and code that is localized from Spark to Hudi to strictly necessary to either 
>  # Address issues (alternative to upstreaming in Spark)
>  # Back-port features (from newer Spark versions to older ones)
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)