You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Alexey Kudinkin (Jira)" <ji...@apache.org> on 2023/01/06 02:43:00 UTC

[jira] [Updated] (HUDI-4690) Remove code duplicated over from Spark

     [ https://issues.apache.org/jira/browse/HUDI-4690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alexey Kudinkin updated HUDI-4690:
----------------------------------
    Reviewers: sivabalan narayanan  (was: Sagar Sumit)

> Remove code duplicated over from Spark
> --------------------------------------
>
>                 Key: HUDI-4690
>                 URL: https://issues.apache.org/jira/browse/HUDI-4690
>             Project: Apache Hudi
>          Issue Type: Bug
>          Components: reader-core, writer-core
>    Affects Versions: 0.12.0
>            Reporter: Alexey Kudinkin
>            Assignee: Alexey Kudinkin
>            Priority: Blocker
>              Labels: pull-request-available
>             Fix For: 0.13.0
>
>
> At present, a lot of code in `HoodieAnalysis` is unnecessarily duplicating the resolution logic from Spark that leads to interference w/ normal operations of Spark's Analyzer and leading to non-trivial issues (like HUDI-4503) when dealing w/ Spark or Spark SQL
>  
> We should minimize the amount of logic and code that is localized from Spark to Hudi to strictly necessary to either 
>  # Address issues (alternative to upstreaming in Spark)
>  # Back-port features (from newer Spark versions to older ones)
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)