You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Alexey Kudinkin (Jira)" <ji...@apache.org> on 2023/01/06 02:43:00 UTC
[jira] [Updated] (HUDI-4690) Remove code duplicated over from Spark
[ https://issues.apache.org/jira/browse/HUDI-4690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alexey Kudinkin updated HUDI-4690:
----------------------------------
Reviewers: sivabalan narayanan (was: Sagar Sumit)
> Remove code duplicated over from Spark
> --------------------------------------
>
> Key: HUDI-4690
> URL: https://issues.apache.org/jira/browse/HUDI-4690
> Project: Apache Hudi
> Issue Type: Bug
> Components: reader-core, writer-core
> Affects Versions: 0.12.0
> Reporter: Alexey Kudinkin
> Assignee: Alexey Kudinkin
> Priority: Blocker
> Labels: pull-request-available
> Fix For: 0.13.0
>
>
> At present, a lot of code in `HoodieAnalysis` is unnecessarily duplicating the resolution logic from Spark that leads to interference w/ normal operations of Spark's Analyzer and leading to non-trivial issues (like HUDI-4503) when dealing w/ Spark or Spark SQL
>
> We should minimize the amount of logic and code that is localized from Spark to Hudi to strictly necessary to either
> # Address issues (alternative to upstreaming in Spark)
> # Back-port features (from newer Spark versions to older ones)
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)