You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Vinoth Chandar (Jira)" <ji...@apache.org> on 2020/01/15 05:04:00 UTC

[jira] [Updated] (HUDI-535) Compatibility Issue : Hudi Readers using newer layout version can see intermittent errors due to race conditions with concurrent compactions in MOR tables

     [ https://issues.apache.org/jira/browse/HUDI-535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Vinoth Chandar updated HUDI-535:
--------------------------------
    Status: Open  (was: New)

> Compatibility Issue : Hudi Readers using newer layout version can see intermittent errors due to race conditions with concurrent compactions in MOR tables 
> -----------------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HUDI-535
>                 URL: https://issues.apache.org/jira/browse/HUDI-535
>             Project: Apache Hudi (incubating)
>          Issue Type: Bug
>          Components: Common Core
>            Reporter: Balaji Varadarajan
>            Assignee: Balaji Varadarajan
>            Priority: Blocker
>             Fix For: 0.5.1
>
>
> As part of recent changes in 0.5.1 to avoid renames in metadata, the compaction plans are no longer getting written to .aux folder. Instead the upgraded reader reads from timeline (.hoodie). This would work as long as writer is also upgraded but if reader alone is upgraded, there would be conditions when hudi reader tried to read from compaction requested file which was renamed by concurrent compactions.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)