You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Balaji Varadarajan (Jira)" <ji...@apache.org> on 2020/01/14 18:08:00 UTC

[jira] [Created] (HUDI-535) Compatibility Issue : Hudi Readers using newer layout version can see intermittent errors due to race conditions with concurrent compactions in MOR tables

Balaji Varadarajan created HUDI-535:
---------------------------------------

             Summary: Compatibility Issue : Hudi Readers using newer layout version can see intermittent errors due to race conditions with concurrent compactions in MOR tables 
                 Key: HUDI-535
                 URL: https://issues.apache.org/jira/browse/HUDI-535
             Project: Apache Hudi (incubating)
          Issue Type: Bug
          Components: Common Core
            Reporter: Balaji Varadarajan
             Fix For: 0.5.1


As part of recent changes in 0.5.1 to avoid renames in metadata, the compaction plans are no longer getting written to .aux folder. Instead the upgraded reader reads from timeline (.hoodie). This would work as long as writer is also upgraded but if reader alone is upgraded, there would be conditions when hudi reader tried to read from compaction requested file which was renamed by concurrent compactions.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)