You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "sivabalan narayanan (Jira)" <ji...@apache.org> on 2023/01/21 00:32:00 UTC

[jira] [Created] (HUDI-5595) Triage MOR flaky tests due to small file management

sivabalan narayanan created HUDI-5595:
-----------------------------------------

             Summary: Triage MOR flaky tests due to small file management
                 Key: HUDI-5595
                 URL: https://issues.apache.org/jira/browse/HUDI-5595
             Project: Apache Hudi
          Issue Type: Test
          Components: tests-ci, writer-core
            Reporter: sivabalan narayanan


In MOR table tests, due to small file handling, we end up expanding existing file group to pack both updates and inserts and hence no log files were generated. but tests expects compaction to happen after 5 commits which fails the test in such cases.

Already made a fix to some of the tests: [https://github.com/apache/hudi/pull/7720/] 

but we might need to triage and fix any other similar tests. 

one thing we want to ensure is, we do have explicit small file handling tests for MOR table so that disabling at other places is ok.

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)