You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Sagar Sumit (Jira)" <ji...@apache.org> on 2021/06/16 15:57:00 UTC

[jira] [Commented] (HUDI-1248) [UMBRELLA] Tests cleanup and fixes

    [ https://issues.apache.org/jira/browse/HUDI-1248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364357#comment-17364357 ] 

Sagar Sumit commented on HUDI-1248:
-----------------------------------

I tried to repro the follwoing tests by running them several times:

1. TestHoodieMergeOnReadTable.testRollbackWithDeltaAndCompactionCommitUsingFileList

2. TestHoodieDeltaStreamer.*testUpsertsMORContinuousModeWithMultipleWriters*

3. TestCleaner.testKeepLatestCommits

1 and 3 passed every time. 2 failed twice. In both the failures, deltaSteamerTestRunner timed out. After I increased the timeout from 240s to 360s, it passed.

cc: [~nishith29]

> [UMBRELLA] Tests cleanup and fixes
> ----------------------------------
>
>                 Key: HUDI-1248
>                 URL: https://issues.apache.org/jira/browse/HUDI-1248
>             Project: Apache Hudi
>          Issue Type: Improvement
>          Components: Testing
>            Reporter: sivabalan narayanan
>            Priority: Blocker
>              Labels: hudi-umbrellas
>             Fix For: 0.9.0
>
>
> There are quite few tickets that requires some fixes to tests. Creating this umbrella ticket to track all efforts.
>  
> https://issues.apache.org/jira/browse/HUDI-1055 remove .parquet from tests.
>  https://issues.apache.org/jira/browse/HUDI-1033 ITTestRepairsCommand and TestRepairsCommand
>  https://issues.apache.org/jira/browse/HUDI-1010 memory leak.
>  https://issues.apache.org/jira/browse/HUDI-997 memory leak
>  https://issues.apache.org/jira/browse/HUDI-664 : Adjust Logging levels to reduce verbose log msgs in hudi-client
>  https://issues.apache.org/jira/browse/HUDI-623: Remove UpgradePayloadFromUberToApache
>  https://issues.apache.org/jira/browse/HUDI-541: Replace variables/comments named "data files" to "base file"
>  https://issues.apache.org/jira/browse/HUDI-347: Fix TestHoodieClientOnCopyOnWriteStorage Tests with modular private methods
>  https://issues.apache.org/jira/browse/HUDI-323: Docker demo/integ-test stdout/stderr output only available on process exit
>  https://issues.apache.org/jira/browse/HUDI-284: Need Tests for Hudi handling of schema evolution
>  https://issues.apache.org/jira/browse/HUDI-154: Enable Rollback case in HoodieRealtimeRecordReaderTest.testReader
> https://issues.apache.org/jira/browse/HUDI-1143 timestamp micros. 
> https://issues.apache.org/jira/browse/HUDI-1989: flaky tests in TestHoodieMergeOnReadTable



--
This message was sent by Atlassian Jira
(v8.3.4#803005)