You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "hudi-bot (via GitHub)" <gi...@apache.org> on 2025/11/30 08:15:49 UTC

[I] Fix CI stability Jun 26, 2023 [hudi]

hudi-bot opened a new issue, #16058:
URL: https://github.com/apache/hudi/issues/16058

   CI has been unstable for the past few weeks. we need to triage them and fix it.
   
    
   
    
   
   UT-spark datasource module times out after 3 hours. 
   
   [https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=17956&view=logs&j=b1544eb9-7ff1-5db9-0187-3e05abf459bc]
    * Looks like top 10 tests were taking 30 to 40 secs and now its taking 40 to 50 secs or more and hence reaching 3 hours
   
   {code:java}
   2023-06-20T05:03:58.6566739Z 52.124 org.apache.hudi.functional.TestIncrementalReadWithFullTableScan testFailEarlyForIncrViewQue
   ryForNonExistingFiles{HoodieTableType}[2]
   2023-06-20T05:03:58.6567324Z 49.446 org.apache.hudi.functional.TestIncrementalReadWithFullTableScan testFailEarlyForIncrViewQue
   ryForNonExistingFiles{HoodieTableType}[1]
   2023-06-20T05:03:58.6568005Z 48.659 org.apache.hudi.functional.cdc.TestCDCDataFrameSuite testMORDataSourceWrite{HoodieCDCSupple
   mentalLoggingMode}[1]
   2023-06-20T05:03:58.6568471Z 47.799 org.apache.hudi.functional.cdc.TestCDCDataFrameSuite testMORDataSourceWrite{HoodieCDCSupple
   mentalLoggingMode}[3]
   2023-06-20T05:03:58.6569093Z 47.586 org.apache.hudi.functional.cdc.TestCDCDataFrameSuite testMORDataSourceWrite{HoodieCDCSupple
   mentalLoggingMode}[2]
   2023-06-20T05:03:58.6569503Z 41.208 org.apache.hudi.functional.TestMORDataSource testCount{HoodieRecordType, HoodieRecordType, 
   String}[2]
   2023-06-20T05:03:58.6570090Z 41.034 org.apache.hudi.functional.TestMORDataSource testCount{HoodieRecordType, HoodieRecordType, 
   String}[4]
   2023-06-20T05:03:58.6570501Z 40.225 org.apache.hudi.functional.TestMORDataSource testCount{HoodieRecordType, HoodieRecordType, 
   String}[3]
   2023-06-20T05:03:58.6571231Z 39.853 org.apache.hudi.functional.cdc.TestCDCDataFrameSuite testCOWDataSourceWrite{HoodieCDCSupple
   mentalLoggingMode}[1]
   2023-06-20T05:03:58.6574224Z 39.357 org.apache.hudi.functional.TestMORDataSource testCount{HoodieRecordType, HoodieRecordType, 
   String}[1]
   2023-06-20T05:03:58.6575261Z 38.995 org.apache.hudi.functional.cdc.TestCDCDataFrameSuite testCOWDataSourceWrite{HoodieCDCSupple
   mentalLoggingMode}[3]
   2023-06-20T05:03:58.6575765Z 38.846 org.apache.hudi.functional.cdc.TestCDCDataFrameSuite testCOWDataSourceWrite{HoodieCDCSupple
   mentalLoggingMode}[2]
   2023-06-20T05:03:58.6576470Z 35.404 org.apache.hudi.functional.TestMORDataSourceWithBucketIndex testCountWithBucketIndex {code}
    
   
   TestHoodieDeltaStreamer.testUpsertsMORContinuousMode
   
   and testAsyncClusteringServiceWithCompaction
   
   [https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_apis/build/builds/18111/logs/19]
   
   Raymond. 
   
    
   
   -TestHoodieDeltaStreamerWithMultiWriter.testUpsertsContinuousModeWithMultipleWritersForConflicts-
   
   -[https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_apis/build/builds/18080/logs/21]-
   
   -Siva-
   
    
   
   -TestWriteMergeOnRead.testUpsert-
   
   -[https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_apis/build/builds/17993/logs/35]-
   
   -Sagar, Danny- 
   
    
   
   -TestWriteMergeOnReadWithCompact.testUpsert-
   
   -TestWriteCopyOnWrite.testSubtaskFails-
   
   -[https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_apis/build/builds/18110/logs/30]-
   
   -Sagar, Danny-
   
    
   TestHoodieClientMultiWriter.testHoodieClientBasicMultiWriterWithEarlyConflictDetection
   [https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_apis/build/builds/18122/logs/28]
   Zhangyue 
   
   ## JIRA info
   
   - Link: https://issues.apache.org/jira/browse/HUDI-6445
   - Type: Test
   - Epic: https://issues.apache.org/jira/browse/HUDI-4302


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Fix CI stability Jun 26, 2023 [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on issue #16058:
URL: https://github.com/apache/hudi/issues/16058#issuecomment-3630137975

   ### Linked PR(s)
   
   - https://github.com/apache/hudi/pull/9060
   - https://github.com/apache/hudi/pull/9062
   - https://github.com/apache/hudi/pull/9072
   - https://github.com/apache/hudi/pull/9078
   - https://github.com/apache/hudi/pull/9080
   - https://github.com/apache/hudi/pull/9081
   - https://github.com/apache/hudi/pull/9082
   - https://github.com/apache/hudi/pull/9104
   - https://github.com/apache/hudi/pull/9522
   - https://github.com/apache/hudi/pull/9525
   - https://github.com/apache/hudi/pull/9526
   - https://github.com/apache/hudi/pull/9527
   - https://github.com/apache/hudi/pull/9528
   - https://github.com/apache/hudi/pull/9530
   - https://github.com/apache/hudi/pull/9531
   - https://github.com/apache/hudi/pull/9532
   - https://github.com/apache/hudi/pull/9533
   - https://github.com/apache/hudi/pull/9534
   - https://github.com/apache/hudi/pull/9540
   - https://github.com/apache/hudi/pull/9541
   - https://github.com/apache/hudi/pull/9542
   - https://github.com/apache/hudi/pull/9543


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Fix CI stability Jun 26, 2023 [hudi]

Posted by "rangareddy (via GitHub)" <gi...@apache.org>.
rangareddy commented on issue #16058:
URL: https://github.com/apache/hudi/issues/16058#issuecomment-5068131732

   This issue was reviewed as part of the JIRA-migrated backlog triage.
   
   Findings: This is a point-in-time CI-stability snapshot from June 2023 (HUDI-6445) that listed the slowest and most flaky tests during that week's build failures, referencing Azure Pipelines build IDs that are now obsolete. It is over three years old with no current reproduction and no single actionable defect; CI has since changed substantially and the linked PRs were point-in-time cleanups. 
   
   Closing as stale. Current CI flakiness or slow tests should be tracked in fresh, specific issues against a recent build.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Fix CI stability Jun 26, 2023 [hudi]

Posted by "rangareddy (via GitHub)" <gi...@apache.org>.
rangareddy closed issue #16058: Fix CI stability Jun 26, 2023
URL: https://github.com/apache/hudi/issues/16058


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org