You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "hudi-bot (via GitHub)" <gi...@apache.org> on 2025/11/30 08:59:43 UTC

[I] Fix flaky testUpsertsContinuousModeWithMultipleWritersForConflicts [hudi]

hudi-bot opened a new issue, #16228:
URL: https://github.com/apache/hudi/issues/16228

   Ref link:
   
   [https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_apis/build/builds/19774/logs/45]
   
    
   {code:java}
   2023-09-09T09:02:21.5113301Z [ERROR] Tests run: 5, Failures: 0, Errors: 1, Skipped: 1, Time elapsed: 483.7 s <<< FAILURE! - in org.apache.hudi.utilities.deltastreamer.TestHoodieDeltaStreamerWithMultiWriter
   2023-09-09T09:02:21.5131537Z [ERROR] testUpsertsContinuousModeWithMultipleWritersForConflicts{HoodieTableType}[1]  Time elapsed: 360.549 s  <<< ERROR!
   2023-09-09T09:02:21.5132223Z java.util.concurrent.TimeoutException
   2023-09-09T09:02:21.5132617Z 	at java.util.concurrent.FutureTask.get(FutureTask.java:205)
   2023-09-09T09:02:21.5133105Z 	at org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamerTestBase$TestHelpers.waitTillCondition(HoodieDeltaStreamerTestBase.java:650)
   2023-09-09T09:02:21.5133691Z 	at org.apache.hudi.utilities.deltastreamer.TestHoodieDeltaStreamer.deltaStreamerTestRunner(TestHoodieDeltaStreamer.java:737)
   2023-09-09T09:02:21.5134279Z 	at org.apache.hudi.utilities.deltastreamer.TestHoodieDeltaStreamer.deltaStreamerTestRunner(TestHoodieDeltaStreamer.java:725)
   2023-09-09T09:02:21.5134959Z 	at org.apache.hudi.utilities.deltastreamer.TestHoodieDeltaStreamerWithMultiWriter.testUpsertsContinuousModeWithMultipleWritersForConflicts(TestHoodieDeltaStreamerWithMultiWriter.java:114)
   2023-09-09T09:02:21.5135495Z 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   2023-09-09T09:02:21.5135904Z 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   2023-09-09T09:02:21.5136357Z 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   2023-09-09T09:02:21.5136863Z 	at java.lang.reflect.Method.invoke(Method.java:498)
   2023-09-09T09:02:21.5137261Z 	at org.junit.platform.commons.util.ReflectionUtils.invokeMethod(ReflectionUtils.java:688)
   2023-09-09T09:02:21.5137718Z 	at org.junit.jupiter.engine.execution.MethodInvocation.proceed(MethodInvocation.java:60)
   2023-09-09T09:02:21.5138237Z 	at org.junit.jupiter.engine.execution.InvocationInterceptorChain$ValidatingInvocation.proceed(InvocationInterceptorChain.java:131)
   2023-09-09T09:02:21.5138748Z 	at org.junit.jupiter.engine.extension.TimeoutExtension.intercept(TimeoutExtension.java:149)
   2023-09-09T09:02:21.5139231Z 	at org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestableMethod(TimeoutExtension.java:140)
   2023-09-09T09:02:21.5139748Z 	at org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestTemplateMethod(TimeoutExtension.java:92)
   2023-09-09T09:02:21.5140298Z 	at org.junit.jupiter.engine.execution.ExecutableInvoker$ReflectiveInterceptorCall.lambda$ofVoidMethod$0(ExecutableInvoker.java:115)
   2023-09-09T09:02:21.5140825Z 	at org.junit.jupiter.engine.execution.ExecutableInvoker.lambda$invoke$0(ExecutableInvoker.java:105)
   2023-09-09T09:02:21.5141354Z 	at org.junit.jupiter.engine.execution.InvocationInterceptorChain$InterceptedInvocation.proceed(InvocationInterceptorChain.java:106)
   2023-09-09T09:02:21.5141877Z 	at org.junit.jupiter.engine.execution.InvocationInterceptorChain.proceed(InvocationInterceptorChain.java:64)
   2023-09-09T09:02:21.5142406Z 	at org.junit.jupiter.engine.execution.InvocationInterceptorChain.chainAndInvoke(InvocationInterceptorChain.java:45)
   2023-09-09T09:02:21.5142926Z 	at org.junit.jupiter.engine.execution.InvocationInterceptorChain.invoke(InvocationInterceptorChain.java:37)
   2023-09-09T09:02:21.5143710Z 	at org.junit.jupiter.engine.execution.ExecutableInvoker.invoke(ExecutableInvoker.java:104)
   2023-09-09T09:02:21.5144154Z 	at org.junit.jupiter.engine.execution.ExecutableInvoker.invoke(ExecutableInvoker.java:98)
   2023-09-09T09:02:21.5144658Z 	at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.lambda$invokeTestMethod$6(TestMethodTestDescriptor.java:210)
   2023-09-09T09:02:21.5145189Z 	at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
   2023-09-09T09:02:21.5145689Z 	at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.invokeTestMethod(TestMethodTestDescriptor.java:206)
   2023-09-09T09:02:21.5146202Z 	at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.execute(TestMethodTestDescriptor.java:131)
   2023-09-09T09:02:21.5146832Z 	at org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.execute(TestMethodTestDescriptor.java:65)
   2023-09-09T09:02:21.5147344Z 	at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$5(NodeTestTask.java:139)
   2023-09-09T09:02:21.5147840Z 	at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
   2023-09-09T09:02:21.5148352Z 	at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$7(NodeTestTask.java:129)
   2023-09-09T09:02:21.5148825Z 	at org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137)
   2023-09-09T09:02:21.5149319Z 	at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:127)
   2023-09-09T09:02:21.5149808Z 	at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
   2023-09-09T09:02:21.5150307Z 	at org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:126)
   2023-09-09T09:02:21.5150790Z 	at org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:84)
   2023-09-09T09:02:21.5151398Z 	at org.junit.platform.engine.support.hierarchical.SameThreadHierarchicalTestExecutorService.submit(SameThreadHierarchicalTestExecutorService.java:32)
   2023-09-09T09:02:21.5151984Z 	at org.junit.platform.engine.support.hierarchical.NodeTestTask$DefaultDynamicTestExecutor.execute(NodeTestTask.java:212)
   2023-09-09T09:02:21.5152508Z 	at org.junit.platform.engine.support.hierarchical.NodeTestTask$DefaultDynamicTestExecutor.execute(NodeTestTask.java:192)
   2023-09-09T09:02:21.5153057Z 	at org.junit.jupiter.engine.descriptor.TestTemplateTestDescriptor.execute(TestTemplateTestDescriptor.java:139)
   2023-09-09T09:02:21.5153583Z 	at org.junit.jupiter.engine.descriptor.TestTemplateTestDescriptor.lambda$execute$2(TestTemplateTestDescriptor.java:107)
   2023-09-09T09:02:21.5154048Z 	at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183)
   2023-09-09T09:02:21.5154476Z 	at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
   2023-09-09T09:02:21.5154899Z 	at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)
   2023-09-09T09:02:21.5155324Z 	at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
   2023-09-09T09:02:21.5155727Z 	at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183)
   2023-09-09T09:02:21.5156129Z 	at java.util.stream.ReferencePipeline$11$1.accept(ReferencePipeline.java:440)
   2023-09-09T09:02:21.5156564Z 	at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
   2023-09-09T09:02:21.5156987Z 	at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
   2023-09-09T09:02:21.5157388Z 	at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
   2023-09-09T09:02:21.5157785Z 	at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183)
   2023-09-09T09:02:21.5158205Z 	at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
   2023-09-09T09:02:21.5158614Z 	at java.util.Iterator.forEachRemaining(Iterator.java:116)
   2023-09-09T09:02:21.5159101Z 	at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
   2023-09-09T09:02:21.5159518Z 	at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)
   2023-09-09T09:02:21.5159922Z 	at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)
   2023-09-09T09:02:21.5160367Z 	at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:150)
   2023-09-09T09:02:21.5160814Z 	at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:173)
   2023-09-09T09:02:21.5161227Z 	at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
   2023-09-09T09:02:21.5161639Z 	at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:485)
   2023-09-09T09:02:21.5162056Z 	at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:272)
   2023-09-09T09:02:21.5162695Z 	at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
   2023-09-09T09:02:21.5163334Z 	at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
   2023-09-09T09:02:21.5163770Z 	at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
   2023-09-09T09:02:21.5164199Z 	at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1384)
   2023-09-09T09:02:21.5164625Z 	at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)
   2023-09-09T09:02:21.5165034Z 	at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)
   2023-09-09T09:02:21.5165449Z 	at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:150)
   2023-09-09T09:02:21.5165906Z 	at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:173)
   2023-09-09T09:02:21.5166342Z 	at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
   2023-09-09T09:02:21.5166742Z 	at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:485)
   2023-09-09T09:02:21.5167142Z 	at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:272)
   2023-09-09T09:02:21.5167581Z 	at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1384)
   2023-09-09T09:02:21.5168019Z 	at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)
   2023-09-09T09:02:21.5168806Z 	at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)
   2023-09-09T09:02:21.5169245Z 	at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:150)
   2023-09-09T09:02:21.5169694Z 	at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:173)
   2023-09-09T09:02:21.5170127Z 	at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
   2023-09-09T09:02:21.5170544Z 	at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:485)
   2023-09-09T09:02:21.5170990Z 	at org.junit.jupiter.engine.descriptor.TestTemplateTestDescriptor.execute(TestTemplateTestDescriptor.java:107)
   2023-09-09T09:02:21.5171722Z 	at org.junit.jupiter.engine.descriptor.TestTemplateTestDescriptor.execute(TestTemplateTestDescriptor.java:42)
   2023-09-09T09:02:21.5172255Z 	at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$5(NodeTestTask.java:139)
   2023-09-09T09:02:21.5172766Z 	at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
   2023-09-09T09:02:21.5173256Z 	at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$7(NodeTestTask.java:129)
   2023-09-09T09:02:21.5179226Z 	at org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137)
   2023-09-09T09:02:21.5179789Z 	at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:127)
   2023-09-09T09:02:21.5180367Z 	at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
   2023-09-09T09:02:21.5180869Z 	at org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:126)
   2023-09-09T09:02:21.5181337Z 	at org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:84)
   2023-09-09T09:02:21.5181970Z 	at java.util.ArrayList.forEach(ArrayList.java:1259)
   2023-09-09T09:02:21.5182490Z 	at org.junit.platform.engine.support.hierarchical.SameThreadHierarchicalTestExecutorService.invokeAll(SameThreadHierarchicalTestExecutorService.java:38)
   2023-09-09T09:02:21.5183065Z 	at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$5(NodeTestTask.java:143)
   2023-09-09T09:02:21.5183645Z 	at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
   2023-09-09T09:02:21.5184123Z 	at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$7(NodeTestTask.java:129)
   2023-09-09T09:02:21.5184561Z 	at org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137)
   2023-09-09T09:02:21.5185081Z 	at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:127)
   2023-09-09T09:02:21.5185556Z 	at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
   2023-09-09T09:02:21.5186039Z 	at org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:126)
   2023-09-09T09:02:21.5186469Z 	at org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:84)
   2023-09-09T09:02:21.5186839Z 	at java.util.ArrayList.forEach(ArrayList.java:1259)
   2023-09-09T09:02:21.5187300Z 	at org.junit.platform.engine.support.hierarchical.SameThreadHierarchicalTestExecutorService.invokeAll(SameThreadHierarchicalTestExecutorService.java:38)
   2023-09-09T09:02:21.5187810Z 	at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$5(NodeTestTask.java:143)
   2023-09-09T09:02:21.5188305Z 	at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
   2023-09-09T09:02:21.5188756Z 	at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$7(NodeTestTask.java:129)
   2023-09-09T09:02:21.5189190Z 	at org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137)
   2023-09-09T09:02:21.5189629Z 	at org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:127)
   2023-09-09T09:02:21.5190078Z 	at org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
   2023-09-09T09:02:21.5190732Z 	at org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:126)
   2023-09-09T09:02:21.5191199Z 	at org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:84)
   2023-09-09T09:02:21.5191907Z 	at org.junit.platform.engine.support.hierarchical.SameThreadHierarchicalTestExecutorService.submit(SameThreadHierarchicalTestExecutorService.java:32)
   2023-09-09T09:02:21.5192471Z 	at org.junit.platform.engine.support.hierarchical.HierarchicalTestExecutor.execute(HierarchicalTestExecutor.java:57)
   2023-09-09T09:02:21.5192976Z 	at org.junit.platform.engine.support.hierarchical.HierarchicalTestEngine.execute(HierarchicalTestEngine.java:51)
   2023-09-09T09:02:21.5193515Z 	at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:108)
   2023-09-09T09:02:21.5194026Z 	at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:88)
   2023-09-09T09:02:21.5194532Z 	at org.junit.platform.launcher.core.EngineExecutionOrchestrator.lambda$execute$0(EngineExecutionOrchestrator.java:54)
   2023-09-09T09:02:21.5195118Z 	at org.junit.platform.launcher.core.EngineExecutionOrchestrator.withInterceptedStreams(EngineExecutionOrchestrator.java:67)
   2023-09-09T09:02:21.5195648Z 	at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:52)
   2023-09-09T09:02:21.5196113Z 	at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:96)
   2023-09-09T09:02:21.5196539Z 	at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:75)
   2023-09-09T09:02:21.5197684Z 	at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invokeAllTests(JUnitPlatformProvider.java:150)
   2023-09-09T09:02:21.5198193Z 	at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invoke(JUnitPlatformProvider.java:124)
   2023-09-09T09:02:21.5198598Z 	at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384)
   2023-09-09T09:02:21.5198967Z 	at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345)
   2023-09-09T09:02:21.5199325Z 	at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126)
   2023-09-09T09:02:21.5199663Z 	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418)
   2023-09-09T09:02:21.5254475Z  {code}
   
   ## JIRA info
   
   - Link: https://issues.apache.org/jira/browse/HUDI-6843
   - Type: Test
   - Epic: https://issues.apache.org/jira/browse/HUDI-4302


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Fix flaky testUpsertsContinuousModeWithMultipleWritersForConflicts [hudi]

Posted by "rangareddy (via GitHub)" <gi...@apache.org>.
rangareddy commented on issue #16228:
URL: https://github.com/apache/hudi/issues/16228#issuecomment-5434649041

   This issue was reviewed as part of the JIRA-migrated backlog triage (HUDI-6843).
   
   **Findings: still open.**
   
   No commit on `master` references HUDI-6843, so nothing has landed under this ticket's key.
   
   The description is substantive and self-describing, so this is workable as written - what is missing is an owner rather than a specification.
   
   Keeping this open.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org