You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Martijn Visser (Jira)" <ji...@apache.org> on 2023/04/24 12:21:00 UTC

[jira] [Updated] (FLINK-25498) FlinkKafkaProducerITCase. testRestoreToCheckpointAfterExceedingProducersPool failed on azure

     [ https://issues.apache.org/jira/browse/FLINK-25498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Martijn Visser updated FLINK-25498:
-----------------------------------
    Component/s: Connectors / Kafka
                     (was: kafka)

> FlinkKafkaProducerITCase. testRestoreToCheckpointAfterExceedingProducersPool failed on azure
> --------------------------------------------------------------------------------------------
>
>                 Key: FLINK-25498
>                 URL: https://issues.apache.org/jira/browse/FLINK-25498
>             Project: Flink
>          Issue Type: Bug
>          Components: Connectors / Kafka
>    Affects Versions: 1.14.2
>            Reporter: Yun Gao
>            Priority: Minor
>              Labels: auto-deprioritized-major, test-stability
>
> {code:java}
> 2021-12-31T08:14:15.9176809Z Dec 31 08:14:15 java.lang.AssertionError: Expected elements: <[42]>, but was: elements: <[42, 42, 42, 42]>
> 2021-12-31T08:14:15.9177351Z Dec 31 08:14:15 	at org.junit.Assert.fail(Assert.java:89)
> 2021-12-31T08:14:15.9177963Z Dec 31 08:14:15 	at org.apache.flink.streaming.connectors.kafka.KafkaTestBase.assertExactlyOnceForTopic(KafkaTestBase.java:331)
> 2021-12-31T08:14:15.9183636Z Dec 31 08:14:15 	at org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerITCase.testRestoreToCheckpointAfterExceedingProducersPool(FlinkKafkaProducerITCase.java:159)
> 2021-12-31T08:14:15.9184980Z Dec 31 08:14:15 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 2021-12-31T08:14:15.9185908Z Dec 31 08:14:15 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 2021-12-31T08:14:15.9186954Z Dec 31 08:14:15 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 2021-12-31T08:14:15.9187888Z Dec 31 08:14:15 	at java.lang.reflect.Method.invoke(Method.java:498)
> 2021-12-31T08:14:15.9188819Z Dec 31 08:14:15 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
> 2021-12-31T08:14:15.9189826Z Dec 31 08:14:15 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 2021-12-31T08:14:15.9191068Z Dec 31 08:14:15 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
> 2021-12-31T08:14:15.9191923Z Dec 31 08:14:15 	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> 2021-12-31T08:14:15.9193167Z Dec 31 08:14:15 	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> 2021-12-31T08:14:15.9193891Z Dec 31 08:14:15 	at org.apache.flink.testutils.junit.RetryRule$RetryOnFailureStatement.evaluate(RetryRule.java:135)
> 2021-12-31T08:14:15.9194516Z Dec 31 08:14:15 	at org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
> 2021-12-31T08:14:15.9195078Z Dec 31 08:14:15 	at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
> 2021-12-31T08:14:15.9195616Z Dec 31 08:14:15 	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
> 2021-12-31T08:14:15.9196194Z Dec 31 08:14:15 	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
> 2021-12-31T08:14:15.9196762Z Dec 31 08:14:15 	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
> 2021-12-31T08:14:15.9197389Z Dec 31 08:14:15 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
> 2021-12-31T08:14:15.9197988Z Dec 31 08:14:15 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
> 2021-12-31T08:14:15.9198818Z Dec 31 08:14:15 	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
> 2021-12-31T08:14:15.9199544Z Dec 31 08:14:15 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
> 2021-12-31T08:14:15.9200367Z Dec 31 08:14:15 	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
> 2021-12-31T08:14:15.9200914Z Dec 31 08:14:15 	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
> 2021-12-31T08:14:15.9201465Z Dec 31 08:14:15 	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
> 2021-12-31T08:14:15.9202369Z Dec 31 08:14:15 	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> 2021-12-31T08:14:15.9203399Z Dec 31 08:14:15 	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
> 2021-12-31T08:14:15.9203973Z Dec 31 08:14:15 	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
> 2021-12-31T08:14:15.9204504Z Dec 31 08:14:15 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
> 2021-12-31T08:14:15.9205027Z Dec 31 08:14:15 	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
> 2021-12-31T08:14:15.9205549Z Dec 31 08:14:15 	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
> 2021-12-31T08:14:15.9206053Z Dec 31 08:14:15 	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
> 2021-12-31T08:14:15.9206540Z Dec 31 08:14:15 	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
> 2021-12-31T08:14:15.9207069Z Dec 31 08:14:15 	at org.junit.vintage.engine.execution.RunnerExecutor.execute(RunnerExecutor.java:43)
> 2021-12-31T08:14:15.9207661Z Dec 31 08:14:15 	at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183)
> 2021-12-31T08:14:15.9208412Z Dec 31 08:14:15 	at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
> 2021-12-31T08:14:15.9208957Z Dec 31 08:14:15 	at java.util.Iterator.forEachRemaining(Iterator.java:116)
> 2021-12-31T08:14:15.9209512Z Dec 31 08:14:15 	at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
> 2021-12-31T08:14:15.9210113Z Dec 31 08:14:15 	at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)
> 2021-12-31T08:14:15.9210688Z Dec 31 08:14:15 	at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)
> 2021-12-31T08:14:15.9211258Z Dec 31 08:14:15 	at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:150)
> 2021-12-31T08:14:15.9211861Z Dec 31 08:14:15 	at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:173)
> 2021-12-31T08:14:15.9212446Z Dec 31 08:14:15 	at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
> 2021-12-31T08:14:15.9213288Z Dec 31 08:14:15 	at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:485)
> 2021-12-31T08:14:15.9214004Z Dec 31 08:14:15 	at org.junit.vintage.engine.VintageTestEngine.executeAllChildren(VintageTestEngine.java:82)
> 2021-12-31T08:14:15.9214792Z Dec 31 08:14:15 	at org.junit.vintage.engine.VintageTestEngine.execute(VintageTestEngine.java:73)
> 2021-12-31T08:14:15.9215739Z Dec 31 08:14:15 	at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:220)
> 2021-12-31T08:14:15.9216617Z Dec 31 08:14:15 	at org.junit.platform.launcher.core.DefaultLauncher.lambda$execute$6(DefaultLauncher.java:188)
> 2021-12-31T08:14:15.9217412Z Dec 31 08:14:15 	at org.junit.platform.launcher.core.DefaultLauncher.withInterceptedStreams(DefaultLauncher.java:202)
> 2021-12-31T08:14:15.9218088Z Dec 31 08:14:15 	at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:181)
> 2021-12-31T08:14:15.9218827Z Dec 31 08:14:15 	at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:128)
> 2021-12-31T08:14:15.9219507Z Dec 31 08:14:15 	at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invokeAllTests(JUnitPlatformProvider.java:150)
> 2021-12-31T08:14:15.9220205Z Dec 31 08:14:15 	at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invoke(JUnitPlatformProvider.java:120)
> 2021-12-31T08:14:15.9221047Z Dec 31 08:14:15 	at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384)
> 2021-12-31T08:14:15.9221917Z Dec 31 08:14:15 	at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345)
> 2021-12-31T08:14:15.9222532Z Dec 31 08:14:15 	at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126)
> 2021-12-31T08:14:15.9223499Z Dec 31 08:14:15 	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418)
> 2021-12-31T08:14:15.9225268Z Dec 31 08:14:15 	Suppressed: org.apache.flink.streaming.connectors.kafka.FlinkKafkaException: Failed to send data to Kafka: Producer attempted an operation with an old epoch. Either there is a newer producer with the same transactionalId, or the producer's transaction has been expired by the broker.
> 2021-12-31T08:14:15.9226290Z Dec 31 08:14:15 		at org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.checkErroneous(FlinkKafkaProducer.java:1429)
> 2021-12-31T08:14:15.9226969Z Dec 31 08:14:15 		at org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.close(FlinkKafkaProducer.java:977)
> 2021-12-31T08:14:15.9227632Z Dec 31 08:14:15 		at org.apache.flink.api.common.functions.util.FunctionUtils.closeFunction(FunctionUtils.java:41)
> 2021-12-31T08:14:15.9228314Z Dec 31 08:14:15 		at org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.close(AbstractUdfStreamOperator.java:114)
> 2021-12-31T08:14:15.9229035Z Dec 31 08:14:15 		at org.apache.flink.streaming.util.AbstractStreamOperatorTestHarness.close(AbstractStreamOperatorTestHarness.java:726)
> 2021-12-31T08:14:15.9229853Z Dec 31 08:14:15 		at org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerITCase.testRestoreToCheckpointAfterExceedingProducersPool(FlinkKafkaProducerITCase.java:161)
> 2021-12-31T08:14:15.9230602Z Dec 31 08:14:15 		... 54 more
> 2021-12-31T08:14:15.9231641Z Dec 31 08:14:15 	Caused by: org.apache.kafka.common.errors.ProducerFencedException: Producer attempted an operation with an old epoch. Either there is a newer producer with the same transactionalId, or the producer's transaction has been expired by the broker.
> 2021-12-31T08:14:15.9232332Z Dec 31 08:14:15 
> {code}
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=28786&view=logs&j=c5f0071e-1851-543e-9a45-9ac140befc32&t=15a22db7-8faa-5b34-3920-d33c9f0ca23c&l=7412



--
This message was sent by Atlassian Jira
(v8.20.10#820010)