You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Yun Gao (Jira)" <ji...@apache.org> on 2021/12/31 10:27:00 UTC
[jira] [Created] (FLINK-25498) FlinkKafkaProducerITCase. testRestoreToCheckpointAfterExceedingProducersPool failed on azure
Yun Gao created FLINK-25498:
-------------------------------
Summary: FlinkKafkaProducerITCase. testRestoreToCheckpointAfterExceedingProducersPool failed on azure
Key: FLINK-25498
URL: https://issues.apache.org/jira/browse/FLINK-25498
Project: Flink
Issue Type: Bug
Components: kafka
Affects Versions: 1.14.2
Reporter: Yun Gao
{code:java}
2021-12-31T08:14:15.9176162Z Dec 31 08:14:15 [ERROR] testRestoreToCheckpointAfterExceedingProducersPool Time elapsed: 74.087 s <<< FAILURE!
2021-12-31T08:14:15.9176809Z Dec 31 08:14:15 java.lang.AssertionError: Expected elements: <[42]>, but was: elements: <[42, 42, 42, 42]>
2021-12-31T08:14:15.9177351Z Dec 31 08:14:15 at org.junit.Assert.fail(Assert.java:89)
2021-12-31T08:14:15.9177963Z Dec 31 08:14:15 at org.apache.flink.streaming.connectors.kafka.KafkaTestBase.assertExactlyOnceForTopic(KafkaTestBase.java:331)
2021-12-31T08:14:15.9183636Z Dec 31 08:14:15 at org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerITCase.testRestoreToCheckpointAfterExceedingProducersPool(FlinkKafkaProducerITCase.java:159)
2021-12-31T08:14:15.9184980Z Dec 31 08:14:15 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2021-12-31T08:14:15.9185908Z Dec 31 08:14:15 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2021-12-31T08:14:15.9186954Z Dec 31 08:14:15 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2021-12-31T08:14:15.9187888Z Dec 31 08:14:15 at java.lang.reflect.Method.invoke(Method.java:498)
2021-12-31T08:14:15.9188819Z Dec 31 08:14:15 at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
2021-12-31T08:14:15.9189826Z Dec 31 08:14:15 at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
2021-12-31T08:14:15.9191068Z Dec 31 08:14:15 at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
2021-12-31T08:14:15.9191923Z Dec 31 08:14:15 at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
2021-12-31T08:14:15.9193167Z Dec 31 08:14:15 at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
2021-12-31T08:14:15.9193891Z Dec 31 08:14:15 at org.apache.flink.testutils.junit.RetryRule$RetryOnFailureStatement.evaluate(RetryRule.java:135)
2021-12-31T08:14:15.9194516Z Dec 31 08:14:15 at org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
2021-12-31T08:14:15.9195078Z Dec 31 08:14:15 at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
2021-12-31T08:14:15.9195616Z Dec 31 08:14:15 at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
2021-12-31T08:14:15.9196194Z Dec 31 08:14:15 at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
2021-12-31T08:14:15.9196762Z Dec 31 08:14:15 at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
2021-12-31T08:14:15.9197389Z Dec 31 08:14:15 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
2021-12-31T08:14:15.9197988Z Dec 31 08:14:15 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
2021-12-31T08:14:15.9198818Z Dec 31 08:14:15 at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
2021-12-31T08:14:15.9199544Z Dec 31 08:14:15 at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
2021-12-31T08:14:15.9200367Z Dec 31 08:14:15 at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
2021-12-31T08:14:15.9200914Z Dec 31 08:14:15 at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
2021-12-31T08:14:15.9201465Z Dec 31 08:14:15 at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
2021-12-31T08:14:15.9202369Z Dec 31 08:14:15 at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
2021-12-31T08:14:15.9203399Z Dec 31 08:14:15 at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
2021-12-31T08:14:15.9203973Z Dec 31 08:14:15 at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
2021-12-31T08:14:15.9204504Z Dec 31 08:14:15 at org.junit.rules.RunRules.evaluate(RunRules.java:20)
2021-12-31T08:14:15.9205027Z Dec 31 08:14:15 at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
2021-12-31T08:14:15.9205549Z Dec 31 08:14:15 at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
2021-12-31T08:14:15.9206053Z Dec 31 08:14:15 at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
2021-12-31T08:14:15.9206540Z Dec 31 08:14:15 at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
2021-12-31T08:14:15.9207069Z Dec 31 08:14:15 at org.junit.vintage.engine.execution.RunnerExecutor.execute(RunnerExecutor.java:43)
2021-12-31T08:14:15.9207661Z Dec 31 08:14:15 at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183)
2021-12-31T08:14:15.9208412Z Dec 31 08:14:15 at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
2021-12-31T08:14:15.9208957Z Dec 31 08:14:15 at java.util.Iterator.forEachRemaining(Iterator.java:116)
2021-12-31T08:14:15.9209512Z Dec 31 08:14:15 at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
2021-12-31T08:14:15.9210113Z Dec 31 08:14:15 at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)
2021-12-31T08:14:15.9210688Z Dec 31 08:14:15 at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)
2021-12-31T08:14:15.9211258Z Dec 31 08:14:15 at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:150)
2021-12-31T08:14:15.9211861Z Dec 31 08:14:15 at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:173)
2021-12-31T08:14:15.9212446Z Dec 31 08:14:15 at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
2021-12-31T08:14:15.9213288Z Dec 31 08:14:15 at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:485)
2021-12-31T08:14:15.9214004Z Dec 31 08:14:15 at org.junit.vintage.engine.VintageTestEngine.executeAllChildren(VintageTestEngine.java:82)
2021-12-31T08:14:15.9214792Z Dec 31 08:14:15 at org.junit.vintage.engine.VintageTestEngine.execute(VintageTestEngine.java:73)
2021-12-31T08:14:15.9215739Z Dec 31 08:14:15 at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:220)
2021-12-31T08:14:15.9216617Z Dec 31 08:14:15 at org.junit.platform.launcher.core.DefaultLauncher.lambda$execute$6(DefaultLauncher.java:188)
2021-12-31T08:14:15.9217412Z Dec 31 08:14:15 at org.junit.platform.launcher.core.DefaultLauncher.withInterceptedStreams(DefaultLauncher.java:202)
2021-12-31T08:14:15.9218088Z Dec 31 08:14:15 at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:181)
2021-12-31T08:14:15.9218827Z Dec 31 08:14:15 at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:128)
2021-12-31T08:14:15.9219507Z Dec 31 08:14:15 at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invokeAllTests(JUnitPlatformProvider.java:150)
2021-12-31T08:14:15.9220205Z Dec 31 08:14:15 at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invoke(JUnitPlatformProvider.java:120)
2021-12-31T08:14:15.9221047Z Dec 31 08:14:15 at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384)
2021-12-31T08:14:15.9221917Z Dec 31 08:14:15 at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345)
2021-12-31T08:14:15.9222532Z Dec 31 08:14:15 at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126)
2021-12-31T08:14:15.9223499Z Dec 31 08:14:15 at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418)
2021-12-31T08:14:15.9225268Z Dec 31 08:14:15 Suppressed: org.apache.flink.streaming.connectors.kafka.FlinkKafkaException: Failed to send data to Kafka: Producer attempted an operation with an old epoch. Either there is a newer producer with the same transactionalId, or the producer's transaction has been expired by the broker.
2021-12-31T08:14:15.9226290Z Dec 31 08:14:15 at org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.checkErroneous(FlinkKafkaProducer.java:1429)
2021-12-31T08:14:15.9226969Z Dec 31 08:14:15 at org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.close(FlinkKafkaProducer.java:977)
2021-12-31T08:14:15.9227632Z Dec 31 08:14:15 at org.apache.flink.api.common.functions.util.FunctionUtils.closeFunction(FunctionUtils.java:41)
2021-12-31T08:14:15.9228314Z Dec 31 08:14:15 at org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.close(AbstractUdfStreamOperator.java:114)
2021-12-31T08:14:15.9229035Z Dec 31 08:14:15 at org.apache.flink.streaming.util.AbstractStreamOperatorTestHarness.close(AbstractStreamOperatorTestHarness.java:726)
2021-12-31T08:14:15.9229853Z Dec 31 08:14:15 at org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerITCase.testRestoreToCheckpointAfterExceedingProducersPool(FlinkKafkaProducerITCase.java:161)
2021-12-31T08:14:15.9230602Z Dec 31 08:14:15 ... 54 more
2021-12-31T08:14:15.9231641Z Dec 31 08:14:15 Caused by: org.apache.kafka.common.errors.ProducerFencedException: Producer attempted an operation with an old epoch. Either there is a newer producer with the same transactionalId, or the producer's transaction has been expired by the broker.
2021-12-31T08:14:15.9232332Z Dec 31 08:14:15
2021-12-31T08:14:16.4493533Z Dec 31 08:14:16 [INFO]
2021-12-31T08:14:16.4494222Z Dec 31 08:14:16 [INFO] Results:
2021-12-31T08:14:16.4494741Z Dec 31 08:14:16 [INFO]
2021-12-31T08:14:16.4495080Z Dec 31 08:14:16 [ERROR] Failures:
2021-12-31T08:14:16.4496559Z Dec 31 08:14:16 [ERROR] FlinkKafkaProducerITCase.testRestoreToCheckpointAfterExceedingProducersPool:159->KafkaTestBase.assertExactlyOnceForTopic:331 Expected elements: <[42]>, but was: elements: <[42, 42, 42, 42]>
2021-12-31T08:14:16.4497521Z Dec 31 08:14:16 [INFO] {code}
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=28786&view=logs&j=c5f0071e-1851-543e-9a45-9ac140befc32&t=15a22db7-8faa-5b34-3920-d33c9f0ca23c&l=7412
--
This message was sent by Atlassian Jira
(v8.20.1#820001)