You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Flink Jira Bot (Jira)" <ji...@apache.org> on 2022/07/06 22:39:00 UTC
[jira] [Updated] (FLINK-25456) FlinkKafkaProducerITCase.testScaleDownBeforeFirstCheckpoint
[ https://issues.apache.org/jira/browse/FLINK-25456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Flink Jira Bot updated FLINK-25456:
-----------------------------------
Labels: auto-deprioritized-critical stale-major test-stability (was: auto-deprioritized-critical test-stability)
I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help the community manage its development. I see this issues has been marked as Major but is unassigned and neither itself nor its Sub-Tasks have been updated for 60 days. I have gone ahead and added a "stale-major" to the issue". If this ticket is a Major, please either assign yourself or give an update. Afterwards, please remove the label or in 7 days the issue will be deprioritized.
> FlinkKafkaProducerITCase.testScaleDownBeforeFirstCheckpoint
> -----------------------------------------------------------
>
> Key: FLINK-25456
> URL: https://issues.apache.org/jira/browse/FLINK-25456
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Kafka
> Affects Versions: 1.14.2, 1.15.0
> Reporter: Till Rohrmann
> Priority: Major
> Labels: auto-deprioritized-critical, stale-major, test-stability
>
> The test {{FlinkKafkaProducerITCase.testScaleDownBeforeFirstCheckpoint}} fails with
> {code}
> 2021-12-27T02:54:54.8464375Z Dec 27 02:54:54 [ERROR] Tests run: 15, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 285.279 s <<< FAILURE! - in org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerITCase
> 2021-12-27T02:54:54.8465354Z Dec 27 02:54:54 [ERROR] testScaleDownBeforeFirstCheckpoint Time elapsed: 85.514 s <<< FAILURE!
> 2021-12-27T02:54:54.8468827Z Dec 27 02:54:54 java.lang.AssertionError: Detected producer leak. Thread name: kafka-producer-network-thread | producer-MockTask-000000000000002a000000000000002c-18
> 2021-12-27T02:54:54.8469779Z Dec 27 02:54:54 at org.junit.Assert.fail(Assert.java:89)
> 2021-12-27T02:54:54.8470485Z Dec 27 02:54:54 at org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerITCase.checkProducerLeak(FlinkKafkaProducerITCase.java:847)
> 2021-12-27T02:54:54.8471842Z Dec 27 02:54:54 at org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerITCase.testScaleDownBeforeFirstCheckpoint(FlinkKafkaProducerITCase.java:381)
> 2021-12-27T02:54:54.8472724Z Dec 27 02:54:54 at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 2021-12-27T02:54:54.8473509Z Dec 27 02:54:54 at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 2021-12-27T02:54:54.8474704Z Dec 27 02:54:54 at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 2021-12-27T02:54:54.8475523Z Dec 27 02:54:54 at java.base/java.lang.reflect.Method.invoke(Method.java:566)
> 2021-12-27T02:54:54.8476258Z Dec 27 02:54:54 at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
> 2021-12-27T02:54:54.8476949Z Dec 27 02:54:54 at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 2021-12-27T02:54:54.8477632Z Dec 27 02:54:54 at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
> 2021-12-27T02:54:54.8478451Z Dec 27 02:54:54 at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> 2021-12-27T02:54:54.8479282Z Dec 27 02:54:54 at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> 2021-12-27T02:54:54.8479976Z Dec 27 02:54:54 at org.apache.flink.testutils.junit.RetryRule$RetryOnFailureStatement.evaluate(RetryRule.java:135)
> 2021-12-27T02:54:54.8480696Z Dec 27 02:54:54 at org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
> 2021-12-27T02:54:54.8481410Z Dec 27 02:54:54 at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
> 2021-12-27T02:54:54.8482009Z Dec 27 02:54:54 at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
> 2021-12-27T02:54:54.8482636Z Dec 27 02:54:54 at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
> 2021-12-27T02:54:54.8483267Z Dec 27 02:54:54 at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
> 2021-12-27T02:54:54.8483900Z Dec 27 02:54:54 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
> 2021-12-27T02:54:54.8484574Z Dec 27 02:54:54 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
> 2021-12-27T02:54:54.8485214Z Dec 27 02:54:54 at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
> 2021-12-27T02:54:54.8485838Z Dec 27 02:54:54 at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
> 2021-12-27T02:54:54.8486441Z Dec 27 02:54:54 at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
> 2021-12-27T02:54:54.8487037Z Dec 27 02:54:54 at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
> 2021-12-27T02:54:54.8487620Z Dec 27 02:54:54 at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
> 2021-12-27T02:54:54.8488391Z Dec 27 02:54:54 at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> 2021-12-27T02:54:54.8489050Z Dec 27 02:54:54 at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
> 2021-12-27T02:54:54.8489685Z Dec 27 02:54:54 at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
> 2021-12-27T02:54:54.8490269Z Dec 27 02:54:54 at org.junit.rules.RunRules.evaluate(RunRules.java:20)
> 2021-12-27T02:54:54.8490844Z Dec 27 02:54:54 at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
> 2021-12-27T02:54:54.8491498Z Dec 27 02:54:54 at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
> 2021-12-27T02:54:54.8492038Z Dec 27 02:54:54 at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
> 2021-12-27T02:54:54.8492578Z Dec 27 02:54:54 at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
> 2021-12-27T02:54:54.8493179Z Dec 27 02:54:54 at org.junit.vintage.engine.execution.RunnerExecutor.execute(RunnerExecutor.java:43)
> 2021-12-27T02:54:54.8493836Z Dec 27 02:54:54 at java.base/java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183)
> 2021-12-27T02:54:54.8494493Z Dec 27 02:54:54 at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
> 2021-12-27T02:54:54.8495111Z Dec 27 02:54:54 at java.base/java.util.Iterator.forEachRemaining(Iterator.java:133)
> 2021-12-27T02:54:54.8495760Z Dec 27 02:54:54 at java.base/java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
> 2021-12-27T02:54:54.8496418Z Dec 27 02:54:54 at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)
> 2021-12-27T02:54:54.8497202Z Dec 27 02:54:54 at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)
> 2021-12-27T02:54:54.8497877Z Dec 27 02:54:54 at java.base/java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:150)
> 2021-12-27T02:54:54.8498721Z Dec 27 02:54:54 at java.base/java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:173)
> 2021-12-27T02:54:54.8499399Z Dec 27 02:54:54 at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
> 2021-12-27T02:54:54.8500050Z Dec 27 02:54:54 at java.base/java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:497)
> 2021-12-27T02:54:54.8500751Z Dec 27 02:54:54 at org.junit.vintage.engine.VintageTestEngine.executeAllChildren(VintageTestEngine.java:82)
> 2021-12-27T02:54:54.8501613Z Dec 27 02:54:54 at org.junit.vintage.engine.VintageTestEngine.execute(VintageTestEngine.java:73)
> 2021-12-27T02:54:54.8502275Z Dec 27 02:54:54 at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:220)
> 2021-12-27T02:54:54.8502962Z Dec 27 02:54:54 at org.junit.platform.launcher.core.DefaultLauncher.lambda$execute$6(DefaultLauncher.java:188)
> 2021-12-27T02:54:54.8503692Z Dec 27 02:54:54 at org.junit.platform.launcher.core.DefaultLauncher.withInterceptedStreams(DefaultLauncher.java:202)
> 2021-12-27T02:54:54.8504405Z Dec 27 02:54:54 at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:181)
> 2021-12-27T02:54:54.8505078Z Dec 27 02:54:54 at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:128)
> 2021-12-27T02:54:54.8505813Z Dec 27 02:54:54 at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invokeAllTests(JUnitPlatformProvider.java:150)
> 2021-12-27T02:54:54.8506580Z Dec 27 02:54:54 at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invoke(JUnitPlatformProvider.java:120)
> 2021-12-27T02:54:54.8507331Z Dec 27 02:54:54 at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384)
> 2021-12-27T02:54:54.8508149Z Dec 27 02:54:54 at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345)
> 2021-12-27T02:54:54.8508880Z Dec 27 02:54:54 at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126)
> 2021-12-27T02:54:54.8509523Z Dec 27 02:54:54 at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418)
> 2021-12-27T02:54:54.8509996Z Dec 27 02:54:54
> 2021-12-27T02:54:55.3284748Z Dec 27 02:54:55 [INFO]
> 2021-12-27T02:54:55.3285368Z Dec 27 02:54:55 [INFO] Results:
> 2021-12-27T02:54:55.3285735Z Dec 27 02:54:55 [INFO]
> 2021-12-27T02:54:55.3286103Z Dec 27 02:54:55 [ERROR] Failures:
> 2021-12-27T02:54:55.3287741Z Dec 27 02:54:55 [ERROR] FlinkKafkaProducerITCase.testScaleDownBeforeFirstCheckpoint:381->checkProducerLeak:847 Detected producer leak. Thread name: kafka-producer-network-thread | producer-MockTask-000000000000002a000000000000002c-18
> {code}
> The problem seems to be that a producer leak has been detected (cc [~fpaul]).
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=28602&view=logs&j=ce8f3cc3-c1ea-5281-f5eb-df9ebd24947f&t=918e890f-5ed9-5212-a25e-962628fb4bc5&l=7186
--
This message was sent by Atlassian Jira
(v8.20.10#820010)