You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "xmarker (Jira)" <ji...@apache.org> on 2021/10/13 10:03:00 UTC
[jira] [Commented] (FLINK-24457)
FileSourceTextLinesITCase.testContinuousTextFileSourceWithJobManagerFailover
fails with NoSuchElement
[ https://issues.apache.org/jira/browse/FLINK-24457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17428125#comment-17428125 ]
xmarker commented on FLINK-24457:
---------------------------------
I investigated the relevant code, I think it may be CollectSinkFunction.offset was concurrent use in different thread( the snapshot thread read and the ServerThread thread write)
> FileSourceTextLinesITCase.testContinuousTextFileSourceWithJobManagerFailover fails with NoSuchElement
> -----------------------------------------------------------------------------------------------------
>
> Key: FLINK-24457
> URL: https://issues.apache.org/jira/browse/FLINK-24457
> Project: Flink
> Issue Type: Bug
> Components: Connectors / FileSystem
> Affects Versions: 1.15.0
> Reporter: Dawid Wysakowicz
> Priority: Major
> Labels: test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=24781&view=logs&j=a5ef94ef-68c2-57fd-3794-dc108ed1c495&t=2c68b137-b01d-55c9-e603-3ff3f320364b&l=23849
> {code}
> Oct 06 00:07:54 [ERROR] Tests run: 5, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 41.682 s <<< FAILURE! - in org.apache.flink.connector.file.src.FileSourceTextLinesITCase
> Oct 06 00:07:54 [ERROR] testContinuousTextFileSourceWithJobManagerFailover Time elapsed: 10.826 s <<< ERROR!
> Oct 06 00:07:54 java.util.NoSuchElementException
> Oct 06 00:07:54 at java.util.LinkedList.removeLast(LinkedList.java:283)
> Oct 06 00:07:54 at org.apache.flink.streaming.api.operators.collect.AbstractCollectResultBuffer.revert(AbstractCollectResultBuffer.java:112)
> Oct 06 00:07:54 at org.apache.flink.streaming.api.operators.collect.CheckpointedCollectResultBuffer.sinkRestarted(CheckpointedCollectResultBuffer.java:37)
> Oct 06 00:07:54 at org.apache.flink.streaming.api.operators.collect.AbstractCollectResultBuffer.dealWithResponse(AbstractCollectResultBuffer.java:87)
> Oct 06 00:07:54 at org.apache.flink.streaming.api.operators.collect.CollectResultFetcher.next(CollectResultFetcher.java:147)
> Oct 06 00:07:54 at org.apache.flink.streaming.api.operators.collect.CollectResultIterator.nextResultFromFetcher(CollectResultIterator.java:106)
> Oct 06 00:07:54 at org.apache.flink.streaming.api.operators.collect.CollectResultIterator.hasNext(CollectResultIterator.java:80)
> Oct 06 00:07:54 at org.apache.flink.streaming.api.datastream.DataStreamUtils.collectRecordsFromUnboundedStream(DataStreamUtils.java:142)
> Oct 06 00:07:54 at org.apache.flink.connector.file.src.FileSourceTextLinesITCase.testContinuousTextFileSource(FileSourceTextLinesITCase.java:224)
> Oct 06 00:07:54 at org.apache.flink.connector.file.src.FileSourceTextLinesITCase.testContinuousTextFileSourceWithJobManagerFailover(FileSourceTextLinesITCase.java:180)
> Oct 06 00:07:54 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> Oct 06 00:07:54 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> Oct 06 00:07:54 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> Oct 06 00:07:54 at java.lang.reflect.Method.invoke(Method.java:498)
> Oct 06 00:07:54 at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
> Oct 06 00:07:54 at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> Oct 06 00:07:54 at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
> Oct 06 00:07:54 at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> Oct 06 00:07:54 at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
> Oct 06 00:07:54 at org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
> Oct 06 00:07:54 at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
> Oct 06 00:07:54 at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
> Oct 06 00:07:54 at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
> Oct 06 00:07:54 at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
> Oct 06 00:07:54 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
> Oct 06 00:07:54 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
> Oct 06 00:07:54 at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
> Oct 06 00:07:54 at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
> Oct 06 00:07:54 at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
> Oct 06 00:07:54 at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
> Oct 06 00:07:54 at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
> Oct 06 00:07:54 at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
> Oct 06 00:07:54 at org.junit.rules.RunRules.evaluate(RunRules.java:20)
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)