You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Dawid Wysakowicz (Jira)" <ji...@apache.org> on 2021/03/26 16:36:00 UTC
[jira] [Created] (FLINK-21995)
YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents:
File channel manager has shutdown.
Dawid Wysakowicz created FLINK-21995:
----------------------------------------
Summary: YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents: File channel manager has shutdown.
Key: FLINK-21995
URL: https://issues.apache.org/jira/browse/FLINK-21995
Project: Flink
Issue Type: Bug
Components: Deployment / YARN
Affects Versions: 1.13.0
Reporter: Dawid Wysakowicz
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=15546&view=logs&j=fc5181b0-e452-5c8f-68de-1097947f6483&t=62110053-334f-5295-a0ab-80dd7e2babbf&l=30260
{code}
[ERROR] YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents:84->YarnTestBase.ensureNoProhibitedStringInLogFiles:589 Found a file /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-logDir-nm-1_0/application_1616768573754_0001/container_1616768573754_0001_01_000002/taskmanager.log with a prohibited string (one of [Exception, Started SelectChannelConnector@0.0.0.0:8081]). Excerpts:
[
2021-03-26 14:23:37,554 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.numberOfTaskSlots, 1
2021-03-26 14:23:37,555 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.memory.process.size, 1600m
2021-03-26 14:23:37,555 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.port, 6123
2021-03-26 14:23:37,660 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - RECEIVED SIGNAL 15: SIGTERM. Shutting down as requested.
2021-03-26 14:23:37,663 INFO org.apache.flink.runtime.blob.TransientBlobCache [] - Shutting down BLOB cache
2021-03-26 14:23:37,667 INFO org.apache.flink.runtime.blob.PermanentBlobCache [] - Shutting down BLOB cache
2021-03-26 14:23:37,668 INFO org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager [] - Shutting down TaskExecutorLocalStateStoresManager.
2021-03-26 14:23:37,677 INFO org.apache.flink.runtime.filecache.FileCache [] - removed file cache directory /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-localDir-nm-1_0/usercache/hadoop/appcache/application_1616768573754_0001/flink-dist-cache-eefe237c-906b-4b9a-b63f-997ef24c58ba
2021-03-26 14:23:37,678 INFO org.apache.flink.runtime.io.disk.FileChannelManagerImpl [] - FileChannelManager removed spill file directory /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-fifo-secured/flink-yarn-tests-fifo-secured-localDir-nm-1_0/usercache/hadoop/appcache/application_1616768573754_0001/flink-netty-shuffle-d0a7a4ea-92b2-4614-bfed-2e949a36b9bc
2021-03-26 14:23:37,680 WARN org.apache.flink.runtime.taskmanager.Task [] - Keyed Aggregation -> Sink: Print to Std. Out (1/1)#0 (e81d01c2526376e7d0b4b33ccd8d8c7a) switched from RUNNING to FAILED with failure cause: java.lang.IllegalStateException: File channel manager has shutdown.
2021-03-26 14:23:37,680 WARN org.apache.flink.runtime.taskmanager.Task [] - Keyed Aggregation -> Sink: Print to Std. Out (1/1)#0 (e81d01c2526376e7d0b4b33ccd8d8c7a) switched from RUNNING to FAILED with failure cause: java.lang.IllegalStateException: File channel manager has shutdown.
at org.apache.flink.util.Preconditions.checkState(Preconditions.java:193)
at org.apache.flink.runtime.io.disk.FileChannelManagerImpl.getPaths(FileChannelManagerImpl.java:122)
at org.apache.flink.runtime.io.disk.iomanager.IOManager.getSpillingDirectoriesPaths(IOManager.java:118)
at org.apache.flink.streaming.runtime.io.StreamTaskNetworkInput.lambda$getRecordDeserializers$0(StreamTaskNetworkInput.java:90)
at java.util.stream.Collectors.lambda$toMap$58(Collectors.java:1321)
at java.util.stream.ReduceOps$3ReducingSink.accept(ReduceOps.java:169)
at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1384)
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)
at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)
at org.apache.flink.streaming.runtime.io.StreamTaskNetworkInput.getRecordDeserializers(StreamTaskNetworkInput.java:85)
at org.apache.flink.streaming.runtime.io.StreamTaskNetworkInput.<init>(StreamTaskNetworkInput.java:74)
at org.apache.flink.streaming.runtime.io.StreamTaskNetworkInputFactory.create(StreamTaskNetworkInputFactory.java:46)
at org.apache.flink.streaming.runtime.tasks.OneInputStreamTask.createTaskInput(OneInputStreamTask.java:162)
at org.apache.flink.streaming.runtime.tasks.OneInputStreamTask.init(OneInputStreamTask.java:93)
at org.apache.flink.streaming.runtime.tasks.StreamTask.beforeInvoke(StreamTask.java:528)
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:580)
at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:760)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:562)
at java.lang.Thread.run(Thread.java:748)
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)