You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Robert Metzger (Jira)" <ji...@apache.org> on 2020/10/15 13:29:00 UTC
[jira] [Updated] (FLINK-19657)
YARNSessionCapacitySchedulerITCase.checkForProhibitedLogContents: netty
failed with java.io.IOException: Broken pipe
[ https://issues.apache.org/jira/browse/FLINK-19657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Metzger updated FLINK-19657:
-----------------------------------
Priority: Critical (was: Major)
> YARNSessionCapacitySchedulerITCase.checkForProhibitedLogContents: netty failed with java.io.IOException: Broken pipe
> --------------------------------------------------------------------------------------------------------------------
>
> Key: FLINK-19657
> URL: https://issues.apache.org/jira/browse/FLINK-19657
> Project: Flink
> Issue Type: Bug
> Components: Deployment / YARN
> Affects Versions: 1.12.0
> Reporter: Robert Metzger
> Priority: Critical
> Labels: test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=7666&view=logs&j=fc5181b0-e452-5c8f-68de-1097947f6483&t=62110053-334f-5295-a0ab-80dd7e2babbf
> {code}
> 2020-10-15T10:41:39.3168991Z [ERROR] Failures:
> 2020-10-15T10:41:39.3172085Z [ERROR] YARNSessionCapacitySchedulerITCase.checkForProhibitedLogContents:650->YarnTestBase.ensureNoProhibitedStringInLogFiles:479 Found a file /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-logDir-nm-1_0/application_1602757819968_0002/container_1602757819968_0002_01_000002/taskmanager.log with a prohibited string (one of [Exception, Started SelectChannelConnector@0.0.0.0:8081]). Excerpts:
> 2020-10-15T10:41:39.3173934Z [
> 2020-10-15T10:41:39.3175238Z 2020-10-15 10:31:08,883 INFO org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Remove job 5a24db6b51d7c697fe30e49aa1a8412c from job leader monitoring.
> 2020-10-15T10:41:39.3176858Z 2020-10-15 10:31:08,885 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Close JobManager connection for job 5a24db6b51d7c697fe30e49aa1a8412c.
> 2020-10-15T10:41:39.3178614Z 2020-10-15 10:31:09,531 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - RECEIVED SIGNAL 15: SIGTERM. Shutting down as requested.
> 2020-10-15T10:41:39.3199037Z 2020-10-15 10:31:09,538 INFO org.apache.flink.runtime.blob.PermanentBlobCache [] - Shutting down BLOB cache
> 2020-10-15T10:41:39.3202316Z 2020-10-15 10:31:09,573 INFO org.apache.flink.runtime.io.disk.FileChannelManagerImpl [] - FileChannelManager removed spill file directory /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-localDir-nm-1_0/usercache/agent07_azpcontainer/appcache/application_1602757819968_0002/flink-io-fa9b2b85-fbe7-429c-85a9-6fcfb4811b01
> 2020-10-15T10:41:39.3204499Z 2020-10-15 10:31:09,577 INFO org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager [] - Shutting down TaskExecutorLocalStateStoresManager.
> 2020-10-15T10:41:39.3240288Z 2020-10-15 10:31:09,579 INFO org.apache.flink.runtime.io.disk.FileChannelManagerImpl [] - FileChannelManager removed spill file directory /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-localDir-nm-1_0/usercache/agent07_azpcontainer/appcache/application_1602757819968_0002/flink-netty-shuffle-7e95809e-e862-45b1-892e-09835297c82d
> 2020-10-15T10:41:39.3244086Z 2020-10-15 10:31:09,594 INFO org.apache.flink.runtime.filecache.FileCache [] - removed file cache directory /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-localDir-nm-1_0/usercache/agent07_azpcontainer/appcache/application_1602757819968_0002/flink-dist-cache-ed288b32-5c40-48b9-9bcb-7186f5a7bfc2
> 2020-10-15T10:41:39.3246636Z 2020-10-15 10:31:09,596 INFO org.apache.flink.runtime.blob.TransientBlobCache [] - Shutting down BLOB cache
> 2020-10-15T10:41:39.3248653Z 2020-10-15 10:31:09,661 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [61b81e62b514/192.168.128.2:39365] failed with java.io.IOException: Broken pipe
> 2020-10-15T10:41:39.3250746Z 2020-10-15 10:31:09,661 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [61b81e62b514/192.168.128.2:39365] failed with java.io.IOException: Broken pipe
> 2020-10-15T10:41:39.3253551Z 2020-10-15 10:31:09,662 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [61b81e62b514/192.168.128.2:39365] failed with java.io.IOException: Broken pipe
> 2020-10-15T10:41:39.3255688Z 2020-10-15 10:31:09,662 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [61b81e62b514/192.168.128.2:39365] failed with java.io.IOException: Broken pipe
> 2020-10-15T10:41:39.3267975Z ]
> 2020-10-15T10:41:39.3270637Z [ERROR] YARNSessionCapacitySchedulerITCase.checkForProhibitedLogContents:650->YarnTestBase.ensureNoProhibitedStringInLogFiles:479 Found a file /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-logDir-nm-1_0/application_1602757819968_0002/container_1602757819968_0002_01_000002/taskmanager.log with a prohibited string (one of [Exception, Started SelectChannelConnector@0.0.0.0:8081]). Excerpts:
> 2020-10-15T10:41:39.3272364Z [
> 2020-10-15T10:41:39.3273848Z 2020-10-15 10:31:08,883 INFO org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Remove job 5a24db6b51d7c697fe30e49aa1a8412c from job leader monitoring.
> 2020-10-15T10:41:39.3275694Z 2020-10-15 10:31:08,885 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Close JobManager connection for job 5a24db6b51d7c697fe30e49aa1a8412c.
> 2020-10-15T10:41:39.3277365Z 2020-10-15 10:31:09,531 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - RECEIVED SIGNAL 15: SIGTERM. Shutting down as requested.
> 2020-10-15T10:41:39.3278813Z 2020-10-15 10:31:09,538 INFO org.apache.flink.runtime.blob.PermanentBlobCache [] - Shutting down BLOB cache
> 2020-10-15T10:41:39.3281136Z 2020-10-15 10:31:09,573 INFO org.apache.flink.runtime.io.disk.FileChannelManagerImpl [] - FileChannelManager removed spill file directory /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-localDir-nm-1_0/usercache/agent07_azpcontainer/appcache/application_1602757819968_0002/flink-io-fa9b2b85-fbe7-429c-85a9-6fcfb4811b01
> 2020-10-15T10:41:39.3283728Z 2020-10-15 10:31:09,577 INFO org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager [] - Shutting down TaskExecutorLocalStateStoresManager.
> 2020-10-15T10:41:39.3285976Z 2020-10-15 10:31:09,579 INFO org.apache.flink.runtime.io.disk.FileChannelManagerImpl [] - FileChannelManager removed spill file directory /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-localDir-nm-1_0/usercache/agent07_azpcontainer/appcache/application_1602757819968_0002/flink-netty-shuffle-7e95809e-e862-45b1-892e-09835297c82d
> 2020-10-15T10:41:39.3288937Z 2020-10-15 10:31:09,594 INFO org.apache.flink.runtime.filecache.FileCache [] - removed file cache directory /__w/2/s/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-localDir-nm-1_0/usercache/agent07_azpcontainer/appcache/application_1602757819968_0002/flink-dist-cache-ed288b32-5c40-48b9-9bcb-7186f5a7bfc2
> 2020-10-15T10:41:39.3291038Z 2020-10-15 10:31:09,596 INFO org.apache.flink.runtime.blob.TransientBlobCache [] - Shutting down BLOB cache
> 2020-10-15T10:41:39.3293240Z 2020-10-15 10:31:09,661 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [61b81e62b514/192.168.128.2:39365] failed with java.io.IOException: Broken pipe
> 2020-10-15T10:41:39.3295639Z 2020-10-15 10:31:09,661 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [61b81e62b514/192.168.128.2:39365] failed with java.io.IOException: Broken pipe
> 2020-10-15T10:41:39.3297824Z 2020-10-15 10:31:09,662 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [61b81e62b514/192.168.128.2:39365] failed with java.io.IOException: Broken pipe
> 2020-10-15T10:41:39.3299775Z 2020-10-15 10:31:09,662 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [61b81e62b514/192.168.128.2:39365] failed with java.io.IOException: Broken pipe
> 2020-10-15T10:41:39.3300726Z ]
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)