You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Robert Metzger (Jira)" <ji...@apache.org> on 2020/05/25 13:33:00 UTC
[jira] [Created] (FLINK-17930) YARN tests do not execute on MacOS
Robert Metzger created FLINK-17930:
--------------------------------------
Summary: YARN tests do not execute on MacOS
Key: FLINK-17930
URL: https://issues.apache.org/jira/browse/FLINK-17930
Project: Flink
Issue Type: Bug
Components: Deployment / YARN, Tests
Affects Versions: 1.12.0
Reporter: Robert Metzger
Running {{mvn325 verify}} (note mvn325 is a local alias for Maven 3.2.5) in "flink-yarn-tests" leads to the following output on my Mac
{code}
[INFO] --- maven-surefire-plugin:2.22.1:test (integration-tests) @ flink-yarn-tests ---
[INFO]
[INFO] -------------------------------------------------------
[INFO] T E S T S
[INFO] -------------------------------------------------------
[INFO] Running org.apache.flink.yarn.YARNITCase
May 25, 2020 3:00:49 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class
May 25, 2020 3:00:49 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class
May 25, 2020 3:00:49 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 25, 2020 3:00:49 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 25, 2020 3:00:49 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:00:49 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:00:49 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:00:49 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 25, 2020 3:00:49 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 25, 2020 3:00:49 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 25, 2020 3:00:49 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 25, 2020 3:00:49 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 25, 2020 3:00:49 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:00:49 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:00:50 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:00:50 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Formatting using clusterid: testClusterID
[ERROR] Tests run: 4, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 108.623 s <<< FAILURE! - in org.apache.flink.yarn.YARNITCase
[ERROR] testPerJobModeWithEnableSystemClassPathIncludeUserJar(org.apache.flink.yarn.YARNITCase) Time elapsed: 28.393 s <<< ERROR!
org.apache.flink.client.deployment.ClusterDeploymentException: Could not deploy Yarn job cluster.
at org.apache.flink.yarn.YarnClusterDescriptor.deployJobCluster(YarnClusterDescriptor.java:436)
at org.apache.flink.yarn.YARNITCase.deployPerJob(YARNITCase.java:123)
at org.apache.flink.yarn.YARNITCase.lambda$testPerJobModeWithEnableSystemClassPathIncludeUserJar$0(YARNITCase.java:73)
at org.apache.flink.yarn.YarnTestBase.runTest(YarnTestBase.java:258)
at org.apache.flink.yarn.YARNITCase.testPerJobModeWithEnableSystemClassPathIncludeUserJar(YARNITCase.java:73)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273)
at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159)
at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384)
at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345)
at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126)
at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418)
Caused by: org.apache.flink.yarn.YarnClusterDescriptor$YarnDeploymentException: The YARN application unexpectedly switched to state FAILED during deployment.
Diagnostics from YARN: Application application_1590411647367_0001 failed 1 times due to ApplicationMaster for attempt appattempt_1590411647367_0001_000001 timed out. Failing the application.
If log aggregation is enabled on your cluster, use this command to further investigate the issue:
yarn logs -applicationId application_1590411647367_0001
at org.apache.flink.yarn.YarnClusterDescriptor.startAppMaster(YarnClusterDescriptor.java:1030)
at org.apache.flink.yarn.YarnClusterDescriptor.deployInternal(YarnClusterDescriptor.java:533)
at org.apache.flink.yarn.YarnClusterDescriptor.deployJobCluster(YarnClusterDescriptor.java:429)
... 38 more
[INFO] Running org.apache.flink.yarn.YARNSessionCapacitySchedulerITCase
May 25, 2020 3:03:07 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class
May 25, 2020 3:03:07 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class
May 25, 2020 3:03:07 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 25, 2020 3:03:07 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 25, 2020 3:03:07 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:03:08 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:03:08 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:03:08 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 25, 2020 3:03:08 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 25, 2020 3:03:08 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 25, 2020 3:03:08 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 25, 2020 3:03:08 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 25, 2020 3:03:08 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:03:08 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:03:08 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:03:08 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
[ERROR] Tests run: 8, Failures: 4, Errors: 0, Skipped: 0, Time elapsed: 132.735 s <<< FAILURE! - in org.apache.flink.yarn.YARNSessionCapacitySchedulerITCase
[ERROR] testDetachedPerJobYarnClusterWithStreamingJob(org.apache.flink.yarn.YARNSessionCapacitySchedulerITCase) Time elapsed: 17 s <<< FAILURE!
java.lang.AssertionError:
Found a file /Users/robert/Projects/flink/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-logDir-nm-1_0/application_1590411786177_0001/container_1590411786177_0001_01_000002/taskmanager.log with a prohibited string (one of [Exception, Started SelectChannelConnector@0.0.0.0:8081]). Excerpts:
[
2020-05-25 15:03:20,053 INFO org.apache.flink.runtime.taskmanager.Task [] - Ensuring all FileSystem streams are closed for task DataSink (collect()) (1/1) (f1c100e7db5292cdd8fdd7f49b2036ee) [FINISHED]
2020-05-25 15:03:20,053 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (collect()) (1/1) f1c100e7db5292cdd8fdd7f49b2036ee.
2020-05-25 15:03:20,077 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Free slot TaskSlot(index:0, state:ACTIVE, resource profile: ResourceProfile{cpuCores=1.0000000000000000, taskHeapMemory=12.800mb (13421771 bytes), taskOffHeapMemory=0 bytes, managedMemory=115.200mb (120795957 bytes), networkMemory=32.000mb (33554432 bytes)}, allocationId: dab3e0a93603e3da1427f3241226aa47, jobId: 03ee19c583fc4bce3a2b3b59e1988026).
2020-05-25 15:03:20,144 INFO org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Remove job 03ee19c583fc4bce3a2b3b59e1988026 from job leader monitoring.
2020-05-25 15:03:20,145 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Close JobManager connection for job 03ee19c583fc4bce3a2b3b59e1988026.
2020-05-25 15:04:09,782 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - The heartbeat of ResourceManager with id a1dc34c6580d4ba21fcd77fdaa4622d7 timed out.
2020-05-25 15:04:09,783 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Close ResourceManager connection a1dc34c6580d4ba21fcd77fdaa4622d7.
2020-05-25 15:04:09,785 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Connecting to ResourceManager akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*(00000000000000000000000000000000).
2020-05-25 15:04:09,791 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:04:09,791 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:04:09,791 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:04:09,793 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
]
at org.junit.Assert.fail(Assert.java:88)
at org.apache.flink.yarn.YarnTestBase.ensureNoProhibitedStringInLogFiles(YarnTestBase.java:508)
at org.apache.flink.yarn.YARNSessionCapacitySchedulerITCase.checkForProhibitedLogContents(YARNSessionCapacitySchedulerITCase.java:649)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:33)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273)
at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159)
at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384)
at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345)
at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126)
at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418)
[ERROR] testStartYarnSessionClusterInQaTeamQueue(org.apache.flink.yarn.YARNSessionCapacitySchedulerITCase) Time elapsed: 6.851 s <<< FAILURE!
java.lang.AssertionError:
Found a file /Users/robert/Projects/flink/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-logDir-nm-1_0/application_1590411786177_0001/container_1590411786177_0001_01_000002/taskmanager.log with a prohibited string (one of [Exception, Started SelectChannelConnector@0.0.0.0:8081]). Excerpts:
[
2020-05-25 15:03:20,053 INFO org.apache.flink.runtime.taskmanager.Task [] - Ensuring all FileSystem streams are closed for task DataSink (collect()) (1/1) (f1c100e7db5292cdd8fdd7f49b2036ee) [FINISHED]
2020-05-25 15:03:20,053 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (collect()) (1/1) f1c100e7db5292cdd8fdd7f49b2036ee.
2020-05-25 15:03:20,077 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Free slot TaskSlot(index:0, state:ACTIVE, resource profile: ResourceProfile{cpuCores=1.0000000000000000, taskHeapMemory=12.800mb (13421771 bytes), taskOffHeapMemory=0 bytes, managedMemory=115.200mb (120795957 bytes), networkMemory=32.000mb (33554432 bytes)}, allocationId: dab3e0a93603e3da1427f3241226aa47, jobId: 03ee19c583fc4bce3a2b3b59e1988026).
2020-05-25 15:03:20,144 INFO org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Remove job 03ee19c583fc4bce3a2b3b59e1988026 from job leader monitoring.
2020-05-25 15:03:20,145 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Close JobManager connection for job 03ee19c583fc4bce3a2b3b59e1988026.
2020-05-25 15:04:09,782 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - The heartbeat of ResourceManager with id a1dc34c6580d4ba21fcd77fdaa4622d7 timed out.
2020-05-25 15:04:09,783 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Close ResourceManager connection a1dc34c6580d4ba21fcd77fdaa4622d7.
2020-05-25 15:04:09,785 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Connecting to ResourceManager akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*(00000000000000000000000000000000).
2020-05-25 15:04:09,791 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:04:09,791 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:04:09,791 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:04:09,793 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
]
at org.junit.Assert.fail(Assert.java:88)
at org.apache.flink.yarn.YarnTestBase.ensureNoProhibitedStringInLogFiles(YarnTestBase.java:508)
at org.apache.flink.yarn.YARNSessionCapacitySchedulerITCase.checkForProhibitedLogContents(YARNSessionCapacitySchedulerITCase.java:649)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:33)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273)
at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159)
at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384)
at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345)
at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126)
at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418)
[ERROR] perJobYarnClusterWithParallelism(org.apache.flink.yarn.YARNSessionCapacitySchedulerITCase) Time elapsed: 16.163 s <<< FAILURE!
java.lang.AssertionError:
Found a file /Users/robert/Projects/flink/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-logDir-nm-1_0/application_1590411786177_0001/container_1590411786177_0001_01_000002/taskmanager.log with a prohibited string (one of [Exception, Started SelectChannelConnector@0.0.0.0:8081]). Excerpts:
[
2020-05-25 15:03:20,053 INFO org.apache.flink.runtime.taskmanager.Task [] - Ensuring all FileSystem streams are closed for task DataSink (collect()) (1/1) (f1c100e7db5292cdd8fdd7f49b2036ee) [FINISHED]
2020-05-25 15:03:20,053 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (collect()) (1/1) f1c100e7db5292cdd8fdd7f49b2036ee.
2020-05-25 15:03:20,077 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Free slot TaskSlot(index:0, state:ACTIVE, resource profile: ResourceProfile{cpuCores=1.0000000000000000, taskHeapMemory=12.800mb (13421771 bytes), taskOffHeapMemory=0 bytes, managedMemory=115.200mb (120795957 bytes), networkMemory=32.000mb (33554432 bytes)}, allocationId: dab3e0a93603e3da1427f3241226aa47, jobId: 03ee19c583fc4bce3a2b3b59e1988026).
2020-05-25 15:03:20,144 INFO org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Remove job 03ee19c583fc4bce3a2b3b59e1988026 from job leader monitoring.
2020-05-25 15:03:20,145 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Close JobManager connection for job 03ee19c583fc4bce3a2b3b59e1988026.
2020-05-25 15:04:09,782 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - The heartbeat of ResourceManager with id a1dc34c6580d4ba21fcd77fdaa4622d7 timed out.
2020-05-25 15:04:09,783 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Close ResourceManager connection a1dc34c6580d4ba21fcd77fdaa4622d7.
2020-05-25 15:04:09,785 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Connecting to ResourceManager akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*(00000000000000000000000000000000).
2020-05-25 15:04:09,791 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:04:09,791 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:04:09,791 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:04:09,793 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:04:19,816 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:04:19,817 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:04:19,817 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:04:29,836 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:04:29,837 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:04:29,837 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
]
at org.junit.Assert.fail(Assert.java:88)
at org.apache.flink.yarn.YarnTestBase.ensureNoProhibitedStringInLogFiles(YarnTestBase.java:508)
at org.apache.flink.yarn.YARNSessionCapacitySchedulerITCase.checkForProhibitedLogContents(YARNSessionCapacitySchedulerITCase.java:649)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:33)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273)
at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159)
at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384)
at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345)
at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126)
at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418)
[ERROR] testNonexistingQueueWARNmessage(org.apache.flink.yarn.YARNSessionCapacitySchedulerITCase) Time elapsed: 1.094 s <<< FAILURE!
java.lang.AssertionError:
Found a file /Users/robert/Projects/flink/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-logDir-nm-1_0/application_1590411786177_0001/container_1590411786177_0001_01_000002/taskmanager.log with a prohibited string (one of [Exception, Started SelectChannelConnector@0.0.0.0:8081]). Excerpts:
[
2020-05-25 15:03:20,053 INFO org.apache.flink.runtime.taskmanager.Task [] - Ensuring all FileSystem streams are closed for task DataSink (collect()) (1/1) (f1c100e7db5292cdd8fdd7f49b2036ee) [FINISHED]
2020-05-25 15:03:20,053 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (collect()) (1/1) f1c100e7db5292cdd8fdd7f49b2036ee.
2020-05-25 15:03:20,077 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Free slot TaskSlot(index:0, state:ACTIVE, resource profile: ResourceProfile{cpuCores=1.0000000000000000, taskHeapMemory=12.800mb (13421771 bytes), taskOffHeapMemory=0 bytes, managedMemory=115.200mb (120795957 bytes), networkMemory=32.000mb (33554432 bytes)}, allocationId: dab3e0a93603e3da1427f3241226aa47, jobId: 03ee19c583fc4bce3a2b3b59e1988026).
2020-05-25 15:03:20,144 INFO org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Remove job 03ee19c583fc4bce3a2b3b59e1988026 from job leader monitoring.
2020-05-25 15:03:20,145 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Close JobManager connection for job 03ee19c583fc4bce3a2b3b59e1988026.
2020-05-25 15:04:09,782 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - The heartbeat of ResourceManager with id a1dc34c6580d4ba21fcd77fdaa4622d7 timed out.
2020-05-25 15:04:09,783 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Close ResourceManager connection a1dc34c6580d4ba21fcd77fdaa4622d7.
2020-05-25 15:04:09,785 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Connecting to ResourceManager akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*(00000000000000000000000000000000).
2020-05-25 15:04:09,791 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:04:09,791 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:04:09,791 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:04:09,793 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:04:19,816 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:04:19,817 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:04:19,817 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:04:29,836 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:04:29,837 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:04:29,837 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
]
at org.junit.Assert.fail(Assert.java:88)
at org.apache.flink.yarn.YarnTestBase.ensureNoProhibitedStringInLogFiles(YarnTestBase.java:508)
at org.apache.flink.yarn.YARNSessionCapacitySchedulerITCase.checkForProhibitedLogContents(YARNSessionCapacitySchedulerITCase.java:649)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:33)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273)
at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159)
at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384)
at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345)
at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126)
at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418)
[INFO] Running org.apache.flink.yarn.YarnConfigurationITCase
May 25, 2020 3:05:51 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class
May 25, 2020 3:05:51 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class
May 25, 2020 3:05:51 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 25, 2020 3:05:51 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 25, 2020 3:05:51 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:05:51 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:05:51 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:05:51 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 25, 2020 3:05:52 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 25, 2020 3:05:52 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 25, 2020 3:05:52 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 25, 2020 3:05:52 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 25, 2020 3:05:52 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:05:52 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:05:52 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:05:52 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Using windowSize=2000, data rate=3
To customize example, use: WindowJoin [--windowSize <window-size-in-millis>] [--rate <elements-per-second>]
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 35.02 s - in org.apache.flink.yarn.YarnConfigurationITCase
[INFO] Running org.apache.flink.yarn.YarnPrioritySchedulingITCase
[WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.616 s - in org.apache.flink.yarn.YarnPrioritySchedulingITCase
[INFO] Running org.apache.flink.yarn.YARNApplicationITCase
May 25, 2020 3:06:27 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class
May 25, 2020 3:06:27 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class
May 25, 2020 3:06:27 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 25, 2020 3:06:27 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 25, 2020 3:06:27 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:06:27 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:06:28 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:06:28 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 25, 2020 3:06:28 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 25, 2020 3:06:28 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 25, 2020 3:06:28 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 25, 2020 3:06:28 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 25, 2020 3:06:28 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:06:28 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:06:28 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:06:28 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Formatting using clusterid: testClusterID
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 85.252 s - in org.apache.flink.yarn.YARNApplicationITCase
[INFO] Running org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
May 25, 2020 3:07:54 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class
May 25, 2020 3:07:54 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class
May 25, 2020 3:07:54 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 25, 2020 3:07:54 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 25, 2020 3:07:54 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:07:54 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:07:54 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:07:54 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 25, 2020 3:07:55 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 25, 2020 3:07:55 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 25, 2020 3:07:55 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 25, 2020 3:07:55 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 25, 2020 3:07:55 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:07:55 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:07:55 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:07:55 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
[WARNING] Tests run: 5, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 66.867 s - in org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
[INFO] Running org.apache.flink.yarn.YARNFileReplicationITCase
May 25, 2020 3:09:01 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class
May 25, 2020 3:09:01 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class
May 25, 2020 3:09:01 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 25, 2020 3:09:01 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 25, 2020 3:09:01 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:09:02 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:09:02 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:09:02 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 25, 2020 3:09:02 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 25, 2020 3:09:02 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 25, 2020 3:09:02 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 25, 2020 3:09:02 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 25, 2020 3:09:02 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:09:02 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:09:02 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:09:02 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Formatting using clusterid: testClusterID
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 73.804 s - in org.apache.flink.yarn.YARNFileReplicationITCase
[INFO] Running org.apache.flink.yarn.YARNSessionFIFOITCase
May 25, 2020 3:10:16 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class
May 25, 2020 3:10:16 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class
May 25, 2020 3:10:16 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 25, 2020 3:10:16 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 25, 2020 3:10:16 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:10:16 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:10:16 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:10:16 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 25, 2020 3:10:17 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 25, 2020 3:10:17 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 25, 2020 3:10:17 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 25, 2020 3:10:17 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 25, 2020 3:10:17 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:10:17 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:10:17 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:10:17 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
[WARNING] Tests run: 4, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 56.816 s - in org.apache.flink.yarn.YARNSessionFIFOITCase
[INFO] Running org.apache.flink.yarn.YARNHighAvailabilityITCase
May 25, 2020 3:11:14 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class
May 25, 2020 3:11:14 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class
May 25, 2020 3:11:14 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 25, 2020 3:11:14 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 25, 2020 3:11:14 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:11:15 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:11:15 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:11:15 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
May 25, 2020 3:11:15 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
May 25, 2020 3:11:15 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
May 25, 2020 3:11:15 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
May 25, 2020 3:11:15 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
May 25, 2020 3:11:15 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:11:15 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:11:15 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
May 25, 2020 3:11:16 PM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 69.528 s - in org.apache.flink.yarn.YARNHighAvailabilityITCase
[INFO]
[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR] YARNSessionCapacitySchedulerITCase.checkForProhibitedLogContents:649->YarnTestBase.ensureNoProhibitedStringInLogFiles:508 Found a file /Users/robert/Projects/flink/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-logDir-nm-1_0/application_1590411786177_0001/container_1590411786177_0001_01_000002/taskmanager.log with a prohibited string (one of [Exception, Started SelectChannelConnector@0.0.0.0:8081]). Excerpts:
[
2020-05-25 15:03:20,053 INFO org.apache.flink.runtime.taskmanager.Task [] - Ensuring all FileSystem streams are closed for task DataSink (collect()) (1/1) (f1c100e7db5292cdd8fdd7f49b2036ee) [FINISHED]
2020-05-25 15:03:20,053 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (collect()) (1/1) f1c100e7db5292cdd8fdd7f49b2036ee.
2020-05-25 15:03:20,077 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Free slot TaskSlot(index:0, state:ACTIVE, resource profile: ResourceProfile{cpuCores=1.0000000000000000, taskHeapMemory=12.800mb (13421771 bytes), taskOffHeapMemory=0 bytes, managedMemory=115.200mb (120795957 bytes), networkMemory=32.000mb (33554432 bytes)}, allocationId: dab3e0a93603e3da1427f3241226aa47, jobId: 03ee19c583fc4bce3a2b3b59e1988026).
2020-05-25 15:03:20,144 INFO org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Remove job 03ee19c583fc4bce3a2b3b59e1988026 from job leader monitoring.
2020-05-25 15:03:20,145 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Close JobManager connection for job 03ee19c583fc4bce3a2b3b59e1988026.
2020-05-25 15:04:09,782 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - The heartbeat of ResourceManager with id a1dc34c6580d4ba21fcd77fdaa4622d7 timed out.
2020-05-25 15:04:09,783 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Close ResourceManager connection a1dc34c6580d4ba21fcd77fdaa4622d7.
2020-05-25 15:04:09,785 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Connecting to ResourceManager akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*(00000000000000000000000000000000).
2020-05-25 15:04:09,791 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:04:09,791 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:04:09,791 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:04:09,793 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:04:19,816 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:04:19,817 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:04:19,817 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:04:29,836 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:04:29,837 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:04:29,837 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
]
[ERROR] YARNSessionCapacitySchedulerITCase.checkForProhibitedLogContents:649->YarnTestBase.ensureNoProhibitedStringInLogFiles:508 Found a file /Users/robert/Projects/flink/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-logDir-nm-1_0/application_1590411786177_0001/container_1590411786177_0001_01_000002/taskmanager.log with a prohibited string (one of [Exception, Started SelectChannelConnector@0.0.0.0:8081]). Excerpts:
[
2020-05-25 15:03:20,053 INFO org.apache.flink.runtime.taskmanager.Task [] - Ensuring all FileSystem streams are closed for task DataSink (collect()) (1/1) (f1c100e7db5292cdd8fdd7f49b2036ee) [FINISHED]
2020-05-25 15:03:20,053 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (collect()) (1/1) f1c100e7db5292cdd8fdd7f49b2036ee.
2020-05-25 15:03:20,077 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Free slot TaskSlot(index:0, state:ACTIVE, resource profile: ResourceProfile{cpuCores=1.0000000000000000, taskHeapMemory=12.800mb (13421771 bytes), taskOffHeapMemory=0 bytes, managedMemory=115.200mb (120795957 bytes), networkMemory=32.000mb (33554432 bytes)}, allocationId: dab3e0a93603e3da1427f3241226aa47, jobId: 03ee19c583fc4bce3a2b3b59e1988026).
2020-05-25 15:03:20,144 INFO org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Remove job 03ee19c583fc4bce3a2b3b59e1988026 from job leader monitoring.
2020-05-25 15:03:20,145 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Close JobManager connection for job 03ee19c583fc4bce3a2b3b59e1988026.
2020-05-25 15:04:09,782 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - The heartbeat of ResourceManager with id a1dc34c6580d4ba21fcd77fdaa4622d7 timed out.
2020-05-25 15:04:09,783 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Close ResourceManager connection a1dc34c6580d4ba21fcd77fdaa4622d7.
2020-05-25 15:04:09,785 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Connecting to ResourceManager akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*(00000000000000000000000000000000).
2020-05-25 15:04:09,791 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:04:09,791 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:04:09,791 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:04:09,793 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
]
[ERROR] YARNSessionCapacitySchedulerITCase.checkForProhibitedLogContents:649->YarnTestBase.ensureNoProhibitedStringInLogFiles:508 Found a file /Users/robert/Projects/flink/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-logDir-nm-1_0/application_1590411786177_0001/container_1590411786177_0001_01_000002/taskmanager.log with a prohibited string (one of [Exception, Started SelectChannelConnector@0.0.0.0:8081]). Excerpts:
[
2020-05-25 15:03:20,053 INFO org.apache.flink.runtime.taskmanager.Task [] - Ensuring all FileSystem streams are closed for task DataSink (collect()) (1/1) (f1c100e7db5292cdd8fdd7f49b2036ee) [FINISHED]
2020-05-25 15:03:20,053 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (collect()) (1/1) f1c100e7db5292cdd8fdd7f49b2036ee.
2020-05-25 15:03:20,077 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Free slot TaskSlot(index:0, state:ACTIVE, resource profile: ResourceProfile{cpuCores=1.0000000000000000, taskHeapMemory=12.800mb (13421771 bytes), taskOffHeapMemory=0 bytes, managedMemory=115.200mb (120795957 bytes), networkMemory=32.000mb (33554432 bytes)}, allocationId: dab3e0a93603e3da1427f3241226aa47, jobId: 03ee19c583fc4bce3a2b3b59e1988026).
2020-05-25 15:03:20,144 INFO org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Remove job 03ee19c583fc4bce3a2b3b59e1988026 from job leader monitoring.
2020-05-25 15:03:20,145 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Close JobManager connection for job 03ee19c583fc4bce3a2b3b59e1988026.
2020-05-25 15:04:09,782 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - The heartbeat of ResourceManager with id a1dc34c6580d4ba21fcd77fdaa4622d7 timed out.
2020-05-25 15:04:09,783 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Close ResourceManager connection a1dc34c6580d4ba21fcd77fdaa4622d7.
2020-05-25 15:04:09,785 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Connecting to ResourceManager akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*(00000000000000000000000000000000).
2020-05-25 15:04:09,791 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:04:09,791 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:04:09,791 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:04:09,793 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:04:19,816 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:04:19,817 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:04:19,817 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:04:29,836 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:04:29,837 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:04:29,837 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
]
[ERROR] YARNSessionCapacitySchedulerITCase.checkForProhibitedLogContents:649->YarnTestBase.ensureNoProhibitedStringInLogFiles:508 Found a file /Users/robert/Projects/flink/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-logDir-nm-1_0/application_1590411786177_0001/container_1590411786177_0001_01_000002/taskmanager.log with a prohibited string (one of [Exception, Started SelectChannelConnector@0.0.0.0:8081]). Excerpts:
[
2020-05-25 15:03:20,053 INFO org.apache.flink.runtime.taskmanager.Task [] - Ensuring all FileSystem streams are closed for task DataSink (collect()) (1/1) (f1c100e7db5292cdd8fdd7f49b2036ee) [FINISHED]
2020-05-25 15:03:20,053 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (collect()) (1/1) f1c100e7db5292cdd8fdd7f49b2036ee.
2020-05-25 15:03:20,077 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Free slot TaskSlot(index:0, state:ACTIVE, resource profile: ResourceProfile{cpuCores=1.0000000000000000, taskHeapMemory=12.800mb (13421771 bytes), taskOffHeapMemory=0 bytes, managedMemory=115.200mb (120795957 bytes), networkMemory=32.000mb (33554432 bytes)}, allocationId: dab3e0a93603e3da1427f3241226aa47, jobId: 03ee19c583fc4bce3a2b3b59e1988026).
2020-05-25 15:03:20,144 INFO org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Remove job 03ee19c583fc4bce3a2b3b59e1988026 from job leader monitoring.
2020-05-25 15:03:20,145 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Close JobManager connection for job 03ee19c583fc4bce3a2b3b59e1988026.
2020-05-25 15:04:09,782 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - The heartbeat of ResourceManager with id a1dc34c6580d4ba21fcd77fdaa4622d7 timed out.
2020-05-25 15:04:09,783 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Close ResourceManager connection a1dc34c6580d4ba21fcd77fdaa4622d7.
2020-05-25 15:04:09,785 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Connecting to ResourceManager akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*(00000000000000000000000000000000).
2020-05-25 15:04:09,791 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:04:09,791 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:04:09,791 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:04:09,793 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
]
[ERROR] Errors:
[ERROR] YARNITCase.testPerJobModeWithEnableSystemClassPathIncludeUserJar:73->YarnTestBase.runTest:258->lambda$testPerJobModeWithEnableSystemClassPathIncludeUserJar$0:73->deployPerJob:123 » ClusterDeployment
[INFO]
[ERROR] Tests run: 30, Failures: 4, Errors: 1, Skipped: 5
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
{code}
This is log file
{code}
2020-05-25 15:03:18,073 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - --------------------------------------------------------------------------------
2020-05-25 15:03:18,076 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - Starting YARN TaskExecutor runner (Version: 1.12-SNAPSHOT, Scala: 2.11, Rev:d88c195, Date:2020-05-25T11:47:58+02:00)
2020-05-25 15:03:18,076 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - OS current user: robert
2020-05-25 15:03:18,224 WARN org.apache.hadoop.util.NativeCodeLoader [] - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2020-05-25 15:03:18,261 WARN org.apache.hadoop.conf.Configuration [] - yarn-site.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2020-05-25 15:03:18,262 WARN org.apache.hadoop.conf.Configuration [] - yarn-site.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2020-05-25 15:03:18,282 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - Current Hadoop/Kerberos user: robert
2020-05-25 15:03:18,283 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - JVM: Java HotSpot(TM) 64-Bit Server VM - Oracle Corporation - 1.8/25.192-b12
2020-05-25 15:03:18,283 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - Maximum heap size: 148 MiBytes
2020-05-25 15:03:18,283 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - JAVA_HOME: /Library/Java/JavaVirtualMachines/jdk1.8.0_192.jdk/Contents/Home
2020-05-25 15:03:18,284 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - Hadoop version: 2.4.1
2020-05-25 15:03:18,284 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - JVM Options:
2020-05-25 15:03:18,284 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - -Xmx161061270
2020-05-25 15:03:18,284 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - -Xms161061270
2020-05-25 15:03:18,284 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - -XX:MaxDirectMemorySize=201326592
2020-05-25 15:03:18,284 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - -XX:MaxMetaspaceSize=268435456
2020-05-25 15:03:18,284 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - -Dlog.file=/Users/robert/Projects/flink/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-logDir-nm-1_0/application_1590411786177_0001/container_1590411786177_0001_01_000002/taskmanager.log
2020-05-25 15:03:18,284 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - -Dlog4j.configuration=file:./log4j.properties
2020-05-25 15:03:18,284 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - -Dlog4j.configurationFile=file:./log4j.properties
2020-05-25 15:03:18,284 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - Program Arguments:
2020-05-25 15:03:18,285 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - -D
2020-05-25 15:03:18,285 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - taskmanager.memory.framework.off-heap.size=134217728b
2020-05-25 15:03:18,285 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - -D
2020-05-25 15:03:18,285 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - taskmanager.memory.network.max=67108864b
2020-05-25 15:03:18,285 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - -D
2020-05-25 15:03:18,285 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - taskmanager.memory.network.min=67108864b
2020-05-25 15:03:18,285 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - -D
2020-05-25 15:03:18,285 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - taskmanager.memory.framework.heap.size=134217728b
2020-05-25 15:03:18,285 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - -D
2020-05-25 15:03:18,285 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - taskmanager.memory.managed.size=241591914b
2020-05-25 15:03:18,285 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - -D
2020-05-25 15:03:18,285 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - taskmanager.cpu.cores=2.0
2020-05-25 15:03:18,286 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - -D
2020-05-25 15:03:18,286 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - taskmanager.memory.task.heap.size=26843542b
2020-05-25 15:03:18,286 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - -D
2020-05-25 15:03:18,286 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - taskmanager.memory.task.off-heap.size=0b
2020-05-25 15:03:18,286 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - --configDir
2020-05-25 15:03:18,286 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - .
2020-05-25 15:03:18,286 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - -Dweb.port=0
2020-05-25 15:03:18,286 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - -Djobmanager.rpc.address=macbook-pro-2.localdomain
2020-05-25 15:03:18,286 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - -Dweb.tmpdir=/var/folders/js/yfk_y2450q7559kygttykwk00000gn/T/flink-web-0b453e56-016d-4a10-a23a-4127dba03b6a
2020-05-25 15:03:18,286 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - -Djobmanager.rpc.port=51615
2020-05-25 15:03:18,286 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - -Drest.address=macbook-pro-2.localdomain
2020-05-25 15:03:18,286 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - Classpath: :BatchWordCount.jar:lib/flink-shaded-zookeeper-3.4.10.jar:lib/flink-table-blink_2.11-1.12-SNAPSHOT.jar:lib/flink-table_2.11-1.12-SNAPSHOT.jar:lib/log4j-1.2-api-2.12.1.jar:lib/log4j-api-2.12.1.jar:lib/log4j-core-2.12.1.jar:lib/log4j-slf4j-impl-2.12.1.jar:flink-dist_2.11-1.12-SNAPSHOT.jar:job.graph:flink-conf.yaml::/Users/robert/.m2/repository/org/apache/curator/curator-test/2.12.0/curator-test-2.12.0.jar:/Users/robert/.m2/repository/com/esotericsoftware/kryo/kryo/2.24.0/kryo-2.24.0.jar:/Users/robert/.m2/repository/com/esotericsoftware/minlog/minlog/1.2/minlog-1.2.jar:/Users/robert/.m2/repository/org/scala-lang/scala-reflect/2.11.12/scala-reflect-2.11.12.jar:/Users/robert/.m2/repository/org/scala-lang/scala-compiler/2.11.12/scala-compiler-2.11.12.jar:/Users/robert/.m2/repository/org/scala-lang/modules/scala-xml_2.11/1.0.5/scala-xml_2.11-1.0.5.jar:/Users/robert/.m2/repository/org/scala-lang/modules/scala-parser-combinators_2.11/1.1.1/scala-parser-combinators_2.11-1.1.1.jar:/Users/robert/.m2/repository/com/data-artisans/frocksdbjni/5.17.2-artisans-2.0/frocksdbjni-5.17.2-artisans-2.0.jar:/Users/robert/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/Users/robert/.m2/repository/org/apache/commons/commons-lang3/3.3.2/commons-lang3-3.3.2.jar:/Users/robert/.m2/repository/commons-cli/commons-cli/1.3.1/commons-cli-1.3.1.jar:/Users/robert/.m2/repository/org/javassist/javassist/3.24.0-GA/javassist-3.24.0-GA.jar:/Users/robert/.m2/repository/org/scala-lang/scala-library/2.11.12/scala-library-2.11.12.jar:/Users/robert/.m2/repository/com/typesafe/akka/akka-actor_2.11/2.5.21/akka-actor_2.11-2.5.21.jar:/Users/robert/.m2/repository/com/typesafe/config/1.3.0/config-1.3.0.jar:/Users/robert/.m2/repository/org/scala-lang/modules/scala-java8-compat_2.11/0.7.0/scala-java8-compat_2.11-0.7.0.jar:/Users/robert/.m2/repository/com/typesafe/akka/akka-stream_2.11/2.5.21/akka-stream_2.11-2.5.21.jar:/Users/robert/.m2/repository/org/reactivestreams/reactive-streams/1.0.2/reactive-streams-1.0.2.jar:/Users/robert/.m2/repository/com/typesafe/ssl-config-core_2.11/0.3.7/ssl-config-core_2.11-0.3.7.jar:/Users/robert/.m2/repository/com/typesafe/akka/akka-protobuf_2.11/2.5.21/akka-protobuf_2.11-2.5.21.jar:/Users/robert/.m2/repository/com/typesafe/akka/akka-slf4j_2.11/2.5.21/akka-slf4j_2.11-2.5.21.jar:/Users/robert/.m2/repository/org/clapper/grizzled-slf4j_2.11/1.3.2/grizzled-slf4j_2.11-1.3.2.jar:/Users/robert/.m2/repository/com/github/scopt/scopt_2.11/3.5.0/scopt_2.11-3.5.0.jar:/Users/robert/.m2/repository/org/xerial/snappy/snappy-java/1.1.4/snappy-java-1.1.4.jar:/Users/robert/.m2/repository/com/twitter/chill_2.11/0.7.6/chill_2.11-0.7.6.jar:/Users/robert/.m2/repository/com/twitter/chill-java/0.7.6/chill-java-0.7.6.jar:/Users/robert/.m2/repository/org/lz4/lz4-java/1.5.0/lz4-java-1.5.0.jar:/Users/robert/.m2/repository/org/apache/commons/commons-math3/3.5/commons-math3-3.5.jar:/Users/robert/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.4.1/hadoop-hdfs-2.4.1.jar:/Users/robert/.m2/repository/commons-daemon/commons-daemon/1.0.13/commons-daemon-1.0.13.jar:/Users/robert/.m2/repository/org/apache/hadoop/hadoop-yarn-common/2.4.1/hadoop-yarn-common-2.4.1.jar:/Users/robert/.m2/repository/javax/xml/bind/jaxb-api/2.3.1/jaxb-api-2.3.1.jar:/Users/robert/.m2/repository/javax/activation/javax.activation-api/1.2.0/javax.activation-api-1.2.0.jar:/Users/robert/.m2/repository/com/google/inject/extensions/guice-servlet/3.0/guice-servlet-3.0.jar:/Users/robert/.m2/repository/com/google/inject/guice/3.0/guice-3.0.jar:/Users/robert/.m2/repository/javax/inject/javax.inject/1/javax.inject-1.jar:/Users/robert/.m2/repository/aopalliance/aopalliance/1.0/aopalliance-1.0.jar:/Users/robert/.m2/repository/com/sun/jersey/contribs/jersey-guice/1.9/jersey-guice-1.9.jar:/Users/robert/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.4.1/hadoop-mapreduce-client-core-2.4.1.jar:/Users/robert/.m2/repository/io/netty/netty/3.6.2.Final/netty-3.6.2.Final.jar:/Users/robert/.m2/repository/org/apache/kafka/kafka-clients/2.2.2/kafka-clients-2.2.2.jar:/Users/robert/.m2/repository/com/github/luben/zstd-jni/1.3.8-1/zstd-jni-1.3.8-1.jar:/Users/robert/.m2/repository/org/apache/hadoop/hadoop-common/2.4.1/hadoop-common-2.4.1.jar:/Users/robert/.m2/repository/org/apache/hadoop/hadoop-annotations/2.4.1/hadoop-annotations-2.4.1.jar:/Users/robert/.m2/repository/com/google/guava/guava/11.0.2/guava-11.0.2.jar:/Users/robert/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/Users/robert/.m2/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar:/Users/robert/.m2/repository/commons-codec/commons-codec/1.10/commons-codec-1.10.jar:/Users/robert/.m2/repository/commons-net/commons-net/3.1/commons-net-3.1.jar:/Users/robert/.m2/repository/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar:/Users/robert/.m2/repository/javax/servlet/servlet-api/2.5/servlet-api-2.5.jar:/Users/robert/.m2/repository/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.jar:/Users/robert/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar:/Users/robert/.m2/repository/com/sun/jersey/jersey-core/1.9/jersey-core-1.9.jar:/Users/robert/.m2/repository/com/sun/jersey/jersey-json/1.9/jersey-json-1.9.jar:/Users/robert/.m2/repository/org/codehaus/jettison/jettison/1.1/jettison-1.1.jar:/Users/robert/.m2/repository/com/sun/xml/bind/jaxb-impl/2.2.3-1/jaxb-impl-2.2.3-1.jar:/Users/robert/.m2/repository/org/codehaus/jackson/jackson-jaxrs/1.8.3/jackson-jaxrs-1.8.3.jar:/Users/robert/.m2/repository/org/codehaus/jackson/jackson-xc/1.8.3/jackson-xc-1.8.3.jar:/Users/robert/.m2/repository/com/sun/jersey/jersey-server/1.9/jersey-server-1.9.jar:/Users/robert/.m2/repository/asm/asm/3.1/asm-3.1.jar:/Users/robert/.m2/repository/tomcat/jasper-compiler/5.5.23/jasper-compiler-5.5.23.jar:/Users/robert/.m2/repository/tomcat/jasper-runtime/5.5.23/jasper-runtime-5.5.23.jar:/Users/robert/.m2/repository/javax/servlet/jsp/jsp-api/2.1/jsp-api-2.1.jar:/Users/robert/.m2/repository/commons-el/commons-el/1.0/commons-el-1.0.jar:/Users/robert/.m2/repository/commons-logging/commons-logging/1.1.3/commons-logging-1.1.3.jar:/Users/robert/.m2/repository/net/java/dev/jets3t/jets3t/0.9.0/jets3t-0.9.0.jar:/Users/robert/.m2/repository/org/apache/httpcomponents/httpclient/4.5.3/httpclient-4.5.3.jar:/Users/robert/.m2/repository/org/apache/httpcomponents/httpcore/4.4.6/httpcore-4.4.6.jar:/Users/robert/.m2/repository/com/jamesmurty/utils/java-xmlbuilder/0.4/java-xmlbuilder-0.4.jar:/Users/robert/.m2/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar:/Users/robert/.m2/repository/commons-configuration/commons-configuration/1.7/commons-configuration-1.7.jar:/Users/robert/.m2/repository/commons-digester/commons-digester/1.8.1/commons-digester-1.8.1.jar:/Users/robert/.m2/repository/commons-beanutils/commons-beanutils/1.8.3/commons-beanutils-1.8.3.jar:/Users/robert/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.8.8/jackson-core-asl-1.8.8.jar:/Users/robert/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.8.8/jackson-mapper-asl-1.8.8.jar:/Users/robert/.m2/repository/org/apache/avro/avro/1.8.2/avro-1.8.2.jar:/Users/robert/.m2/repository/com/thoughtworks/paranamer/paranamer/2.7/paranamer-2.7.jar:/Users/robert/.m2/repository/org/tukaani/xz/1.5/xz-1.5.jar:/Users/robert/.m2/repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar:/Users/robert/.m2/repository/org/apache/hadoop/hadoop-auth/2.4.1/hadoop-auth-2.4.1.jar:/Users/robert/.m2/repository/com/jcraft/jsch/0.1.42/jsch-0.1.42.jar:/Users/robert/.m2/repository/org/apache/zookeeper/zookeeper/3.4.10/zookeeper-3.4.10.jar:/Users/robert/.m2/repository/org/apache/commons/commons-compress/1.20/commons-compress-1.20.jar:/Users/robert/.m2/repository/org/apache/hadoop/hadoop-yarn-client/2.4.1/hadoop-yarn-client-2.4.1.jar:/Users/robert/.m2/repository/com/sun/jersey/jersey-client/1.9/jersey-client-1.9.jar:/Users/robert/.m2/repository/org/apache/hadoop/hadoop-yarn-api/2.4.1/hadoop-yarn-api-2.4.1.jar:/Users/robert/.m2/repository/org/apache/hadoop/hadoop-minicluster/2.4.1/hadoop-minicluster-2.4.1.jar:/Users/robert/.m2/repository/org/apache/hadoop/hadoop-common/2.4.1/hadoop-common-2.4.1-tests.jar:/Users/robert/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.4.1/hadoop-hdfs-2.4.1-tests.jar:/Users/robert/.m2/repository/org/apache/hadoop/hadoop-yarn-server-tests/2.4.1/hadoop-yarn-server-tests-2.4.1-tests.jar:/Users/robert/.m2/repository/org/apache/hadoop/hadoop-yarn-server-common/2.4.1/hadoop-yarn-server-common-2.4.1.jar:/Users/robert/.m2/repository/org/apache/hadoop/hadoop-yarn-server-nodemanager/2.4.1/hadoop-yarn-server-nodemanager-2.4.1.jar:/Users/robert/.m2/repository/org/apache/hadoop/hadoop-yarn-server-resourcemanager/2.4.1/hadoop-yarn-server-resourcemanager-2.4.1.jar:/Users/robert/.m2/repository/org/apache/hadoop/hadoop-yarn-server-applicationhistoryservice/2.4.1/hadoop-yarn-server-applicationhistoryservice-2.4.1.jar:/Users/robert/.m2/repository/org/fusesource/leveldbjni/leveldbjni-all/1.8/leveldbjni-all-1.8.jar:/Users/robert/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.4.1/hadoop-mapreduce-client-jobclient-2.4.1-tests.jar:/Users/robert/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-common/2.4.1/hadoop-mapreduce-client-common-2.4.1.jar:/Users/robert/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-shuffle/2.4.1/hadoop-mapreduce-client-shuffle-2.4.1.jar:/Users/robert/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-app/2.4.1/hadoop-mapreduce-client-app-2.4.1.jar:/Users/robert/.m2/repository/org/apache/hadoop/hadoop-yarn-server-web-proxy/2.4.1/hadoop-yarn-server-web-proxy-2.4.1.jar:/Users/robert/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.4.1/hadoop-mapreduce-client-jobclient-2.4.1.jar:/Users/robert/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-hs/2.4.1/hadoop-mapreduce-client-hs-2.4.1.jar:/Users/robert/.m2/repository/org/apache/hadoop/hadoop-minikdc/3.2.0/hadoop-minikdc-3.2.0.jar:/Users/robert/.m2/repository/org/apache/kerby/kerb-simplekdc/1.0.1/kerb-simplekdc-1.0.1.jar:/Users/robert/.m2/repository/org/apache/kerby/kerb-client/1.0.1/kerb-client-1.0.1.jar:/Users/robert/.m2/repository/org/apache/kerby/kerby-config/1.0.1/kerby-config-1.0.1.jar:/Users/robert/.m2/repository/org/apache/kerby/kerb-core/1.0.1/kerb-core-1.0.1.jar:/Users/robert/.m2/repository/org/apache/kerby/kerby-pkix/1.0.1/kerby-pkix-1.0.1.jar:/Users/robert/.m2/repository/org/apache/kerby/kerby-asn1/1.0.1/kerby-asn1-1.0.1.jar:/Users/robert/.m2/repository/org/apache/kerby/kerby-util/1.0.1/kerby-util-1.0.1.jar:/Users/robert/.m2/repository/org/apache/kerby/kerb-common/1.0.1/kerb-common-1.0.1.jar:/Users/robert/.m2/repository/org/apache/kerby/kerb-crypto/1.0.1/kerb-crypto-1.0.1.jar:/Users/robert/.m2/repository/org/apache/kerby/kerb-util/1.0.1/kerb-util-1.0.1.jar:/Users/robert/.m2/repository/org/apache/kerby/token-provider/1.0.1/token-provider-1.0.1.jar:/Users/robert/.m2/repository/com/nimbusds/nimbus-jose-jwt/3.10/nimbus-jose-jwt-3.10.jar:/Users/robert/.m2/repository/net/jcip/jcip-annotations/1.0/jcip-annotations-1.0.jar:/Users/robert/.m2/repository/net/minidev/json-smart/1.3.1/json-smart-1.3.1.jar:/Users/robert/.m2/repository/org/bouncycastle/bcprov-jdk15on/1.52/bcprov-jdk15on-1.52.jar:/Users/robert/.m2/repository/org/apache/kerby/kerb-admin/1.0.1/kerb-admin-1.0.1.jar:/Users/robert/.m2/repository/org/apache/kerby/kerb-server/1.0.1/kerb-server-1.0.1.jar:/Users/robert/.m2/repository/org/apache/kerby/kerb-identity/1.0.1/kerb-identity-1.0.1.jar:/Users/robert/.m2/repository/org/apache/kerby/kerby-xdr/1.0.1/kerby-xdr-1.0.1.jar:/Users/robert/.m2/repository/org/slf4j/slf4j-api/1.7.15/slf4j-api-1.7.15.jar:/Users/robert/.m2/repository/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar:/Users/robert/.m2/repository/junit/junit/4.12/junit-4.12.jar:/Users/robert/.m2/repository/org/hamcrest/hamcrest-core/1.3/hamcrest-core-1.3.jar:/Users/robert/.m2/repository/org/mockito/mockito-core/2.21.0/mockito-core-2.21.0.jar:/Users/robert/.m2/repository/net/bytebuddy/byte-buddy/1.8.15/byte-buddy-1.8.15.jar:/Users/robert/.m2/repository/net/bytebuddy/byte-buddy-agent/1.8.15/byte-buddy-agent-1.8.15.jar:/Users/robert/.m2/repository/org/objenesis/objenesis/2.1/objenesis-2.1.jar:/Users/robert/.m2/repository/org/powermock/powermock-module-junit4/2.0.4/powermock-module-junit4-2.0.4.jar:/Users/robert/.m2/repository/org/powermock/powermock-module-junit4-common/2.0.4/powermock-module-junit4-common-2.0.4.jar:/Users/robert/.m2/repository/org/powermock/powermock-reflect/2.0.4/powermock-reflect-2.0.4.jar:/Users/robert/.m2/repository/org/powermock/powermock-core/2.0.4/powermock-core-2.0.4.jar:/Users/robert/.m2/repository/org/powermock/powermock-api-mockito2/2.0.4/powermock-api-mockito2-2.0.4.jar:/Users/robert/.m2/repository/org/powermock/powermock-api-support/2.0.4/powermock-api-support-2.0.4.jar:/Users/robert/.m2/repository/org/hamcrest/hamcrest-all/1.3/hamcrest-all-1.3.jar:/Users/robert/.m2/repository/org/apache/logging/log4j/log4j-slf4j-impl/2.12.1/log4j-slf4j-impl-2.12.1.jar:/Users/robert/.m2/repository/org/apache/logging/log4j/log4j-api/2.12.1/log4j-api-2.12.1.jar:/Users/robert/.m2/repository/org/apache/logging/log4j/log4j-core/2.12.1/log4j-core-2.12.1.jar:/Users/robert/.m2/repository/org/apache/logging/log4j/log4j-1.2-api/2.12.1/log4j-1.2-api-2.12.1.jar
2020-05-25 15:03:18,288 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - --------------------------------------------------------------------------------
2020-05-25 15:03:18,289 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - Registered UNIX signal handlers for [TERM, HUP, INT]
2020-05-25 15:03:18,291 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - Current working Directory: /Users/robert/Projects/flink/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-localDir-nm-1_0/usercache/robert/appcache/application_1590411786177_0001/container_1590411786177_0001_01_000002
2020-05-25 15:03:18,307 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.memory.process.size, 1 gb
2020-05-25 15:03:18,307 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: internal.jobgraph-path, job.graph
2020-05-25 15:03:18,307 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: yarn.flink-dist-jar, file:/Users/robert/Projects/flink/build-target/lib/flink-dist_2.11-1.12-SNAPSHOT.jar
2020-05-25 15:03:18,307 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.execution.failover-strategy, region
2020-05-25 15:03:18,308 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: high-availability.cluster-id, application_1590411786177_0001
2020-05-25 15:03:18,308 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.address, localhost
2020-05-25 15:03:18,308 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.target, yarn-per-job
2020-05-25 15:03:18,308 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.memory.process.size, 768 mb
2020-05-25 15:03:18,308 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.port, 6123
2020-05-25 15:03:18,308 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.savepoint.ignore-unclaimed-state, false
2020-05-25 15:03:18,308 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.attached, true
2020-05-25 15:03:18,308 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: internal.cluster.execution-mode, NORMAL
2020-05-25 15:03:18,309 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.shutdown-on-attached-exit, false
2020-05-25 15:03:18,309 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: pipeline.jars, file:/Users/robert/Projects/flink/flink-yarn-tests/target/programs/BatchWordCount.jar
2020-05-25 15:03:18,309 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: parallelism.default, 1
2020-05-25 15:03:18,309 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: yarn.ship-directories, /Users/robert/Projects/flink/flink-yarn-tests/../build-target/lib
2020-05-25 15:03:18,309 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.numberOfTaskSlots, 2
2020-05-25 15:03:18,309 WARN org.apache.flink.configuration.GlobalConfiguration [] - Error while trying to split key and value in configuration file ./flink-conf.yaml:18: "pipeline.classpaths: "
2020-05-25 15:03:18,309 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: $internal.yarn.log-config-file, /var/folders/js/yfk_y2450q7559kygttykwk00000gn/T/junit4770195625186370798/conf/log4j.properties
2020-05-25 15:03:18,311 WARN org.apache.flink.core.plugin.PluginConfig [] - The plugins directory [plugins] does not exist.
2020-05-25 15:03:18,372 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - Current working/local Directory: /Users/robert/Projects/flink/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-localDir-nm-1_0/usercache/robert/appcache/application_1590411786177_0001
2020-05-25 15:03:18,376 INFO org.apache.flink.runtime.clusterframework.BootstrapTools [] - Setting directories for temporary files to: /Users/robert/Projects/flink/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-localDir-nm-1_0/usercache/robert/appcache/application_1590411786177_0001
2020-05-25 15:03:18,376 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - TM: local keytab path obtained null
2020-05-25 15:03:18,376 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - TM: keytab principal obtained null
2020-05-25 15:03:18,385 INFO org.apache.flink.yarn.YarnTaskExecutorRunner [] - YARN daemon is running as: robert Yarn client user obtainer: robert
2020-05-25 15:03:18,404 WARN org.apache.flink.runtime.util.HadoopUtils [] - Could not find Hadoop configuration via any of the supported methods (Flink configuration, environment variables).
2020-05-25 15:03:18,424 WARN org.apache.hadoop.conf.Configuration [] - yarn-site.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2020-05-25 15:03:18,424 WARN org.apache.hadoop.conf.Configuration [] - yarn-site.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2020-05-25 15:03:18,430 INFO org.apache.flink.runtime.security.modules.HadoopModule [] - Hadoop user set to robert (auth:SIMPLE), credentials check status: true
2020-05-25 15:03:18,439 INFO org.apache.flink.runtime.security.modules.JaasModule [] - Jaas file will be created as /Users/robert/Projects/flink/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-localDir-nm-1_0/usercache/robert/appcache/application_1590411786177_0001/jaas-7366475351470157639.conf.
2020-05-25 15:03:18,475 WARN org.apache.flink.configuration.Configuration [] - Config uses deprecated configuration key 'web.port' instead of proper key 'rest.port'
2020-05-25 15:03:18,479 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner [] - Using configured hostname/address for TaskManager: macbook-pro-2.localdomain.
2020-05-25 15:03:18,481 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Trying to start actor system, external address macbook-pro-2.localdomain:0, bind address 0.0.0.0:0.
2020-05-25 15:03:18,880 INFO akka.event.slf4j.Slf4jLogger [] - Slf4jLogger started
2020-05-25 15:03:18,901 INFO akka.remote.Remoting [] - Starting remoting
2020-05-25 15:03:19,010 INFO akka.remote.Remoting [] - Remoting started; listening on addresses :[akka.tcp://flink@macbook-pro-2.localdomain:51631]
2020-05-25 15:03:19,149 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Actor system started at akka.tcp://flink@macbook-pro-2.localdomain:51631
2020-05-25 15:03:19,168 INFO org.apache.flink.runtime.metrics.MetricRegistryImpl [] - No metrics reporter configured, no metrics will be exposed/reported.
2020-05-25 15:03:19,171 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Trying to start actor system, external address macbook-pro-2.localdomain:0, bind address 0.0.0.0:0.
2020-05-25 15:03:19,180 INFO akka.event.slf4j.Slf4jLogger [] - Slf4jLogger started
2020-05-25 15:03:19,182 INFO akka.remote.Remoting [] - Starting remoting
2020-05-25 15:03:19,186 INFO akka.remote.Remoting [] - Remoting started; listening on addresses :[akka.tcp://flink-metrics@macbook-pro-2.localdomain:51633]
2020-05-25 15:03:19,209 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Actor system started at akka.tcp://flink-metrics@macbook-pro-2.localdomain:51633
2020-05-25 15:03:19,220 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at akka://flink-metrics/user/rpc/MetricQueryService_container_1590411786177_0001_01_000002 .
2020-05-25 15:03:19,230 INFO org.apache.flink.runtime.blob.PermanentBlobCache [] - Created BLOB cache storage directory /Users/robert/Projects/flink/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-localDir-nm-1_0/usercache/robert/appcache/application_1590411786177_0001/blobStore-9e92fbe6-df88-4d92-a60f-3616076671c8
2020-05-25 15:03:19,232 INFO org.apache.flink.runtime.blob.TransientBlobCache [] - Created BLOB cache storage directory /Users/robert/Projects/flink/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-localDir-nm-1_0/usercache/robert/appcache/application_1590411786177_0001/blobStore-5ece715c-c244-4287-a072-f5eb521be3a9
2020-05-25 15:03:19,235 INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: []
2020-05-25 15:03:19,235 INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: []
2020-05-25 15:03:19,235 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner [] - Starting TaskManager with ResourceID: container_1590411786177_0001_01_000002
2020-05-25 15:03:19,256 INFO org.apache.flink.runtime.taskexecutor.TaskManagerServices [] - Temporary file directory '/Users/robert/Projects/flink/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-localDir-nm-1_0/usercache/robert/appcache/application_1590411786177_0001': total 828 GB, usable 68 GB (8.21% usable)
2020-05-25 15:03:19,260 INFO org.apache.flink.runtime.io.disk.FileChannelManagerImpl [] - FileChannelManager uses directory /Users/robert/Projects/flink/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-localDir-nm-1_0/usercache/robert/appcache/application_1590411786177_0001/flink-io-92ae2a87-8ebc-4bdc-9aa9-00fc5b8609be for spill files.
2020-05-25 15:03:19,270 INFO org.apache.flink.runtime.io.network.netty.NettyConfig [] - NettyConfig [server address: /0.0.0.0, server port: 0, ssl enabled: false, memory segment size (bytes): 32768, transport type: AUTO, number of server threads: 2 (manual), number of client threads: 2 (manual), server connect backlog: 0 (use Netty's default), client connect timeout (sec): 120, send/receive buffer size (bytes): 0 (use Netty's default)]
2020-05-25 15:03:19,275 INFO org.apache.flink.runtime.io.disk.FileChannelManagerImpl [] - FileChannelManager uses directory /Users/robert/Projects/flink/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-localDir-nm-1_0/usercache/robert/appcache/application_1590411786177_0001/flink-netty-shuffle-cdb62469-66b2-4afe-9ea5-fe4e175f96d0 for spill files.
2020-05-25 15:03:19,371 INFO org.apache.flink.runtime.io.network.buffer.NetworkBufferPool [] - Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
2020-05-25 15:03:19,380 INFO org.apache.flink.runtime.io.network.NettyShuffleEnvironment [] - Starting the network environment and its components.
2020-05-25 15:03:19,417 INFO org.apache.flink.runtime.io.network.netty.NettyClient [] - Transport type 'auto': using NIO.
2020-05-25 15:03:19,419 INFO org.apache.flink.runtime.io.network.netty.NettyClient [] - Successful initialization (took 38 ms).
2020-05-25 15:03:19,422 INFO org.apache.flink.runtime.io.network.netty.NettyServer [] - Transport type 'auto': using NIO.
2020-05-25 15:03:19,458 INFO org.apache.flink.runtime.io.network.netty.NettyServer [] - Successful initialization (took 38 ms). Listening on SocketAddress /0:0:0:0:0:0:0:0:51634.
2020-05-25 15:03:19,460 INFO org.apache.flink.runtime.taskexecutor.KvStateService [] - Starting the kvState service and its components.
2020-05-25 15:03:19,471 INFO org.apache.flink.runtime.taskexecutor.TaskManagerConfiguration [] - Messages have a max timeout of 10000 ms
2020-05-25 15:03:19,484 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at akka://flink/user/rpc/taskmanager_0 .
2020-05-25 15:03:19,496 INFO org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Start job leader service.
2020-05-25 15:03:19,497 INFO org.apache.flink.runtime.filecache.FileCache [] - User file cache uses directory /Users/robert/Projects/flink/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-localDir-nm-1_0/usercache/robert/appcache/application_1590411786177_0001/flink-dist-cache-e5e38f41-de58-40f1-9631-b3b41c70f3ae
2020-05-25 15:03:19,498 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Connecting to ResourceManager akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*(00000000000000000000000000000000).
2020-05-25 15:03:19,714 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Resolved ResourceManager address, beginning registration
2020-05-25 15:03:19,714 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Registration at ResourceManager attempt 1 (timeout=100ms)
2020-05-25 15:03:19,760 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Successful registration at resource manager akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_* under registration id 5c3ea8859df566aacc8e9125da6731ae.
2020-05-25 15:03:19,772 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Receive slot request dab3e0a93603e3da1427f3241226aa47 for job 03ee19c583fc4bce3a2b3b59e1988026 from resource manager with leader id 00000000000000000000000000000000.
2020-05-25 15:03:19,778 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Allocated slot for dab3e0a93603e3da1427f3241226aa47.
2020-05-25 15:03:19,779 INFO org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Add job 03ee19c583fc4bce3a2b3b59e1988026 for job leader monitoring.
2020-05-25 15:03:19,780 INFO org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Try to register at job manager akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/jobmanager_2 with leader id 00000000-0000-0000-0000-000000000000.
2020-05-25 15:03:19,793 INFO org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Resolved JobManager address, beginning registration
2020-05-25 15:03:19,793 INFO org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Registration at JobManager attempt 1 (timeout=100ms)
2020-05-25 15:03:19,806 INFO org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Successful registration at job manager akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/jobmanager_2 for job 03ee19c583fc4bce3a2b3b59e1988026.
2020-05-25 15:03:19,807 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Establish JobManager connection for job 03ee19c583fc4bce3a2b3b59e1988026.
2020-05-25 15:03:19,810 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Offer reserved slots to the leader of job 03ee19c583fc4bce3a2b3b59e1988026.
2020-05-25 15:03:19,828 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Activate slot dab3e0a93603e3da1427f3241226aa47.
2020-05-25 15:03:19,871 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Received task CHAIN DataSource (at getDefaultTextLineDataSet(WordCountData.java:70) (org.apache.flink.api.java.io.CollectionInputFormat)) -> FlatMap (FlatMap at main(WordCount.java:84)) -> Combine (SUM(1), at main(WordCount.java:87) (1/1).
2020-05-25 15:03:19,872 INFO org.apache.flink.runtime.taskmanager.Task [] - CHAIN DataSource (at getDefaultTextLineDataSet(WordCountData.java:70) (org.apache.flink.api.java.io.CollectionInputFormat)) -> FlatMap (FlatMap at main(WordCount.java:84)) -> Combine (SUM(1), at main(WordCount.java:87) (1/1) (04c5f4faf2014c494c8f13c2b78bd136) switched from CREATED to DEPLOYING.
2020-05-25 15:03:19,872 INFO org.apache.flink.runtime.taskmanager.Task [] - Creating FileSystem stream leak safety net for task CHAIN DataSource (at getDefaultTextLineDataSet(WordCountData.java:70) (org.apache.flink.api.java.io.CollectionInputFormat)) -> FlatMap (FlatMap at main(WordCount.java:84)) -> Combine (SUM(1), at main(WordCount.java:87) (1/1) (04c5f4faf2014c494c8f13c2b78bd136) [DEPLOYING]
2020-05-25 15:03:19,875 INFO org.apache.flink.runtime.taskmanager.Task [] - Loading JAR files for task CHAIN DataSource (at getDefaultTextLineDataSet(WordCountData.java:70) (org.apache.flink.api.java.io.CollectionInputFormat)) -> FlatMap (FlatMap at main(WordCount.java:84)) -> Combine (SUM(1), at main(WordCount.java:87) (1/1) (04c5f4faf2014c494c8f13c2b78bd136) [DEPLOYING].
2020-05-25 15:03:19,884 INFO org.apache.flink.runtime.taskmanager.Task [] - Registering task at network: CHAIN DataSource (at getDefaultTextLineDataSet(WordCountData.java:70) (org.apache.flink.api.java.io.CollectionInputFormat)) -> FlatMap (FlatMap at main(WordCount.java:84)) -> Combine (SUM(1), at main(WordCount.java:87) (1/1) (04c5f4faf2014c494c8f13c2b78bd136) [DEPLOYING].
2020-05-25 15:03:19,893 INFO org.apache.flink.runtime.taskmanager.Task [] - CHAIN DataSource (at getDefaultTextLineDataSet(WordCountData.java:70) (org.apache.flink.api.java.io.CollectionInputFormat)) -> FlatMap (FlatMap at main(WordCount.java:84)) -> Combine (SUM(1), at main(WordCount.java:87) (1/1) (04c5f4faf2014c494c8f13c2b78bd136) switched from DEPLOYING to RUNNING.
2020-05-25 15:03:19,949 WARN org.apache.flink.metrics.MetricGroup [] - The operator name DataSource (at getDefaultTextLineDataSet(WordCountData.java:70) (org.apache.flink.api.java.io.CollectionInputFormat)) exceeded the 80 characters length limit and was truncated.
2020-05-25 15:03:19,995 INFO org.apache.flink.runtime.taskmanager.Task [] - CHAIN DataSource (at getDefaultTextLineDataSet(WordCountData.java:70) (org.apache.flink.api.java.io.CollectionInputFormat)) -> FlatMap (FlatMap at main(WordCount.java:84)) -> Combine (SUM(1), at main(WordCount.java:87) (1/1) (04c5f4faf2014c494c8f13c2b78bd136) switched from RUNNING to FINISHED.
2020-05-25 15:03:19,995 INFO org.apache.flink.runtime.taskmanager.Task [] - Freeing task resources for CHAIN DataSource (at getDefaultTextLineDataSet(WordCountData.java:70) (org.apache.flink.api.java.io.CollectionInputFormat)) -> FlatMap (FlatMap at main(WordCount.java:84)) -> Combine (SUM(1), at main(WordCount.java:87) (1/1) (04c5f4faf2014c494c8f13c2b78bd136).
2020-05-25 15:03:19,996 INFO org.apache.flink.runtime.taskmanager.Task [] - Ensuring all FileSystem streams are closed for task CHAIN DataSource (at getDefaultTextLineDataSet(WordCountData.java:70) (org.apache.flink.api.java.io.CollectionInputFormat)) -> FlatMap (FlatMap at main(WordCount.java:84)) -> Combine (SUM(1), at main(WordCount.java:87) (1/1) (04c5f4faf2014c494c8f13c2b78bd136) [FINISHED]
2020-05-25 15:03:20,008 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Received task Reduce (SUM(1), at main(WordCount.java:87) (1/1).
2020-05-25 15:03:20,008 INFO org.apache.flink.runtime.taskmanager.Task [] - Reduce (SUM(1), at main(WordCount.java:87) (1/1) (ba85a23c1d690b9816d8bdca03e0fdd6) switched from CREATED to DEPLOYING.
2020-05-25 15:03:20,008 INFO org.apache.flink.runtime.taskmanager.Task [] - Creating FileSystem stream leak safety net for task Reduce (SUM(1), at main(WordCount.java:87) (1/1) (ba85a23c1d690b9816d8bdca03e0fdd6) [DEPLOYING]
2020-05-25 15:03:20,008 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN DataSource (at getDefaultTextLineDataSet(WordCountData.java:70) (org.apache.flink.api.java.io.CollectionInputFormat)) -> FlatMap (FlatMap at main(WordCount.java:84)) -> Combine (SUM(1), at main(WordCount.java:87) (1/1) 04c5f4faf2014c494c8f13c2b78bd136.
2020-05-25 15:03:20,008 INFO org.apache.flink.runtime.taskmanager.Task [] - Loading JAR files for task Reduce (SUM(1), at main(WordCount.java:87) (1/1) (ba85a23c1d690b9816d8bdca03e0fdd6) [DEPLOYING].
2020-05-25 15:03:20,010 INFO org.apache.flink.runtime.taskmanager.Task [] - Registering task at network: Reduce (SUM(1), at main(WordCount.java:87) (1/1) (ba85a23c1d690b9816d8bdca03e0fdd6) [DEPLOYING].
2020-05-25 15:03:20,010 INFO org.apache.flink.runtime.taskmanager.Task [] - Reduce (SUM(1), at main(WordCount.java:87) (1/1) (ba85a23c1d690b9816d8bdca03e0fdd6) switched from DEPLOYING to RUNNING.
2020-05-25 15:03:20,042 INFO org.apache.flink.runtime.taskmanager.Task [] - Reduce (SUM(1), at main(WordCount.java:87) (1/1) (ba85a23c1d690b9816d8bdca03e0fdd6) switched from RUNNING to FINISHED.
2020-05-25 15:03:20,042 INFO org.apache.flink.runtime.taskmanager.Task [] - Freeing task resources for Reduce (SUM(1), at main(WordCount.java:87) (1/1) (ba85a23c1d690b9816d8bdca03e0fdd6).
2020-05-25 15:03:20,042 INFO org.apache.flink.runtime.taskmanager.Task [] - Ensuring all FileSystem streams are closed for task Reduce (SUM(1), at main(WordCount.java:87) (1/1) (ba85a23c1d690b9816d8bdca03e0fdd6) [FINISHED]
2020-05-25 15:03:20,043 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Un-registering task and sending final execution state FINISHED to JobManager for task Reduce (SUM(1), at main(WordCount.java:87) (1/1) ba85a23c1d690b9816d8bdca03e0fdd6.
2020-05-25 15:03:20,046 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Received task DataSink (collect()) (1/1).
2020-05-25 15:03:20,047 INFO org.apache.flink.runtime.taskmanager.Task [] - DataSink (collect()) (1/1) (f1c100e7db5292cdd8fdd7f49b2036ee) switched from CREATED to DEPLOYING.
2020-05-25 15:03:20,047 INFO org.apache.flink.runtime.taskmanager.Task [] - Creating FileSystem stream leak safety net for task DataSink (collect()) (1/1) (f1c100e7db5292cdd8fdd7f49b2036ee) [DEPLOYING]
2020-05-25 15:03:20,047 INFO org.apache.flink.runtime.taskmanager.Task [] - Loading JAR files for task DataSink (collect()) (1/1) (f1c100e7db5292cdd8fdd7f49b2036ee) [DEPLOYING].
2020-05-25 15:03:20,048 INFO org.apache.flink.runtime.taskmanager.Task [] - Registering task at network: DataSink (collect()) (1/1) (f1c100e7db5292cdd8fdd7f49b2036ee) [DEPLOYING].
2020-05-25 15:03:20,049 INFO org.apache.flink.runtime.taskmanager.Task [] - DataSink (collect()) (1/1) (f1c100e7db5292cdd8fdd7f49b2036ee) switched from DEPLOYING to RUNNING.
2020-05-25 15:03:20,053 INFO org.apache.flink.runtime.taskmanager.Task [] - DataSink (collect()) (1/1) (f1c100e7db5292cdd8fdd7f49b2036ee) switched from RUNNING to FINISHED.
2020-05-25 15:03:20,053 INFO org.apache.flink.runtime.taskmanager.Task [] - Freeing task resources for DataSink (collect()) (1/1) (f1c100e7db5292cdd8fdd7f49b2036ee).
2020-05-25 15:03:20,053 INFO org.apache.flink.runtime.taskmanager.Task [] - Ensuring all FileSystem streams are closed for task DataSink (collect()) (1/1) (f1c100e7db5292cdd8fdd7f49b2036ee) [FINISHED]
2020-05-25 15:03:20,053 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (collect()) (1/1) f1c100e7db5292cdd8fdd7f49b2036ee.
2020-05-25 15:03:20,077 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Free slot TaskSlot(index:0, state:ACTIVE, resource profile: ResourceProfile{cpuCores=1.0000000000000000, taskHeapMemory=12.800mb (13421771 bytes), taskOffHeapMemory=0 bytes, managedMemory=115.200mb (120795957 bytes), networkMemory=32.000mb (33554432 bytes)}, allocationId: dab3e0a93603e3da1427f3241226aa47, jobId: 03ee19c583fc4bce3a2b3b59e1988026).
2020-05-25 15:03:20,144 INFO org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Remove job 03ee19c583fc4bce3a2b3b59e1988026 from job leader monitoring.
2020-05-25 15:03:20,145 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Close JobManager connection for job 03ee19c583fc4bce3a2b3b59e1988026.
2020-05-25 15:04:09,782 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - The heartbeat of ResourceManager with id a1dc34c6580d4ba21fcd77fdaa4622d7 timed out.
2020-05-25 15:04:09,783 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Close ResourceManager connection a1dc34c6580d4ba21fcd77fdaa4622d7.
2020-05-25 15:04:09,785 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Connecting to ResourceManager akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*(00000000000000000000000000000000).
2020-05-25 15:04:09,791 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:04:09,791 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:04:09,793 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:04:19,816 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:04:19,817 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:04:19,817 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:04:29,836 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:04:29,837 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:04:29,837 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:04:39,857 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:04:39,857 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:04:39,858 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:04:49,877 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:04:49,877 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:04:49,877 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:04:59,899 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:04:59,899 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:04:59,899 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:05:09,918 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:05:09,919 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:05:09,919 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:05:19,939 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:05:19,939 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:05:19,939 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:05:29,958 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:05:29,959 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:05:29,959 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:05:39,982 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:05:39,982 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:05:39,982 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:05:49,998 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:05:49,998 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:05:49,998 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:06:00,018 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:06:00,018 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:06:00,019 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:06:10,043 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:06:10,043 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:06:10,043 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:06:20,059 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:06:20,060 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:06:20,060 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:06:30,081 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:06:30,082 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:06:30,082 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:06:40,104 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:06:40,104 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:06:40,104 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:06:50,120 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:06:50,121 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:06:50,121 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:07:00,140 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:07:00,141 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:07:00,141 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:07:10,161 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:07:10,161 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:07:10,161 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:07:20,184 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:07:20,184 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:07:20,184 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:07:30,204 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:07:30,205 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:07:30,205 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:07:40,223 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:07:40,223 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:07:40,224 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:07:50,244 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:07:50,244 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:07:50,244 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:08:00,263 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:08:00,264 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:08:00,264 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:08:10,285 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:08:10,285 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:08:10,285 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:08:20,303 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:08:20,304 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:08:20,304 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:08:30,324 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:08:30,324 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:08:30,324 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:08:40,346 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:08:40,346 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:08:40,346 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:08:50,365 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:08:50,365 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:08:50,365 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:09:00,385 WARN akka.remote.transport.netty.NettyTransport [] - Remote connection to [null] failed with java.net.ConnectException: Connection refused
2020-05-25 15:09:00,385 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*..
2020-05-25 15:09:00,385 WARN akka.remote.ReliableDeliverySupervisor [] - Association with remote system [akka.tcp://flink@macbook-pro-2.localdomain:51615] has failed, address is now gated for [50] ms. Reason: [Association failed with [akka.tcp://flink@macbook-pro-2.localdomain:51615]] Caused by: [java.net.ConnectException: Connection refused]
2020-05-25 15:09:09,812 ERROR org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Fatal error occurred in TaskExecutor akka.tcp://flink@macbook-pro-2.localdomain:51631/user/rpc/taskmanager_0.
org.apache.flink.runtime.taskexecutor.exceptions.RegistrationTimeoutException: Could not register at the ResourceManager within the specified maximum registration duration 300000 ms. This indicates a problem with this instance. Terminating now.
at org.apache.flink.runtime.taskexecutor.TaskExecutor.registrationTimeout(TaskExecutor.java:1251) ~[flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at org.apache.flink.runtime.taskexecutor.TaskExecutor.lambda$startRegistrationTimeout$18(TaskExecutor.java:1237) ~[flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRunAsync(AkkaRpcActor.java:402) ~[flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:195) ~[flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:152) ~[flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:26) [flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:21) [flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123) [flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:21) [flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:170) [flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171) [flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171) [flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at akka.actor.Actor$class.aroundReceive(Actor.scala:517) [flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:225) [flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:592) [flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at akka.actor.ActorCell.invoke(ActorCell.scala:561) [flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:258) [flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at akka.dispatch.Mailbox.run(Mailbox.scala:225) [flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at akka.dispatch.Mailbox.exec(Mailbox.scala:235) [flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) [flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) [flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) [flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) [flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
2020-05-25 15:09:09,816 ERROR org.apache.flink.runtime.taskexecutor.TaskManagerRunner [] - Fatal error occurred while executing the TaskManager. Shutting it down...
org.apache.flink.runtime.taskexecutor.exceptions.RegistrationTimeoutException: Could not register at the ResourceManager within the specified maximum registration duration 300000 ms. This indicates a problem with this instance. Terminating now.
at org.apache.flink.runtime.taskexecutor.TaskExecutor.registrationTimeout(TaskExecutor.java:1251) ~[flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at org.apache.flink.runtime.taskexecutor.TaskExecutor.lambda$startRegistrationTimeout$18(TaskExecutor.java:1237) ~[flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRunAsync(AkkaRpcActor.java:402) ~[flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:195) ~[flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:152) ~[flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:26) [flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:21) [flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123) [flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:21) [flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:170) [flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171) [flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171) [flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at akka.actor.Actor$class.aroundReceive(Actor.scala:517) [flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:225) [flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:592) [flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at akka.actor.ActorCell.invoke(ActorCell.scala:561) [flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:258) [flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at akka.dispatch.Mailbox.run(Mailbox.scala:225) [flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at akka.dispatch.Mailbox.exec(Mailbox.scala:235) [flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) [flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) [flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) [flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) [flink-dist_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT]
2020-05-25 15:09:09,819 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Stopping TaskExecutor akka.tcp://flink@macbook-pro-2.localdomain:51631/user/rpc/taskmanager_0.
2020-05-25 15:09:09,819 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Terminating registration attempts towards ResourceManager akka.tcp://flink@macbook-pro-2.localdomain:51615/user/rpc/resourcemanager_*.
2020-05-25 15:09:09,822 INFO org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Stop job leader service.
2020-05-25 15:09:09,822 INFO org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager [] - Shutting down TaskExecutorLocalStateStoresManager.
2020-05-25 15:09:09,824 INFO org.apache.flink.runtime.io.disk.FileChannelManagerImpl [] - FileChannelManager removed spill file directory /Users/robert/Projects/flink/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-localDir-nm-1_0/usercache/robert/appcache/application_1590411786177_0001/flink-io-92ae2a87-8ebc-4bdc-9aa9-00fc5b8609be
2020-05-25 15:09:09,825 INFO org.apache.flink.runtime.io.network.NettyShuffleEnvironment [] - Shutting down the network environment and its components.
2020-05-25 15:09:09,826 INFO org.apache.flink.runtime.io.network.netty.NettyClient [] - Successful shutdown (took 1 ms).
2020-05-25 15:09:09,828 INFO org.apache.flink.runtime.io.network.netty.NettyServer [] - Successful shutdown (took 1 ms).
2020-05-25 15:09:09,829 INFO org.apache.flink.runtime.io.disk.FileChannelManagerImpl [] - FileChannelManager removed spill file directory /Users/robert/Projects/flink/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-localDir-nm-1_0/usercache/robert/appcache/application_1590411786177_0001/flink-netty-shuffle-cdb62469-66b2-4afe-9ea5-fe4e175f96d0
2020-05-25 15:09:09,829 INFO org.apache.flink.runtime.taskexecutor.KvStateService [] - Shutting down the kvState service and its components.
2020-05-25 15:09:09,829 INFO org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Stop job leader service.
2020-05-25 15:09:09,829 INFO org.apache.flink.runtime.filecache.FileCache [] - removed file cache directory /Users/robert/Projects/flink/flink-yarn-tests/target/flink-yarn-tests-capacityscheduler/flink-yarn-tests-capacityscheduler-localDir-nm-1_0/usercache/robert/appcache/application_1590411786177_0001/flink-dist-cache-e5e38f41-de58-40f1-9631-b3b41c70f3ae
2020-05-25 15:09:09,830 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Stopped TaskExecutor akka.tcp://flink@macbook-pro-2.localdomain:51631/user/rpc/taskmanager_0.
2020-05-25 15:09:09,831 INFO org.apache.flink.runtime.blob.PermanentBlobCache [] - Shutting down BLOB cache
2020-05-25 15:09:09,831 INFO org.apache.flink.runtime.blob.TransientBlobCache [] - Shutting down BLOB cache
2020-05-25 15:09:09,831 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Stopping Akka RPC service.
2020-05-25 15:09:09,834 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Stopping Akka RPC service.
2020-05-25 15:09:09,837 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Shutting down remote daemon.
2020-05-25 15:09:09,838 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Shutting down remote daemon.
2020-05-25 15:09:09,839 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Remote daemon shut down; proceeding with flushing remote transports.
2020-05-25 15:09:09,839 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Remote daemon shut down; proceeding with flushing remote transports.
2020-05-25 15:09:09,850 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Remoting shut down.
2020-05-25 15:09:09,851 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Remoting shut down.
2020-05-25 15:09:09,858 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Stopped Akka RPC service.
{code}
tl;dr: the following tests/ checks are failing:
- YARNITCase.testPerJobModeWithEnableSystemClassPathIncludeUserJar
- 3x YARNSessionCapacitySchedulerITCase.checkForProhibitedLogContents
--
This message was sent by Atlassian Jira
(v8.3.4#803005)