You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Nico Kruber (JIRA)" <ji...@apache.org> on 2018/07/13 08:15:00 UTC
[jira] [Created] (FLINK-9842) Job submission fails via CLI with SSL
enabled
Nico Kruber created FLINK-9842:
----------------------------------
Summary: Job submission fails via CLI with SSL enabled
Key: FLINK-9842
URL: https://issues.apache.org/jira/browse/FLINK-9842
Project: Flink
Issue Type: Bug
Components: Client, Job-Submission
Affects Versions: 1.5.1
Reporter: Nico Kruber
Fix For: 1.5.2, 1.6.0
There's a regression in Flink 1.5.1 which leads to the job submission via CLI failing with SSL enabled (1.5.0 works). Tried with the {{WordCount}} example:
Client log:
{code}
2018-07-13 09:51:45,088 INFO org.apache.flink.client.cli.CliFrontend - --------------------------------------------------------------------------------
2018-07-13 09:51:45,091 INFO org.apache.flink.client.cli.CliFrontend - Starting Command Line Client (Version: 1.5.1, Rev:3488f8b, Date:10.07.2018 @ 11:51:27 GMT)
2018-07-13 09:51:45,091 INFO org.apache.flink.client.cli.CliFrontend - OS current user: nico
2018-07-13 09:51:45,092 INFO org.apache.flink.client.cli.CliFrontend - Current Hadoop/Kerberos user: <no hadoop dependency found>
2018-07-13 09:51:45,092 INFO org.apache.flink.client.cli.CliFrontend - JVM: OpenJDK 64-Bit Server VM - Oracle Corporation - 1.8/25.171-b11
2018-07-13 09:51:45,092 INFO org.apache.flink.client.cli.CliFrontend - Maximum heap size: 3534 MiBytes
2018-07-13 09:51:45,092 INFO org.apache.flink.client.cli.CliFrontend - JAVA_HOME: /usr/lib64/jvm/java
2018-07-13 09:51:45,093 INFO org.apache.flink.client.cli.CliFrontend - No Hadoop Dependency available
2018-07-13 09:51:45,093 INFO org.apache.flink.client.cli.CliFrontend - JVM Options:
2018-07-13 09:51:45,093 INFO org.apache.flink.client.cli.CliFrontend - -Dlog.file=/home/nico/Downloads/flink-1.5.1/log/flink-nico-client-nico-work.fritz.box.log
2018-07-13 09:51:45,093 INFO org.apache.flink.client.cli.CliFrontend - -Dlog4j.configuration=file:/home/nico/Downloads/flink-1.5.1/conf/log4j-cli.properties
2018-07-13 09:51:45,094 INFO org.apache.flink.client.cli.CliFrontend - -Dlogback.configurationFile=file:/home/nico/Downloads/flink-1.5.1/conf/logback.xml
2018-07-13 09:51:45,094 INFO org.apache.flink.client.cli.CliFrontend - Program Arguments:
2018-07-13 09:51:45,094 INFO org.apache.flink.client.cli.CliFrontend - run
2018-07-13 09:51:45,094 INFO org.apache.flink.client.cli.CliFrontend - ./examples/streaming/WordCount.jar
2018-07-13 09:51:45,094 INFO org.apache.flink.client.cli.CliFrontend - --input
2018-07-13 09:51:45,095 INFO org.apache.flink.client.cli.CliFrontend - LICENSE
2018-07-13 09:51:45,095 INFO org.apache.flink.client.cli.CliFrontend - --output
2018-07-13 09:51:45,095 INFO org.apache.flink.client.cli.CliFrontend - /home/nico/flink/build-target/test.txt
2018-07-13 09:51:45,095 INFO org.apache.flink.client.cli.CliFrontend - Classpath: /home/nico/Downloads/flink-1.5.1/lib/flink-python_2.11-1.5.1.jar:/home/nico/Downloads/flink-1.5.1/lib/log4j-1.2.17.jar:/home/nico/Downloads/flink-1.5.1/lib/slf4j-log4j12-1.7.7.jar:/home/nico/Downloads/flink-1.5.1/lib/flink-dist_2.11-1.5.1.jar:::
2018-07-13 09:51:45,095 INFO org.apache.flink.client.cli.CliFrontend - --------------------------------------------------------------------------------
2018-07-13 09:51:45,105 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.address, localhost
2018-07-13 09:51:45,105 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.port, 6123
2018-07-13 09:51:45,105 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.heap.mb, 1024
2018-07-13 09:51:45,106 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.heap.mb, 1024
2018-07-13 09:51:45,106 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.numberOfTaskSlots, 1
2018-07-13 09:51:45,106 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: parallelism.default, 1
2018-07-13 09:51:45,108 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: rest.port, 8081
2018-07-13 09:51:45,110 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: security.ssl.enabled, true
2018-07-13 09:51:45,110 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: security.ssl.keystore, /home/nico/Downloads/ssl/node.keystore
2018-07-13 09:51:45,110 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: security.ssl.keystore-password, ******
2018-07-13 09:51:45,111 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: security.ssl.key-password, ******
2018-07-13 09:51:45,111 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: security.ssl.truststore, /home/nico/Downloads/ssl/ca.truststore
2018-07-13 09:51:45,111 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: security.ssl.truststore-password, ******
2018-07-13 09:51:45,117 WARN org.apache.flink.client.cli.CliFrontend - Could not load CLI class org.apache.flink.yarn.cli.FlinkYarnSessionCli.
java.lang.NoClassDefFoundError: org/apache/hadoop/conf/Configuration
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at org.apache.flink.client.cli.CliFrontend.loadCustomCommandLine(CliFrontend.java:1208)
at org.apache.flink.client.cli.CliFrontend.loadCustomCommandLines(CliFrontend.java:1164)
at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1090)
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.conf.Configuration
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 5 more
2018-07-13 09:51:45,140 INFO org.apache.flink.core.fs.FileSystem - Hadoop is not in the classpath/dependencies. The extended set of supported File Systems via Hadoop is not available.
2018-07-13 09:51:45,495 INFO org.apache.flink.runtime.security.modules.HadoopModuleFactory - Cannot create Hadoop Security Module because Hadoop cannot be found in the Classpath.
2018-07-13 09:51:45,551 INFO org.apache.flink.runtime.security.SecurityUtils - Cannot install HadoopSecurityContext because Hadoop cannot be found in the Classpath.
2018-07-13 09:51:45,649 INFO org.apache.flink.client.cli.CliFrontend - Running 'run' command.
2018-07-13 09:51:45,657 INFO org.apache.flink.client.cli.CliFrontend - Building program from JAR file
2018-07-13 09:51:45,712 WARN org.apache.flink.configuration.Configuration - Config uses deprecated configuration key 'jobmanager.rpc.address' instead of proper key 'rest.address'
2018-07-13 09:51:46,250 INFO org.apache.flink.runtime.rest.RestClient - Rest client endpoint started.
2018-07-13 09:51:46,254 INFO org.apache.flink.client.cli.CliFrontend - Starting execution of program
2018-07-13 09:51:46,254 INFO org.apache.flink.client.program.rest.RestClusterClient - Starting program in interactive mode (detached: false)
2018-07-13 09:51:46,288 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.address, localhost
2018-07-13 09:51:46,288 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.port, 6123
2018-07-13 09:51:46,289 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.heap.mb, 1024
2018-07-13 09:51:46,289 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.heap.mb, 1024
2018-07-13 09:51:46,289 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.numberOfTaskSlots, 1
2018-07-13 09:51:46,289 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: parallelism.default, 1
2018-07-13 09:51:46,290 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: rest.port, 8081
2018-07-13 09:51:46,291 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: security.ssl.enabled, true
2018-07-13 09:51:46,291 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: security.ssl.keystore, /home/nico/Downloads/ssl/node.keystore
2018-07-13 09:51:46,291 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: security.ssl.keystore-password, ******
2018-07-13 09:51:46,291 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: security.ssl.key-password, ******
2018-07-13 09:51:46,291 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: security.ssl.truststore, /home/nico/Downloads/ssl/ca.truststore
2018-07-13 09:51:46,292 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: security.ssl.truststore-password, ******
2018-07-13 09:51:46,304 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.address, localhost
2018-07-13 09:51:46,304 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.port, 6123
2018-07-13 09:51:46,304 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.heap.mb, 1024
2018-07-13 09:51:46,305 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.heap.mb, 1024
2018-07-13 09:51:46,305 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.numberOfTaskSlots, 1
2018-07-13 09:51:46,305 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: parallelism.default, 1
2018-07-13 09:51:46,305 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: rest.port, 8081
2018-07-13 09:51:46,306 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: security.ssl.enabled, true
2018-07-13 09:51:46,306 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: security.ssl.keystore, /home/nico/Downloads/ssl/node.keystore
2018-07-13 09:51:46,306 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: security.ssl.keystore-password, ******
2018-07-13 09:51:46,306 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: security.ssl.key-password, ******
2018-07-13 09:51:46,306 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: security.ssl.truststore, /home/nico/Downloads/ssl/ca.truststore
2018-07-13 09:51:46,307 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: security.ssl.truststore-password, ******
2018-07-13 09:51:46,355 INFO org.apache.flink.api.java.typeutils.TypeExtractor - class org.apache.flink.streaming.api.functions.source.TimestampedFileInputSplit does not contain a setter for field modificationTime
2018-07-13 09:51:46,356 INFO org.apache.flink.api.java.typeutils.TypeExtractor - Class class org.apache.flink.streaming.api.functions.source.TimestampedFileInputSplit cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance.
2018-07-13 09:51:46,468 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.address, localhost
2018-07-13 09:51:46,468 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.port, 6123
2018-07-13 09:51:46,468 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.heap.mb, 1024
2018-07-13 09:51:46,469 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.heap.mb, 1024
2018-07-13 09:51:46,469 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.numberOfTaskSlots, 1
2018-07-13 09:51:46,469 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: parallelism.default, 1
2018-07-13 09:51:46,469 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: rest.port, 8081
2018-07-13 09:51:46,470 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: security.ssl.enabled, true
2018-07-13 09:51:46,470 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: security.ssl.keystore, /home/nico/Downloads/ssl/node.keystore
2018-07-13 09:51:46,470 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: security.ssl.keystore-password, ******
2018-07-13 09:51:46,470 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: security.ssl.key-password, ******
2018-07-13 09:51:46,470 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: security.ssl.truststore, /home/nico/Downloads/ssl/ca.truststore
2018-07-13 09:51:46,470 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: security.ssl.truststore-password, ******
2018-07-13 09:51:46,605 INFO org.apache.flink.client.program.rest.RestClusterClient - Submitting job a337b32db65c744c68b8f7804b66058d (detached: false).
2018-07-13 09:51:47,773 INFO org.apache.flink.runtime.rest.RestClient - Shutting down rest endpoint.
2018-07-13 09:51:47,775 INFO org.apache.flink.runtime.rest.RestClient - Rest endpoint shutdown complete.
2018-07-13 09:51:47,776 ERROR org.apache.flink.client.cli.CliFrontend - Error while running the command.
org.apache.flink.client.program.ProgramInvocationException: Could not retrieve the execution result.
at org.apache.flink.client.program.rest.RestClusterClient.submitJob(RestClusterClient.java:257)
at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:464)
at org.apache.flink.streaming.api.environment.StreamContextEnvironment.execute(StreamContextEnvironment.java:66)
at org.apache.flink.streaming.examples.wordcount.WordCount.main(WordCount.java:89)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:528)
at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:420)
at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:404)
at org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:785)
at org.apache.flink.client.cli.CliFrontend.runProgram(CliFrontend.java:279)
at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:214)
at org.apache.flink.client.cli.CliFrontend.parseParameters(CliFrontend.java:1025)
at org.apache.flink.client.cli.CliFrontend.lambda$main$9(CliFrontend.java:1101)
at org.apache.flink.runtime.security.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30)
at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1101)
Caused by: org.apache.flink.runtime.client.JobSubmissionException: Failed to submit JobGraph.
at org.apache.flink.client.program.rest.RestClusterClient.lambda$submitJob$8(RestClusterClient.java:370)
at java.util.concurrent.CompletableFuture.uniExceptionally(CompletableFuture.java:870)
at java.util.concurrent.CompletableFuture$UniExceptionally.tryFire(CompletableFuture.java:852)
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474)
at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1977)
at org.apache.flink.runtime.concurrent.FutureUtils.lambda$retryOperationWithDelay$5(FutureUtils.java:214)
at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:760)
at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:736)
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474)
at java.util.concurrent.CompletableFuture.postFire(CompletableFuture.java:561)
at java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:929)
at java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:442)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.util.concurrent.CompletionException: org.apache.flink.runtime.concurrent.FutureUtils$RetryException: Could not complete the operation. Exception is not retryable.
at java.util.concurrent.CompletableFuture.encodeRelay(CompletableFuture.java:326)
at java.util.concurrent.CompletableFuture.completeRelay(CompletableFuture.java:338)
at java.util.concurrent.CompletableFuture.uniRelay(CompletableFuture.java:911)
at java.util.concurrent.CompletableFuture$UniRelay.tryFire(CompletableFuture.java:899)
... 12 more
Caused by: org.apache.flink.runtime.concurrent.FutureUtils$RetryException: Could not complete the operation. Exception is not retryable.
... 10 more
Caused by: java.util.concurrent.CompletionException: org.apache.flink.runtime.rest.util.RestClientException: [Job submission failed.]
at java.util.concurrent.CompletableFuture.encodeRelay(CompletableFuture.java:326)
at java.util.concurrent.CompletableFuture.completeRelay(CompletableFuture.java:338)
at java.util.concurrent.CompletableFuture.uniRelay(CompletableFuture.java:911)
at java.util.concurrent.CompletableFuture.uniCompose(CompletableFuture.java:953)
at java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:926)
... 4 more
Caused by: org.apache.flink.runtime.rest.util.RestClientException: [Job submission failed.]
at org.apache.flink.runtime.rest.RestClient.parseResponse(RestClient.java:309)
at org.apache.flink.runtime.rest.RestClient.lambda$submitRequest$3(RestClient.java:293)
at java.util.concurrent.CompletableFuture.uniCompose(CompletableFuture.java:952)
... 5 more
{code}
JM log:
{code}
2018-07-13 09:50:16,744 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - --------------------------------------------------------------------------------
2018-07-13 09:50:16,747 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Starting StandaloneSessionClusterEntrypoint (Version: 1.5.1, Rev:3488f8b, Date:10.07.2018 @ 11:51:27 GMT)
2018-07-13 09:50:16,747 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - OS current user: nico
2018-07-13 09:50:16,747 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Current Hadoop/Kerberos user: <no hadoop dependency found>
2018-07-13 09:50:16,748 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - JVM: OpenJDK 64-Bit Server VM - Oracle Corporation - 1.8/25.171-b11
2018-07-13 09:50:16,748 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Maximum heap size: 981 MiBytes
2018-07-13 09:50:16,748 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - JAVA_HOME: /usr/lib64/jvm/java
2018-07-13 09:50:16,748 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - No Hadoop Dependency available
2018-07-13 09:50:16,749 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - JVM Options:
2018-07-13 09:50:16,749 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -Xms1024m
2018-07-13 09:50:16,749 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -Xmx1024m
2018-07-13 09:50:16,749 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -Dlog.file=/home/nico/Downloads/flink-1.5.1/log/flink-nico-standalonesession-57-nico-work.fritz.box.log
2018-07-13 09:50:16,749 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -Dlog4j.configuration=file:/home/nico/Downloads/flink-1.5.1/conf/log4j.properties
2018-07-13 09:50:16,749 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -Dlogback.configurationFile=file:/home/nico/Downloads/flink-1.5.1/conf/logback.xml
2018-07-13 09:50:16,750 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Program Arguments:
2018-07-13 09:50:16,750 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - --configDir
2018-07-13 09:50:16,750 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - /home/nico/Downloads/flink-1.5.1/conf
2018-07-13 09:50:16,750 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - --executionMode
2018-07-13 09:50:16,750 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - cluster
2018-07-13 09:50:16,750 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Classpath: /home/nico/Downloads/flink-1.5.1/lib/flink-python_2.11-1.5.1.jar:/home/nico/Downloads/flink-1.5.1/lib/log4j-1.2.17.jar:/home/nico/Downloads/flink-1.5.1/lib/slf4j-log4j12-1.7.7.jar:/home/nico/Downloads/flink-1.5.1/lib/flink-dist_2.11-1.5.1.jar:::
2018-07-13 09:50:16,751 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - --------------------------------------------------------------------------------
2018-07-13 09:50:16,754 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Registered UNIX signal handlers for [TERM, HUP, INT]
2018-07-13 09:50:16,770 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.address, localhost
2018-07-13 09:50:16,771 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.port, 6123
2018-07-13 09:50:16,771 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.heap.mb, 1024
2018-07-13 09:50:16,772 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.heap.mb, 1024
2018-07-13 09:50:16,772 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.numberOfTaskSlots, 1
2018-07-13 09:50:16,773 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: parallelism.default, 1
2018-07-13 09:50:16,774 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: rest.port, 8081
2018-07-13 09:50:16,775 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: security.ssl.enabled, true
2018-07-13 09:50:16,775 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: security.ssl.keystore, /home/nico/Downloads/ssl/node.keystore
2018-07-13 09:50:16,775 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: security.ssl.keystore-password, ******
2018-07-13 09:50:16,776 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: security.ssl.key-password, ******
2018-07-13 09:50:16,776 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: security.ssl.truststore, /home/nico/Downloads/ssl/ca.truststore
2018-07-13 09:50:16,776 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: security.ssl.truststore-password, ******
2018-07-13 09:50:16,923 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Starting StandaloneSessionClusterEntrypoint.
2018-07-13 09:50:16,923 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Install default filesystem.
2018-07-13 09:50:16,932 INFO org.apache.flink.core.fs.FileSystem - Hadoop is not in the classpath/dependencies. The extended set of supported File Systems via Hadoop is not available.
2018-07-13 09:50:16,947 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Install security context.
2018-07-13 09:50:16,960 INFO org.apache.flink.runtime.security.modules.HadoopModuleFactory - Cannot create Hadoop Security Module because Hadoop cannot be found in the Classpath.
2018-07-13 09:50:16,990 INFO org.apache.flink.runtime.security.SecurityUtils - Cannot install HadoopSecurityContext because Hadoop cannot be found in the Classpath.
2018-07-13 09:50:16,991 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Initializing cluster services.
2018-07-13 09:50:17,011 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Trying to start actor system at localhost:6123
2018-07-13 09:50:18,080 INFO akka.event.slf4j.Slf4jLogger - Slf4jLogger started
2018-07-13 09:50:18,235 INFO akka.remote.Remoting - Starting remoting
2018-07-13 09:50:18,587 INFO akka.remote.Remoting - Remoting started; listening on addresses :[akka.ssl.tcp://flink@localhost:6123]
2018-07-13 09:50:18,610 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Actor system started at akka.ssl.tcp://flink@localhost:6123
2018-07-13 09:50:18,679 WARN org.apache.flink.configuration.Configuration - Config uses deprecated configuration key 'jobmanager.rpc.address' instead of proper key 'rest.address'
2018-07-13 09:50:18,701 INFO org.apache.flink.runtime.blob.BlobServer - Created BLOB server storage directory /tmp/blobStore-39ee84ff-0dd9-4f10-a766-7f919c51cb43
2018-07-13 09:50:19,322 INFO org.apache.flink.runtime.blob.BlobServer - Enabling ssl for the blob server
2018-07-13 09:50:19,323 INFO org.apache.flink.runtime.blob.BlobServer - Started BLOB server at 0.0.0.0:35353 - max concurrent requests: 50 - max backlog: 1000
2018-07-13 09:50:19,385 INFO org.apache.flink.runtime.metrics.MetricRegistryImpl - No metrics reporter configured, no metrics will be exposed/reported.
2018-07-13 09:50:19,396 INFO org.apache.flink.runtime.dispatcher.FileArchivedExecutionGraphStore - Initializing FileArchivedExecutionGraphStore: Storage directory /tmp/executionGraphStore-3c7e38b7-1501-42c8-b629-408e71e163ee, expiration time 3600000, maximum cache size 52428800 bytes.
2018-07-13 09:50:19,469 INFO org.apache.flink.runtime.blob.TransientBlobCache - Created BLOB cache storage directory /tmp/blobStore-2e2141d9-5420-4be6-8bf3-4a9acd828533
2018-07-13 09:50:19,485 WARN org.apache.flink.configuration.Configuration - Config uses deprecated configuration key 'jobmanager.rpc.address' instead of proper key 'rest.address'
2018-07-13 09:50:19,517 WARN org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Upload directory /tmp/flink-web-50e25b1a-4df1-4e9c-8dae-020836570535/flink-web-upload does not exist, or has been deleted externally. Previously uploaded files are no longer available.
2018-07-13 09:50:19,518 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Created directory /tmp/flink-web-50e25b1a-4df1-4e9c-8dae-020836570535/flink-web-upload for file uploads.
2018-07-13 09:50:19,525 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Starting rest endpoint.
2018-07-13 09:50:20,470 INFO org.apache.flink.runtime.webmonitor.WebMonitorUtils - Determined location of main cluster component log file: /home/nico/Downloads/flink-1.5.1/log/flink-nico-standalonesession-57-nico-work.fritz.box.log
2018-07-13 09:50:20,475 INFO org.apache.flink.runtime.webmonitor.WebMonitorUtils - Determined location of main cluster component stdout file: /home/nico/Downloads/flink-1.5.1/log/flink-nico-standalonesession-57-nico-work.fritz.box.out
2018-07-13 09:50:20,785 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Rest endpoint listening at localhost:8081
2018-07-13 09:50:20,785 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - https://localhost:8081 was granted leadership with leaderSessionID=00000000-0000-0000-0000-000000000000
2018-07-13 09:50:20,785 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Web frontend listening at https://localhost:8081.
2018-07-13 09:50:20,821 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at akka://flink/user/resourcemanager .
2018-07-13 09:50:21,138 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at akka://flink/user/dispatcher .
2018-07-13 09:50:21,178 INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - ResourceManager akka.ssl.tcp://flink@localhost:6123/user/resourcemanager was granted leadership with fencing token 00000000000000000000000000000000
2018-07-13 09:50:21,179 INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Starting the SlotManager.
2018-07-13 09:50:21,219 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Dispatcher akka.ssl.tcp://flink@localhost:6123/user/dispatcher was granted leadership with fencing token 00000000-0000-0000-0000-000000000000
2018-07-13 09:50:21,219 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Recovering all persisted jobs.
2018-07-13 09:50:21,538 WARN org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Unhandled exception
org.apache.flink.shaded.netty4.io.netty.handler.ssl.NotSslRecordException: not an SSL/TLS record: 474554202f6a6f62732f6f7665727669657720485454502f312e310d0a486f73743a206c6f63616c686f73743a383038310d0a557365722d4167656e743a204d6f7a696c6c612f352e3020285831313b204c696e7578207838365f36343b2072763a36312e3029204765636b6f2f32303130303130312046697265666f782f36312e300d0a4163636570743a206170706c69636174696f6e2f6a736f6e2c20746578742f706c61696e2c202a2f2a0d0a4163636570742d4c616e67756167653a20656e2d47422c656e3b713d302e350d0a4163636570742d456e636f64696e673a20677a69702c206465666c6174650d0a526566657265723a20687474703a2f2f6c6f63616c686f73743a383038312f0d0a444e543a20310d0a436f6e6e656374696f6e3a206b6565702d616c6976650d0a0d0a
at org.apache.flink.shaded.netty4.io.netty.handler.ssl.SslHandler.decode(SslHandler.java:940)
at org.apache.flink.shaded.netty4.io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:315)
at org.apache.flink.shaded.netty4.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:229)
at org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:339)
at org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:324)
at org.apache.flink.shaded.netty4.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:847)
at org.apache.flink.shaded.netty4.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:131)
at org.apache.flink.shaded.netty4.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:511)
at org.apache.flink.shaded.netty4.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
at org.apache.flink.shaded.netty4.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382)
at org.apache.flink.shaded.netty4.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354)
at org.apache.flink.shaded.netty4.io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
at org.apache.flink.shaded.netty4.io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:748)
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)