You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/04 21:02:01 UTC
[GitHub] [beam] damccorm opened a new issue, #21070: Flink (1.12) Beam (2.30) word count example missing a dependency for the uber jar
damccorm opened a new issue, #21070:
URL: https://github.com/apache/beam/issues/21070
https://beam.apache.org/documentation/runners/flink/#flink-version-compatibility
The word count example generated by the `mvn archetype` command is missing a dependency to run successfully with Flink.
```
<!-- https://mvnrepository.com/artifact/com.fasterxml.jackson.module/jackson-module-jaxb-annotations
-->
<dependency>
<groupId>com.fasterxml.jackson.module</groupId>
<artifactId>jackson-module-jaxb-annotations</artifactId>
<version>2.12.4</version>
</dependency>
```
This won't become apparent until one tries to run the packaged uber jar in a Flink cluster (1.12 in my case) and gets the following error:
```
tianzi@tz-yarn-m:~$ flink run -c org.apache.beam.examples.WordCount word-count-beam-bundled-0.1.jar
--runner=FlinkRunner
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/lib/flink/lib/log4j-slf4j-impl-2.12.1.jar!/org/slf4j/impl/StaticL
oggerBinder.class]
SLF4J:
Found binding in [jar:file:/usr/lib/hadoop/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLog
gerBinder.class]
SLF4J:
See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is
of type [org.apache.logging.slf4j.Log4jLoggerFactory]
2021-07-09 16:45:28,061 INFO org.apache.flink.yarn.cli.FlinkYarnSessionCli
[] - Found Ya
rn properties file under /tmp/.yarn-properties-tianzi.
2021-07-09 16:45:28,061
INFO org.apache.flink.yarn.cli.FlinkYarnSessionCli [] - Found Ya
rn properties file
under /tmp/.yarn-properties-tianzi.
java.util.ServiceConfigurationError: com.fasterxml.jackson.databind.Module:
Provider com.fasterxml.jacks
on.module.jaxb.JaxbAnnotationModule not a subtype
at java.util.ServiceLoader.fail(ServiceLoader.java:239)
at java.util.ServiceLoader.access$300(ServiceLoader.java:185)
at java.util.ServiceLoader$LazyIterator.nextService(ServiceLoader.java:376)
at java.util.ServiceLoader$LazyIterator.next(ServiceLoader.java:404)
at java.util.ServiceLoader$1.next(ServiceLoader.java:480)
at com.fasterxml.jackson.databind.ObjectMapper.findModules(ObjectMapper.java:1081)
at
org.apache.beam.sdk.options.PipelineOptionsFactory.<clinit>(PipelineOptionsFactory.java:478)
at org.apache.beam.examples.WordCount.main(WordCount.java:196)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:349)
at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedPro
gram.java:219)
at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114)
at org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:812)
at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:246)
at org.apache.flink.client.cli.CliFrontend.parseAndRun(CliFrontend.java:1054)
at org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:1132)
at
java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1762)
at org.apache.flink.runtime.security.contexts.HadoopSecurityContext.runSecured(HadoopSecurityCon
text.java:41)
at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1132)
```
Imported from Jira [BEAM-12595](https://issues.apache.org/jira/browse/BEAM-12595). Original Jira may contain additional context.
Reported by: tianzi.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org