Re: [Bug]

[Alexey Romanenko <ar...@gmail.com>]

*** I move it to user@beam.apache.org since it’s rather user-related question ***


Hello Liu,

Could you check which versions of Jackson you have in your Spark class path while running a job?

—
Alexey 

> On 8 Apr 2022, at 07:01, Liu Jie <ji...@gmail.com> wrote:
> 
> Dear Sir/Madam，
> 
> I followed the official documentation to download the WordCount example (https://beam.apache.org/get-started/quickstart-java/ <https://beam.apache.org/get-started/quickstart-java/>), used Maven to build the project, deployed spark-2.4.8-bin-hadoop2.7 locally, and followed the official Spark Runner configuration (https://beam.apache.org/documentation/runners/spark/ <https://beam.apache.org/documentation/runners/spark/>), the error was reported.
> 
> Exception in thread "main" java.lang.NoSuchMethodError: com.fasterxml.jackson.databind.type.TypeBindings.emptyBindings()Lcom/fasterxml/jackson/databind/type/TypeBindings;
>         at org.apache.beam.sdk.options.PipelineOptionsFactory.createBeanProperty(PipelineOptionsFactory.java:1706)
> 
> 
> The Spark commit cluster command is：
> ./bin/spark-submit \
>   --class org.apache.beam.examples.WordCount \
>   --master spark://yuanshu-2288H-V5:7077 \
>   /share/apache_beam_code/word-count-beam/target/word-count-beam-bundled-0.1.jar \
> --runner=SparkRunner \
> --inputFile=/share/k_means_data_python/10000_point_4_center_2_feature.txt \
> --output=/share/apache_beam_code/word-count-beam/src/main/java/BeamKmeans/4core6G1worker/output
> 
> The pom.xml file and full error output in Maven are in the attachment.
> 
> I created the question on StackOverflow:
> https://stackoverflow.com/questions/71791853/apache-beam-2-37-0-sparkrunner-program-executing-in-spark-2-4-8-standalone-clust <https://stackoverflow.com/questions/71791853/apache-beam-2-37-0-sparkrunner-program-executing-in-spark-2-4-8-standalone-clust>
> 
> Looking forward to your reply
>  
> -- 
> Kind regards,
> Jie Liu
> ----------------
> Mr. Jie Liu
> Computer School, University of South China, Hengyang 421001
> E-Mail: jieliu5326@gmail.com <ma...@mdpi.com>
> <spark_2.4.8_standalone_apache_beam_2.37.0_SparkRunner_error.txt><apache_beam_2.37.0_maven_example_pom.txt>