You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Kyle Weaver (Jira)" <ji...@apache.org> on 2022/01/05 19:31:00 UTC

[jira] [Updated] (BEAM-13569) Python postcommit failing portableWordCountSparkRunnerBatch

     [ https://issues.apache.org/jira/browse/BEAM-13569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kyle Weaver updated BEAM-13569:
-------------------------------
    Fix Version/s: 2.37.0
       Resolution: Fixed
           Status: Resolved  (was: Open)

> Python postcommit failing portableWordCountSparkRunnerBatch
> -----------------------------------------------------------
>
>                 Key: BEAM-13569
>                 URL: https://issues.apache.org/jira/browse/BEAM-13569
>             Project: Beam
>          Issue Type: Sub-task
>          Components: runner-spark, test-failures
>            Reporter: Kyle Weaver
>            Assignee: Kyle Weaver
>            Priority: P1
>             Fix For: 2.37.0
>
>          Time Spent: 2h 20m
>  Remaining Estimate: 0h
>
> Guessing this was due to recent changes such as for the gradle upgrade (BEAM-13430).
> Execution failed for task ':sdks:python:test-suites:portable:py37:portableWordCountSparkRunnerBatch'.
> 'Exception in thread "grpc-default-executor-0" java.lang.NoClassDefFoundError: org/apache/spark/streaming/api/java/JavaStreamingListener '
> '\tat org.apache.beam.runners.spark.SparkJobInvoker.createJobInvocation(SparkJobInvoker.java:101)'
> '\tat org.apache.beam.runners.spark.SparkJobInvoker.invokeWithExecutor(SparkJobInvoker.java:82)'
> '\tat org.apache.beam.runners.jobsubmission.JobInvoker.invoke(JobInvoker.java:48)'
> '\tat org.apache.beam.runners.jobsubmission.InMemoryJobService.run(InMemoryJobService.java:246)'
> '\tat org.apache.beam.model.jobmanagement.v1.JobServiceGrpc$MethodHandlers.invoke(JobServiceGrpc.java:948)'
> '\tat org.apache.beam.vendor.grpc.v1p36p0.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCall s.java:182)'
> '\tat org.apache.beam.vendor.grpc.v1p36p0.io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.ja va:35)'
> '\tat org.apache.beam.vendor.grpc.v1p36p0.io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallListener.java:23)'
> '\tat org.apache.beam.vendor.grpc.v1p36p0.io.grpc.ForwardingServerCallListener$SimpleForwardingServerCallListener.onHalfClose(Forwarding ServerCallListener.java:40)'
> '\tat org.apache.beam.vendor.grpc.v1p36p0.io.grpc.Contexts$ContextualizedServerCallListener.onHalfClose(Contexts.java:86)'
> '\tat org.apache.beam.vendor.grpc.v1p36p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:331)'
> '\tat org.apache.beam.vendor.grpc.v1p36p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInConte xt(ServerImpl.java:797)'
> '\tat org.apache.beam.vendor.grpc.v1p36p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)'
> '\tat org.apache.beam.vendor.grpc.v1p36p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)'
> '\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)'
> '\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)'
> '\tat java.lang.Thread.run(Thread.java:748)'
> 'Caused by: java.lang.ClassNotFoundException: org.apache.spark.streaming.api.java.JavaStreamingListener'
> '\tat java.net.URLClassLoader.findClass(URLClassLoader.java:382)'



--
This message was sent by Atlassian Jira
(v8.20.1#820001)