You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Michael Baker (Jira)" <ji...@apache.org> on 2023/10/04 17:06:00 UTC
[jira] [Commented] (SPARK-45391) spark-connect-repl is not working on macOS
[ https://issues.apache.org/jira/browse/SPARK-45391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17771928#comment-17771928 ]
Michael Baker commented on SPARK-45391:
---------------------------------------
I'm getting this same error after installing spark-connect-repl in an arm64 ubuntu:focal Docker container.
> spark-connect-repl is not working on macOS
> ------------------------------------------
>
> Key: SPARK-45391
> URL: https://issues.apache.org/jira/browse/SPARK-45391
> Project: Spark
> Issue Type: Bug
> Components: Connect Contrib
> Affects Versions: 3.5.0
> Environment: MacBook M2
> cs version
> 2.1.7
> scala -version
> Scala code runner version 2.12.18 -- Copyright 2002-2023, LAMP/EPFL and Lightbend, Inc.
> Reporter: Vu Tan
> Priority: Major
>
> I followed [https://spark.apache.org/docs/latest/spark-connect-overview.html#use-spark-connect-for-interactive-analysis] to try spark-connect-repl on my local PC but got the following error:
>
> ---------------------------
> spark-connect-repl
> Exception in thread "main" java.lang.NoClassDefFoundError: org/sparkproject/connect/client/com/google/common/io/BaseEncoding
> at org.sparkproject.connect.client.io.grpc.Metadata.<clinit>(Metadata.java:114)
> at org.apache.spark.sql.connect.client.SparkConnectClient$.<init>(SparkConnectClient.scala:329)
> at org.apache.spark.sql.connect.client.SparkConnectClient$.<clinit>(SparkConnectClient.scala)
> at org.apache.spark.sql.application.ConnectRepl$.doMain(ConnectRepl.scala:61)
> at org.apache.spark.sql.application.ConnectRepl$.main(ConnectRepl.scala:50)
> at org.apache.spark.sql.application.ConnectRepl.main(ConnectRepl.scala)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at coursier.bootstrap.launcher.a.a(Unknown Source)
> at coursier.bootstrap.launcher.Launcher.main(Unknown Source)
> Caused by: java.lang.ClassNotFoundException: org.sparkproject.connect.client.com.google.common.io.BaseEncoding
> at java.net.URLClassLoader.findClass(URLClassLoader.java:387)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
> ... 12 more
> ---------------------------
>
> Do you have any idea why this is happening and how to solve it?
> Thank you.
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org