You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Yang Jie (Jira)" <ji...@apache.org> on 2022/10/14 03:15:00 UTC

[jira] [Created] (SPARK-40795) Exclude redundant jars from spark-protobuf-assembly jar

Yang Jie created SPARK-40795:
--------------------------------

             Summary: Exclude redundant jars from spark-protobuf-assembly jar
                 Key: SPARK-40795
                 URL: https://issues.apache.org/jira/browse/SPARK-40795
             Project: Spark
          Issue Type: Improvement
          Components: Build
    Affects Versions: 3.4.0
            Reporter: Yang Jie


spark-protobuf-assembly jar produced by sbt currently includes the following jars:

 
{code:java}
[debug] Including from cache: spark-tags_2.12-3.4.0-SNAPSHOT.jar
[debug] Including from cache: unused-1.0.0.jar
[debug] Including from cache: spark-protobuf_2.12-3.4.0-SNAPSHOT.jar
[debug] Including from cache: scala-collection-compat_2.12-2.2.0.jar
[debug] Including from cache: pmml-model-1.4.8.jar
[debug] Including from cache: protobuf-java-3.21.1.jar
[debug] Including from cache: guava-14.0.1.jar
[debug] Including from cache: scala-library-2.12.17.jar {code}
The actual needs only includes:
{code:java}
[debug] Including: spark-protobuf_2.12-3.4.0-SNAPSHOT.jar
[debug] Including from cache: protobuf-java-3.21.1.jar {code}
 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org