You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2016/04/19 02:45:25 UTC

[jira] [Resolved] (SPARK-14711) Examples jar not a part of distribution

     [ https://issues.apache.org/jira/browse/SPARK-14711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Marcelo Vanzin resolved SPARK-14711.
------------------------------------
       Resolution: Fixed
         Assignee: Mark Grover
    Fix Version/s: 2.0.0

> Examples jar not a part of distribution
> ---------------------------------------
>
>                 Key: SPARK-14711
>                 URL: https://issues.apache.org/jira/browse/SPARK-14711
>             Project: Spark
>          Issue Type: Bug
>          Components: Build
>    Affects Versions: 2.0.0
>            Reporter: Mark Grover
>            Assignee: Mark Grover
>             Fix For: 2.0.0
>
>
> While mucking around with some examples, it seems like spark-examples jar is not being included in the distribution tarball. Also, it's not in the classpath in the spark-submit classpath, which means commands like {{run-example}} fail to work, whether a "distribution" tarball is used or a regular {{mvn package}} build.
> The root cause of this may be due to the fact that the spark-examples jar is under {{$SPARK_HOME/examples/target}} while all its dependencies are at {{$SPARK_HOME/examples/target/scala-2.11/jars}}. And, we only seem to be including the jars directory in the classpath. See [here|https://github.com/apache/spark/blob/master/launcher/src/main/java/org/apache/spark/launcher/SparkSubmitCommandBuilder.java#L354] for details.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org