[jira] [Created] (SPARK-14711) Examples jar not a part of distribution

["Mark Grover (JIRA)" <ji...@apache.org>]

Mark Grover created SPARK-14711:
-----------------------------------

             Summary: Examples jar not a part of distribution
                 Key: SPARK-14711
                 URL: https://issues.apache.org/jira/browse/SPARK-14711
             Project: Spark
          Issue Type: Bug
          Components: Build
    Affects Versions: 2.0.0
            Reporter: Mark Grover


While mucking around with some examples, it seems like spark-examples jar is not being included in the distribution tarball. Also, it's not in the classpath in the spark-submit classpath, which means commands like {{run-example}} fail to work, whether a "distribution" tarball is used or a regular {{mvn package}} build.

The root cause of this may be due to the fact that the spark-examples jar is under {{$SPARK_HOME/examples/target}} while all its dependencies are at {{$SPARK_HOME/examples/target/scala-2.11/jars}}. And, we only seem to be including the jars directory in the classpath. See [here|https://github.com/apache/spark/blob/master/launcher/src/main/java/org/apache/spark/launcher/SparkSubmitCommandBuilder.java#L354] for details.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org