You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2015/07/07 01:24:05 UTC

[jira] [Created] (SPARK-8852) spark-streaming-flume-assembly packages too many dependencies

Marcelo Vanzin created SPARK-8852:
-------------------------------------

             Summary: spark-streaming-flume-assembly packages too many dependencies
                 Key: SPARK-8852
                 URL: https://issues.apache.org/jira/browse/SPARK-8852
             Project: Spark
          Issue Type: Bug
          Components: Streaming
    Affects Versions: 1.5.0
            Reporter: Marcelo Vanzin


This assembly was recently added to make it easier to start pyspark jobs that use the flume backend; but it packages way too many dependencies, several of which are already packaged in the main Spark assembly, making the final file unnecessarily large.

We should clean up the dependency tree for that module and only package what's really needed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org