You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Patrick Wendell (JIRA)" <ji...@apache.org> on 2014/10/16 05:21:35 UTC

[jira] [Commented] (SPARK-3951) Make the external-* jars fat jars

    [ https://issues.apache.org/jira/browse/SPARK-3951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14173289#comment-14173289 ] 

Patrick Wendell commented on SPARK-3951:
----------------------------------------

I think the best solution here is actually to mark spark as "provided" in these external library poms. That way users can link against them and build their own assemblies that won't include Spark itself. This is consistent with the way that users in general build Spark applications.

> Make the external-* jars fat jars
> ---------------------------------
>
>                 Key: SPARK-3951
>                 URL: https://issues.apache.org/jira/browse/SPARK-3951
>             Project: Spark
>          Issue Type: Bug
>            Reporter: Hari Shreedharan
>
> I am not sure this is the right solution to the issue of having to pull in the external jars and all of the dependencies and transitive dependencies, but building them as fat jars will definitely solve this, though not in a not so elegant way.
> If we build the fat jar, the user can simply deploy this jar and not  worry about all of the dependencies.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org