[jira] [Commented] (SPARK-3962) Mark spark dependency as "provided" in external libraries

["Patrick Wendell (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-3962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14214480#comment-14214480 ] 

Patrick Wendell commented on SPARK-3962:
----------------------------------------

I think this is causing the build to fail because of this bug:
https://jira.codehaus.org/browse/MSHADE-148

Would it be possible to remove the test-jar dependency on streaming for these modules (/cc @tdas)? If we need to have a moderate amount of code duplication I think it's fine because as it stands now these aren't really usable for people. I looked and I only found some minor dependencies that could be inlined into the modules.

> Mark spark dependency as "provided" in external libraries
> ---------------------------------------------------------
>
>                 Key: SPARK-3962
>                 URL: https://issues.apache.org/jira/browse/SPARK-3962
>             Project: Spark
>          Issue Type: Bug
>          Components: Streaming
>            Reporter: Patrick Wendell
>            Assignee: Prashant Sharma
>            Priority: Blocker
>
> Right now there is not an easy way for users to link against the external streaming libraries and not accidentally pull Spark into their assembly jar. We should mark Spark as "provided" in the external connector pom's so that user applications can simply include those like any other dependency in the user's jar.
> This is also the best format for third-party libraries that depend on Spark (of which there will eventually be many) so it would be nice for our own build to conform to this nicely.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org