[jira] [Commented] (SPARK-9261) StreamingTab calls public APIs in Spark core that expose shaded classes

["Apache Spark (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-9261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14637677#comment-14637677 ] 

Apache Spark commented on SPARK-9261:
-------------------------------------

User 'vanzin' has created a pull request for this issue:
https://github.com/apache/spark/pull/7601

> StreamingTab calls public APIs in Spark core that expose shaded classes
> -----------------------------------------------------------------------
>
>                 Key: SPARK-9261
>                 URL: https://issues.apache.org/jira/browse/SPARK-9261
>             Project: Spark
>          Issue Type: Bug
>          Components: Streaming
>    Affects Versions: 1.5.0
>            Reporter: Marcelo Vanzin
>            Priority: Minor
>
> There's a minor issue in {{StreamingTab}} that has hit me a couple of times when building with maven.
> It calls methods in {{JettyUtils}} and {{WebUI}} that expose Jetty types (namely {{ServletContextHandler}}). Since Jetty is now shaded, it's not safe to do that, since when running unit tests the spark-core jar will have the shaded version of the APIs while the streaming classes haven't been shaded yet.
> This seems, at the lowest level, to be a bug in scalac (I've run into this issue in other modules before), since the code shouldn't compile at all, but we should avoid that kind of thing in the first place.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org