You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Patrick Wendell (JIRA)" <ji...@apache.org> on 2014/04/07 02:52:14 UTC

[jira] [Resolved] (SPARK-1314) sbt assembly builds hive jar

     [ https://issues.apache.org/jira/browse/SPARK-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Patrick Wendell resolved SPARK-1314.
------------------------------------

    Resolution: Fixed

> sbt assembly builds hive jar
> ----------------------------
>
>                 Key: SPARK-1314
>                 URL: https://issues.apache.org/jira/browse/SPARK-1314
>             Project: Spark
>          Issue Type: Bug
>          Components: Build, SQL
>    Affects Versions: 1.0.0
>            Reporter: Aaron Davidson
>            Assignee: Aaron Davidson
>             Fix For: 1.0.0
>
>
> Running "sbt/sbt assembly" will create a spark-hive-assembly jar which causes all subsequent operations using spark-class to use the Hive jar instead of the Spark one. For people who use this workflow, this negates most of the use of extracting out Hive to its own assembly.
> One way to get around this would be to create an environment variable which controls whether or not we include the Hive dependencies into the normal spark assembly jar. This would be in line with the behavior of similarly "optional" components such as Yarn and Ganglia.



--
This message was sent by Atlassian JIRA
(v6.2#6252)