[jira] [Comment Edited] (HIVE-12984) spark tgz-s need to be deleted on mvn clean, as are other binary artifacts in the tree

["Sergey Shelukhin (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-12984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140213#comment-15140213 ] 

Sergey Shelukhin edited comment on HIVE-12984 at 2/10/16 2:15 AM:
------------------------------------------------------------------

They actually get pulled into deployed artifacts on mvn deploy, I don't think out packaging filters can affect that. I am cutting the 4th RC now and it's kind of tiresome to delete them every time (after forgetting and noticing the source zip is 300Mb). 
Why do spark tests need to depend on the package instead of just individual jars? MiniTez and MiniMr (and MiniHdfs and MiniHBase and MiniAccumulo) all run fine with just jars. Otherwise, is it possible to file a spark JIRA to have a distribution without Hive if there's no way around it?


was (Author: sershe):
They actually get pulled into deployed artifacts on mvn deploy, I don't think out packaging filters can affect that. I am cutting the 4th RC now and it's kind of tiresome to delete them every time. 
Why do spark tests need to depend on the package instead of just individual jars? MiniTez and MiniMr (and MiniHdfs and MiniHBase and MiniAccumulo) all run fine with just jars. Otherwise, is it possible to file a spark JIRA to have a distribution without Hive if there's no way around it?

> spark tgz-s need to be deleted on mvn clean, as are other binary artifacts in the tree
> --------------------------------------------------------------------------------------
>
>                 Key: HIVE-12984
>                 URL: https://issues.apache.org/jira/browse/HIVE-12984
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Sergey Shelukhin
>            Assignee: Sergey Shelukhin
>         Attachments: HIVE-12984.patch
>
>
> Currently, tgz files are downloaded and kept around forever. I noticed when packaging the release (apparently the excludes in packaging files also didn't work) that the initial src tar.gz was huge; regardless of that, I had 6 version of spark (1.2 thru 1.6 with one dot version) sitting there, and also in every clone of Hive that I have.
> These should be switched to use normal means of artifact distribution (I think I already filed a jira but I cannot find it now); meanwhile making sure that mvn clean would remove them.
> I realize it could create some pain when running tests repeatedly on dev machine unless "clean" is omitted from rebuilds; that is somewhat intentional - it should be a good incentive to switch to maven for dependency management instead of a bash script ;)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)