You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by "Miklos Gergely (JIRA)" <ji...@apache.org> on 2019/03/26 22:45:00 UTC

[jira] [Created] (HIVE-21516) Fix spark downloading for q tests

Miklos Gergely created HIVE-21516:
-------------------------------------

             Summary: Fix spark downloading for q tests
                 Key: HIVE-21516
                 URL: https://issues.apache.org/jira/browse/HIVE-21516
             Project: Hive
          Issue Type: Bug
          Components: Hive
    Affects Versions: 3.1.1
            Reporter: Miklos Gergely
            Assignee: Miklos Gergely
             Fix For: 4.0.0


Currently itests/pom.xml declares a command to generated the download script for spark, thus it is re-generated every time any maven command is executed for any sub project of itests. AS a side effect it is leaving download.sh files everywhere. The download.sh file is almost totally static, no need to recreate it every time, just requires $spark.version as a parameter.

Also it is only working properly under linux, as it relies on the md5sum program which is not present in OS X. This means that if the spark tarball is partially downloaded on OS X, then it would never be re-downloaded. This should be fixed by making it work as well using md5 on OS X.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)