You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/03/05 03:38:00 UTC
[jira] [Commented] (HIVE-16391) Publish proper Hive 1.2 jars
(without including all dependencies in uber jar)
[ https://issues.apache.org/jira/browse/HIVE-16391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16385539#comment-16385539 ]
Saisai Shao commented on HIVE-16391:
------------------------------------
Hi all,
Do we have any progress on it? Spark currently uses forked Hive 1.2.1.spark2, which rejects the Hadoop version 3.0 support (SPARK-18673). We can patch forked Hive 1.2.1.spark2 to support Hadoop 3, but seems a proper solution is to maintain this in Hive as discussed (SPARK-20202) and make it fix in the Hive community.
> Publish proper Hive 1.2 jars (without including all dependencies in uber jar)
> -----------------------------------------------------------------------------
>
> Key: HIVE-16391
> URL: https://issues.apache.org/jira/browse/HIVE-16391
> Project: Hive
> Issue Type: Task
> Components: Build Infrastructure
> Reporter: Reynold Xin
> Priority: Major
>
> Apache Spark currently depends on a forked version of Apache Hive. AFAIK, the only change in the fork is to work around the issue that Hive publishes only two sets of jars: one set with no dependency declared, and another with all the dependencies included in the published uber jar. That is to say, Hive doesn't publish a set of jars with the proper dependencies declared.
> There is general consensus on both sides that we should remove the forked Hive.
> The change in the forked version is recorded here https://github.com/JoshRosen/hive/tree/release-1.2.1-spark2
> Note that the fork in the past included other fixes but those have all become unnecessary.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)