You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Bowen Li (JIRA)" <ji...@apache.org> on 2019/07/05 00:30:00 UTC

[jira] [Updated] (FLINK-12934) add hadoop dependencies as 'flink-shaded-hadoop-2-uber' for flink-connector-hive to connect to remote hive metastore service

     [ https://issues.apache.org/jira/browse/FLINK-12934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Bowen Li updated FLINK-12934:
-----------------------------
    Description: Now, for all hadoop related dependencies, we just use the single jar of flink-shaded-hadoop-2-uber, instead of depending on individual hadoop jars. It's much more convenient for users to use now.  (was: we've been testing flink-connector-hive to connect to built-in hive metastore. Connecting to standalone hive metastore requires additional dependencies:


{code:java}
commons-configuration-1.6.jar
commons-logging-1.2.jar
servlet-api-2.5.jar
hadoop-auth-2.7.2.jar
{code}

All dependencies needed to make flink-connector-hive able to connect to hive metastore for HiveCatalog include:

{code:java}
commons-configuration-1.6.jar				hadoop-common-2.7.2.jar
commons-logging-1.2.jar					hadoop-mapreduce-client-core-2.7.2.jar
flink-connector-hive_2.11-1.9-SNAPSHOT.jar		hive-exec-2.3.4.jar
flink-dist_2.11-1.9-SNAPSHOT.jar			hive-metastore-2.3.4.jar
flink-hadoop-compatibility_2.11-1.9-SNAPSHOT.jar	log4j-1.2.17.jar
flink-sql-client_2.11-1.9-SNAPSHOT.jar			servlet-api-2.5.jar
flink-table_2.11-1.9-SNAPSHOT.jar			slf4j-log4j12-1.7.15.jar
hadoop-auth-2.7.2.jar
{code}
)

> add hadoop dependencies as 'flink-shaded-hadoop-2-uber' for flink-connector-hive to connect to remote hive metastore service
> ----------------------------------------------------------------------------------------------------------------------------
>
>                 Key: FLINK-12934
>                 URL: https://issues.apache.org/jira/browse/FLINK-12934
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Connectors / Hive
>            Reporter: Bowen Li
>            Assignee: Bowen Li
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 1.9.0
>
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> Now, for all hadoop related dependencies, we just use the single jar of flink-shaded-hadoop-2-uber, instead of depending on individual hadoop jars. It's much more convenient for users to use now.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)