You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Bowen Li (JIRA)" <ji...@apache.org> on 2019/07/05 00:30:00 UTC
[jira] [Updated] (FLINK-12934) add hadoop dependencies as
'flink-shaded-hadoop-2-uber' for flink-connector-hive to connect to remote
hive metastore service
[ https://issues.apache.org/jira/browse/FLINK-12934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Bowen Li updated FLINK-12934:
-----------------------------
Description: Now, for all hadoop related dependencies, we just use the single jar of flink-shaded-hadoop-2-uber, instead of depending on individual hadoop jars. It's much more convenient for users to use now. (was: we've been testing flink-connector-hive to connect to built-in hive metastore. Connecting to standalone hive metastore requires additional dependencies:
{code:java}
commons-configuration-1.6.jar
commons-logging-1.2.jar
servlet-api-2.5.jar
hadoop-auth-2.7.2.jar
{code}
All dependencies needed to make flink-connector-hive able to connect to hive metastore for HiveCatalog include:
{code:java}
commons-configuration-1.6.jar hadoop-common-2.7.2.jar
commons-logging-1.2.jar hadoop-mapreduce-client-core-2.7.2.jar
flink-connector-hive_2.11-1.9-SNAPSHOT.jar hive-exec-2.3.4.jar
flink-dist_2.11-1.9-SNAPSHOT.jar hive-metastore-2.3.4.jar
flink-hadoop-compatibility_2.11-1.9-SNAPSHOT.jar log4j-1.2.17.jar
flink-sql-client_2.11-1.9-SNAPSHOT.jar servlet-api-2.5.jar
flink-table_2.11-1.9-SNAPSHOT.jar slf4j-log4j12-1.7.15.jar
hadoop-auth-2.7.2.jar
{code}
)
> add hadoop dependencies as 'flink-shaded-hadoop-2-uber' for flink-connector-hive to connect to remote hive metastore service
> ----------------------------------------------------------------------------------------------------------------------------
>
> Key: FLINK-12934
> URL: https://issues.apache.org/jira/browse/FLINK-12934
> Project: Flink
> Issue Type: Sub-task
> Components: Connectors / Hive
> Reporter: Bowen Li
> Assignee: Bowen Li
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.9.0
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Now, for all hadoop related dependencies, we just use the single jar of flink-shaded-hadoop-2-uber, instead of depending on individual hadoop jars. It's much more convenient for users to use now.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)