You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "ziqiang.wang (Jira)" <ji...@apache.org> on 2022/01/13 08:27:00 UTC
[jira] [Comment Edited] (FLINK-25562) hive sql connector 依赖冲突
[ https://issues.apache.org/jira/browse/FLINK-25562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17475168#comment-17475168 ]
ziqiang.wang edited comment on FLINK-25562 at 1/13/22, 8:26 AM:
----------------------------------------------------------------
!image-2022-01-13-16-08-20-176.png!
Copy this module, and rename to flink-sql-connector-hive-1.1.0
Then modify the pom file:
# hive-exec dependency version 1.2.2 to 1.1.0
# hive-metastore dependency version 1.2.2 to 1.1.0
Next, pacakge the new module, and put the jar file to [https://nightlies.apache.org/flink/flink-docs-release-1.13/docs/connectors/table/hive/overview/] page.
Other:
# not only for flink 1.13, other version of flink may need this opearion too.
# If you can provided the final jar with scala 2.11 and 2.12, it's more useful for programer, may be.
The different of hive 1.1.0 and hive 1.2.2:
* 1.1.0: !image-2022-01-13-16-18-14-830.png!
* 1.2.2:
!image-2022-01-13-16-21-09-495.png!
was (Author: JIRAUSER283195):
!image-2022-01-13-16-08-20-176.png!
Copy this module, and rename to flink-sql-connector-hive-1.1.0
Then modify the pom file:
# hive-exec dependency version 1.2.2 to 1.1.0
# hive-metastore dependency version 1.2.2 to 1.1.0
Next, pacakge the new module, and put the jar file to [https://nightlies.apache.org/flink/flink-docs-release-1.13/docs/connectors/table/hive/overview/] page.
Other: not only for flink 1.13, other version of flink may need this opearion too.
The different of hive 1.1.0 and hive 1.2.2:
* 1.1.0: !image-2022-01-13-16-18-14-830.png!
* 1.2.2:
!image-2022-01-13-16-21-09-495.png!
> hive sql connector 依赖冲突
> -----------------------
>
> Key: FLINK-25562
> URL: https://issues.apache.org/jira/browse/FLINK-25562
> Project: Flink
> Issue Type: Improvement
> Components: Connectors / Hive
> Affects Versions: 1.13.3
> Environment: CDH：5.15.0
> hadoop：2.6.0
> hive：1.1.0
> flink：1.3.3
> Reporter: ziqiang.wang
> Priority: Minor
> Labels: easyfix
> Fix For: 1.13.3
>
> Attachments: image-2022-01-07-14-54-37-874.png, image-2022-01-13-16-08-20-176.png, image-2022-01-13-16-18-14-830.png, image-2022-01-13-16-21-09-495.png
>
> Original Estimate: 12h
> Remaining Estimate: 12h
>
> [https://repo.maven.apache.org/maven2/org/apache/flink/flink-sql-connector-hive-1.2.2_2.11/1.13.5/flink-sql-connector-hive-1.2.2_2.11-1.13.5.jar]
> Flink jar flink-sql-connector-hive-1.2.2_2.11.jar are not compatible with Hive 1.1.0.
> I cloned the source code of Flink, and then modified the version of Hive to 1.1.0 in the POM file of Hive-sql-connector. Then I repackaged Flink-SQL-connector-Hive, and put it online, so there was no version conflict problem.
> Version conflicts mainly occur in the Hive-exe.jar package.
> For conflicts details, see the following figure.
> !image-2022-01-07-14-54-37-874.png!
> I hope the official website can provided other packaged jar for hive 1.1.x。
--
This message was sent by Atlassian Jira
(v8.20.1#820001)