You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/06/02 13:25:00 UTC

[jira] [Updated] (HIVE-27402) Refactor Kafka credential handling into kafka-handler module

     [ https://issues.apache.org/jira/browse/HIVE-27402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

ASF GitHub Bot updated HIVE-27402:
----------------------------------
    Labels: pull-request-available  (was: )

> Refactor Kafka credential handling into kafka-handler module
> ------------------------------------------------------------
>
>                 Key: HIVE-27402
>                 URL: https://issues.apache.org/jira/browse/HIVE-27402
>             Project: Hive
>          Issue Type: Improvement
>          Components: HiveServer2, kafka integration
>            Reporter: Stamatis Zampetakis
>            Assignee: Stamatis Zampetakis
>            Priority: Major
>              Labels: pull-request-available
>
> Currently the code for handling credentials and authentication for the Kafka storage handler is spread across hive-exec (https://github.com/apache/hive/blob/7cd3107a76d633ef5fae2ffb8ec16953ac968092/ql/src/java/org/apache/hadoop/hive/ql/exec/tez/DagUtils.java#L302) and kafka-handler (https://github.com/apache/hive/blob/7cd3107a76d633ef5fae2ffb8ec16953ac968092/kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaUtils.java#L71) modules. This leads to unexpected dependencies to kafka (e.g., kafka-client) in hive-exec module and limits sharing opportunities of credential utilities present in KafkaUtil class.
>     
> The goal of this refactoring is threefold:
> * centralize Kafka credential handling (in one module) opening the road to more code reuse and better encapsulation;
> * remove kafka dependencies (e.g., kafka-client) from hive-exec module;
> * facilitate unit testing and product stability.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)