You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Robert Metzger (Jira)" <ji...@apache.org> on 2020/07/03 12:00:08 UTC
[jira] [Commented] (FLINK-18013) Refactor Hadoop Utility
classes/functions into a common Maven module
[ https://issues.apache.org/jira/browse/FLINK-18013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17150958#comment-17150958 ]
Robert Metzger commented on FLINK-18013:
----------------------------------------
[~zenfenan] FYI: I'm on vacation for 2 weeks, so I won't be able to review much in the meantime. Still, if you are stuck, feel free to ping me.
> Refactor Hadoop Utility classes/functions into a common Maven module
> --------------------------------------------------------------------
>
> Key: FLINK-18013
> URL: https://issues.apache.org/jira/browse/FLINK-18013
> Project: Flink
> Issue Type: Improvement
> Components: Connectors / Common
> Reporter: Sivaprasanna Sethuraman
> Assignee: Sivaprasanna Sethuraman
> Priority: Major
>
> We have multiple modules which use Hadoop in one way another. This has caused a significant redundancy in utility classes and functions related to Hadoop. One such example which is also the motivation behind this Jira is the functionality to (de)serializing Hadoop Configuration. This functionality has multiple implementations across multiple modules (flink-hadoop-fs, flink-orc, flink-sequence-file, etc) with more or less the same code.
> The aim of this Jira is to introduce a new module, say flink-hadoop-utils, that only contains the Hadoop related utility classes & functions with proper test cases in a single shareable module and get rid of the redundancy by adding this module as the dependency.
> Relevant [DISCUSS] thread can be found at [https://lists.apache.org/thread.html/rf885987160bede5911a7f61923307a6d5ae07f850da0a90555728e5f%40%3Cdev.flink.apache.org%3E]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)