You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Sivaprasanna Sethuraman (Jira)" <ji...@apache.org> on 2020/05/28 15:00:00 UTC
[jira] [Commented] (FLINK-18013) Refactor Hadoop Utility
classes/functions into a common Maven module
[ https://issues.apache.org/jira/browse/FLINK-18013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17118781#comment-17118781 ]
Sivaprasanna Sethuraman commented on FLINK-18013:
-------------------------------------------------
[~rmetzger]
FYI.
> Refactor Hadoop Utility classes/functions into a common Maven module
> --------------------------------------------------------------------
>
> Key: FLINK-18013
> URL: https://issues.apache.org/jira/browse/FLINK-18013
> Project: Flink
> Issue Type: Improvement
> Reporter: Sivaprasanna Sethuraman
> Priority: Major
>
> We have multiple modules which use Hadoop in one way another. This has caused a significant redundancy in utility classes and functions related to Hadoop. One such example which is also the motivation behind this Jira is the functionality to (de)serializing Hadoop Configuration. This functionality has multiple implementations across multiple modules (flink-hadoop-fs, flink-orc, flink-sequence-file, etc) with more or less the same code.
> The aim of this Jira is to introduce a new module, say flink-hadoop-utils, that only contains the Hadoop related utility classes & functions with proper test cases in a single shareable module and get rid of the redundancy by adding this module as the dependency.
> Relevant [DISCUSS] thread can be found at [https://lists.apache.org/thread.html/rf885987160bede5911a7f61923307a6d5ae07f850da0a90555728e5f%40%3Cdev.flink.apache.org%3E]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)