You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Jingsong Lee (Jira)" <ji...@apache.org> on 2020/10/19 08:03:00 UTC
[jira] [Commented] (FLINK-19706) Introduce `Repeated Partition
Commit Check` in `org.apache.flink.table.filesystem.PartitionCommitPolicy`
[ https://issues.apache.org/jira/browse/FLINK-19706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17216519#comment-17216519 ]
Jingsong Lee commented on FLINK-19706:
--------------------------------------
Hi [~neighborhood], thanks for your proposal, can you explain more about "Checking Repeated Partition Commit"?
> Introduce `Repeated Partition Commit Check` in `org.apache.flink.table.filesystem.PartitionCommitPolicy`
> ---------------------------------------------------------------------------------------------------------
>
> Key: FLINK-19706
> URL: https://issues.apache.org/jira/browse/FLINK-19706
> Project: Flink
> Issue Type: Improvement
> Components: Connectors / FileSystem, Connectors / Hive, Table SQL / Runtime
> Reporter: Lsw_aka_laplace
> Priority: Minor
>
> Hi all,
> Recently we have been devoted to using Hive Streaming Writing to accelerate our data-sync of Data Warehouse based on Hive, and eventually we made it.
> For producing purpose, a lot of metrics/logs/measures were added in order to help us analyze running info or fix some unexpected problems. Among these mentioned above, we found that Checking Repeated Partition Commit is the most important one. So here, we are willing to make a contribution of introducing this backwards to Community.
> If this proposal is meaning, I am happy to introduce my design and implementation.
>
> Looking forward to ANY opinion~
--
This message was sent by Atlassian Jira
(v8.3.4#803005)