You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Yun Gao (Jira)" <ji...@apache.org> on 2022/04/13 06:28:06 UTC

[jira] [Updated] (FLINK-17589) Extend StreamingFileSink to Support Streaming Hive Connector

     [ https://issues.apache.org/jira/browse/FLINK-17589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yun Gao updated FLINK-17589:
----------------------------
    Fix Version/s: 1.16.0

> Extend StreamingFileSink to Support Streaming Hive Connector
> ------------------------------------------------------------
>
>                 Key: FLINK-17589
>                 URL: https://issues.apache.org/jira/browse/FLINK-17589
>             Project: Flink
>          Issue Type: New Feature
>          Components: Connectors / FileSystem
>            Reporter: Yun Gao
>            Priority: Minor
>              Labels: auto-deprioritized-major, auto-unassigned
>             Fix For: 1.15.0, 1.16.0
>
>
> According to the [discussion on FLIP-115 | https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E |https://lists.apache.org/thread.html/rb1795428e481dbeaa1af2dcffed87b4804ed81d2af60256cd50032d7%40%3Cdev.flink.apache.org%3E], we will use StreamingFileSink to support the streaming hive connector. This requires to make some extension to the current StreamingFileSink:
>  #   Support path-based writer to write the specified Hadoop path.
>  #   Provides listeners to collect the bucket state so that the Hive sink could decide when one bucket is terminated and then writing meta-info to Hive.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)