You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "Narayanan Arunachalam (JIRA)" <ji...@apache.org> on 2018/04/04 17:55:00 UTC

[jira] [Created] (FLINK-9138) Enhance BucketingSink to also flush data by time interval

Narayanan Arunachalam created FLINK-9138:
--------------------------------------------

             Summary: Enhance BucketingSink to also flush data by time interval
                 Key: FLINK-9138
                 URL: https://issues.apache.org/jira/browse/FLINK-9138
             Project: Flink
          Issue Type: Improvement
          Components: filesystem-connector
    Affects Versions: 1.4.2
            Reporter: Narayanan Arunachalam


BucketingSink now supports flushing data to the file system by size limit and by period of inactivity. It will be useful to also flush data by a specified time period. This way, the data will be written out when write throughput is low but there is no significant time period gaps between the writes. This reduces ETA for the data in the file system and should help move the checkpoints faster as well.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)