You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "tanjialiang (Jira)" <ji...@apache.org> on 2022/07/28 07:57:00 UTC
[jira] [Updated] (FLINK-28728) Support to set the end offset for streaming connector
[ https://issues.apache.org/jira/browse/FLINK-28728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
tanjialiang updated FLINK-28728:
--------------------------------
Description: Like MQ or CDC connector, it support set the startup mode for reading, but not support set the end offset/position. When the MQ's or CDC's data is not frequently, consume their data in period can cut lots of kubernetes/YARN resource, such as startup from earliest, and end to the current offset, save current offset in savepoint, and using the savepoint to startup in the next period time, in a loop. (was: Like MQ or CDC connector, it support set the startup mode for reading, but not support set the end offset/position. When the MQ's or CDC's data is not frequently, consume their data in period can cut lots of kubernetes/YARN resource, such as startup from earliest, and end to the current offset, save current offset in savepoint, and using the savepoint to startup in the next period time, in a loop.)
> Support to set the end offset for streaming connector
> -----------------------------------------------------
>
> Key: FLINK-28728
> URL: https://issues.apache.org/jira/browse/FLINK-28728
> Project: Flink
> Issue Type: Improvement
> Reporter: tanjialiang
> Priority: Major
>
> Like MQ or CDC connector, it support set the startup mode for reading, but not support set the end offset/position. When the MQ's or CDC's data is not frequently, consume their data in period can cut lots of kubernetes/YARN resource, such as startup from earliest, and end to the current offset, save current offset in savepoint, and using the savepoint to startup in the next period time, in a loop.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)