[jira] [Updated] (FLINK-28853) FLIP-217 Support watermark alignment of source splits

["Piotr Nowojski (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/FLINK-28853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Piotr Nowojski updated FLINK-28853:
-----------------------------------
    Release Note: 
Added support for watermark alignment of source splits. 

Since Flink 1.17, source connectors have to implement watermark alignment of source split in order to use the watermark alignment feature. The required method to implement are: `SourceReader#pauseOrResumeSplits` and `SplitReader#pauseOrResumeSplits`. If you are migrating from Flink <= 1.16.x, and you were using watermark alignment, but at the same time you are not able to upgrade/modify your connector, you can disable per split alignment via setting `pipeline.watermark-alignment.allow-unaligned-source-splits` to true. Note that by doing so, watermark alignment will be working properly only when your number of splits equals to the parallelism of the source operator.

  was:Added support for watermark alignment of source splits.


> FLIP-217 Support watermark alignment of source splits
> -----------------------------------------------------
>
>                 Key: FLINK-28853
>                 URL: https://issues.apache.org/jira/browse/FLINK-28853
>             Project: Flink
>          Issue Type: Improvement
>          Components: Connectors / Common, Runtime / Checkpointing
>    Affects Versions: 1.16.0
>            Reporter: Sebastian Mattheis
>            Assignee: Maximilian Michels
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 1.17.0
>
>
> This improvement implements [FLIP-217|https://cwiki.apache.org/confluence/display/FLINK/FLIP-217+Support+watermark+alignment+of+source+splits] to support watermark alignment of source splits.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)