You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Xinbin Huang (Jira)" <ji...@apache.org> on 2022/07/18 01:22:00 UTC

[jira] [Commented] (FLINK-23633) HybridSource: Support dynamic stop position in FileSource

    [ https://issues.apache.org/jira/browse/FLINK-23633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17567763#comment-17567763 ] 

Xinbin Huang commented on FLINK-23633:
--------------------------------------

[~thw] I've made a PR to implement this. Would you have time to take a look? https://github.com/apache/flink/pull/20289

> HybridSource: Support dynamic stop position in FileSource
> ---------------------------------------------------------
>
>                 Key: FLINK-23633
>                 URL: https://issues.apache.org/jira/browse/FLINK-23633
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Connectors / FileSystem
>            Reporter: Thomas Weise
>            Assignee: Xinbin Huang
>            Priority: Major
>              Labels: pull-request-available
>
> As of FLINK-22670 FileSource can be used with HybridSource with fixed end position. To support the scenario where the switch position isn't known ahead of time, FileSource needs to have a hook to decide when it is time to stop with continuous polling and then expose the end position through the enumerator.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)