You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Jiabao Sun (Jira)" <ji...@apache.org> on 2023/06/15 08:02:00 UTC

[jira] [Updated] (FLINK-32344) MongoDB connector support unbounded streaming read via ChangeStream feature

     [ https://issues.apache.org/jira/browse/FLINK-32344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jiabao Sun updated FLINK-32344:
-------------------------------
    Description: 
Change streams allow applications to access real-time data changes without the complexity and risk of tailing the oplog. Applications can use change streams to subscribe to all data changes on a single collection, a database, or an entire deployment, and immediately react to them. Because change streams use the aggregation framework, applications can also filter for specific changes or transform the notifications at will.

We can use MongoDB change streams feature to support unbounded streaming read for mongodb connector.

[Change Streams|https://www.mongodb.com/docs/manual/changeStreams/#change-streams]

> MongoDB connector support unbounded streaming read via ChangeStream feature
> ---------------------------------------------------------------------------
>
>                 Key: FLINK-32344
>                 URL: https://issues.apache.org/jira/browse/FLINK-32344
>             Project: Flink
>          Issue Type: New Feature
>          Components: Connectors / MongoDB
>    Affects Versions: mongodb-1.0.1
>            Reporter: Jiabao Sun
>            Priority: Major
>
> Change streams allow applications to access real-time data changes without the complexity and risk of tailing the oplog. Applications can use change streams to subscribe to all data changes on a single collection, a database, or an entire deployment, and immediately react to them. Because change streams use the aggregation framework, applications can also filter for specific changes or transform the notifications at will.
> We can use MongoDB change streams feature to support unbounded streaming read for mongodb connector.
> [Change Streams|https://www.mongodb.com/docs/manual/changeStreams/#change-streams]



--
This message was sent by Atlassian Jira
(v8.20.10#820010)