You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Jingsong Lee (Jira)" <ji...@apache.org> on 2020/10/27 04:20:00 UTC

[jira] [Created] (FLINK-19819) SourceReaderBase supports limit push down

Jingsong Lee created FLINK-19819:
------------------------------------

             Summary: SourceReaderBase supports limit push down
                 Key: FLINK-19819
                 URL: https://issues.apache.org/jira/browse/FLINK-19819
             Project: Flink
          Issue Type: Improvement
          Components: Connectors / Common
            Reporter: Jingsong Lee
             Fix For: 1.12.0


User requirement:

Users need to look at a few random pieces of data in a table to see what the data looks like. So users often use the SQL:

"select * from table limit 10"

For a large table, expect to end soon because only a few pieces of data are queried.

For DataStream or BoundedStream, they are push based execution models, so the downstream cannot control the end of source operator.

We need push down limit to source operator, so that source operator can end early.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)