You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Jingsong Lee (Jira)" <ji...@apache.org> on 2020/07/07 02:41:00 UTC

[jira] [Created] (FLINK-18508) Dynamic source supports statistics and parallelism report

Jingsong Lee created FLINK-18508:
------------------------------------

             Summary: Dynamic source supports statistics and parallelism report
                 Key: FLINK-18508
                 URL: https://issues.apache.org/jira/browse/FLINK-18508
             Project: Flink
          Issue Type: New Feature
          Components: Table SQL / API
            Reporter: Jingsong Lee
             Fix For: 1.12.0


Add SupportsStatisticsReport and SupportsParallelismReport to dynamic source, source can return some information to help table optimizer.

This information can be more accurate from the source rather than the catalog. For example, for iceberg / filesystem connector, after filter and partition pushdown, the statistics have been greatly adjusted, and many files may have been filtered out.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)