You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "Sebastian Liu (Jira)" <ji...@apache.org> on 2020/11/30 08:39:00 UTC

[jira] [Created] (FLINK-20416) Need a cached catalog for batch SQL job

Sebastian Liu created FLINK-20416:
-------------------------------------

             Summary: Need a cached catalog for batch SQL job
                 Key: FLINK-20416
                 URL: https://issues.apache.org/jira/browse/FLINK-20416
             Project: Flink
          Issue Type: Improvement
          Components: Table SQL / API, Table SQL / Planner
            Reporter: Sebastian Liu


For OLAP scenarios, There are usually some analytical queries which running time is relatively short. These queries are also sensitive to latency. In the current Blink sql processing, parse/validate/optimize stages are all need meta data from catalog API. But each request to the catalog requires re-run of the underlying meta query. 

 

We may need a cached catalog which can cache the table schema and statistic info to avoid unnecessary repeated meta requests. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)