You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Shammon (Jira)" <ji...@apache.org> on 2021/12/15 07:31:00 UTC

[jira] [Created] (FLINK-25318) Improvement of scheduler and execution for Flink OLAP

Shammon created FLINK-25318:
-------------------------------

             Summary: Improvement of scheduler and execution for Flink OLAP
                 Key: FLINK-25318
                 URL: https://issues.apache.org/jira/browse/FLINK-25318
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / Coordination, Runtime / Network
    Affects Versions: 1.13.3, 1.12.5, 1.14.0
            Reporter: Shammon


We use flink to perform OLAP queries. We launch flink session cluster, submit batch jobs to the cluster as OLAP queries, and fetch the jobs' results. OLAP jobs are generally small queries which will finish at the seconds or milliseconds, and users always submit multiple jobs to the session cluster concurrently. We found the qps and latency of jobs will be greatly affected when there're tens jobs are running, even when there's little data in each query. We will give the result of benchmark for the latest version later.
After discussed with [~xtsong], and thanks for his advice, we create this issue to trace and manager Flink OLAP related improvements. More users and developers are welcome and feel free to create Flink OLAP related subtasks here, thanks



--
This message was sent by Atlassian Jira
(v8.20.1#820001)