You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "Jingsong Lee (Jira)" <ji...@apache.org> on 2020/03/04 05:25:00 UTC

[jira] [Created] (FLINK-16413) Reduce hive source parallelism when limit push down

Jingsong Lee created FLINK-16413:
------------------------------------

             Summary: Reduce hive source parallelism when limit push down
                 Key: FLINK-16413
                 URL: https://issues.apache.org/jira/browse/FLINK-16413
             Project: Flink
          Issue Type: Bug
          Components: Connectors / Hive
            Reporter: Jingsong Lee
             Fix For: 1.11.0


User started hive source parallelism automatic inference. For example, Set the maximum parallelism of inference to 10.

User have a similar SQL SELECT * from mytable limit 1;

There are more than 10 files in the hive table mytable. Is it a bit wasteful to start 10 parallelism.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)