You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Jark Wu (Jira)" <ji...@apache.org> on 2021/11/23 02:32:00 UTC

[jira] [Assigned] (FLINK-24953) Optime hive parallelism inference

     [ https://issues.apache.org/jira/browse/FLINK-24953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jark Wu reassigned FLINK-24953:
-------------------------------

    Assignee: xiangqiao

> Optime hive parallelism inference
> ---------------------------------
>
>                 Key: FLINK-24953
>                 URL: https://issues.apache.org/jira/browse/FLINK-24953
>             Project: Flink
>          Issue Type: Improvement
>          Components: Connectors / Hive
>    Affects Versions: 1.13.0, 1.14.0
>            Reporter: xiangqiao
>            Assignee: xiangqiao
>            Priority: Major
>              Labels: pull-request-available
>
> Currently, when I disable hive table source parallelism inference using configuration  and set parallelism.default: 100. 
> {code:java}
> table.exec.hive.infer-source-parallelism: false 
> parallelism.default: 100{code}
> The result is that the parallelism of hive table source is {*}1{*}, and the configuration of the default parallelism is not effective.
> I will optimize this problem. In the future, when disable hive table source parallelism inference ,the  parallelism of hive table source will be determined according to the following order:
>  
> 1. If table.exec.resource.default-parallelism is set, the configured value will be used
> 2. If parallelism.default is set, the configured value is used
> 3. If the above two configuration items are not set, the default value is 1
>  



--
This message was sent by Atlassian Jira
(v8.20.1#820001)