You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Jark Wu (Jira)" <ji...@apache.org> on 2021/11/23 02:32:00 UTC
[jira] [Assigned] (FLINK-24953) Optime hive parallelism inference
[ https://issues.apache.org/jira/browse/FLINK-24953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jark Wu reassigned FLINK-24953:
-------------------------------
Assignee: xiangqiao
> Optime hive parallelism inference
> ---------------------------------
>
> Key: FLINK-24953
> URL: https://issues.apache.org/jira/browse/FLINK-24953
> Project: Flink
> Issue Type: Improvement
> Components: Connectors / Hive
> Affects Versions: 1.13.0, 1.14.0
> Reporter: xiangqiao
> Assignee: xiangqiao
> Priority: Major
> Labels: pull-request-available
>
> Currently, when I disable hive table source parallelism inference using configuration and set parallelism.default: 100.
> {code:java}
> table.exec.hive.infer-source-parallelism: false
> parallelism.default: 100{code}
> The result is that the parallelism of hive table source is {*}1{*}, and the configuration of the default parallelism is not effective.
> I will optimize this problem. In the future, when disable hive table source parallelism inference ,the parallelism of hive table source will be determined according to the following order:
>
> 1. If table.exec.resource.default-parallelism is set, the configured value will be used
> 2. If parallelism.default is set, the configured value is used
> 3. If the above two configuration items are not set, the default value is 1
>
--
This message was sent by Atlassian Jira
(v8.20.1#820001)