You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Weijie Guo (Jira)" <ji...@apache.org> on 2022/10/26 06:21:00 UTC
[jira] [Commented] (FLINK-29764) Automatic judgment of parallelism of source
[ https://issues.apache.org/jira/browse/FLINK-29764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17624208#comment-17624208 ]
Weijie Guo commented on FLINK-29764:
------------------------------------
[~waywtdcc] Can you explain your problem in more detail? As far as I know, the source parallelism under the adaptive batch scheduler subject the following rule:
# Kind of source can infer parallelism according to the catalog. For example, HiveTableSource.
# Considering other sources, using the configuration "{*}jobmanager.adaptive-batch-scheduler.default-source-parallelism{*}” to manually configure source parallelism.
> Automatic judgment of parallelism of source
> -------------------------------------------
>
> Key: FLINK-29764
> URL: https://issues.apache.org/jira/browse/FLINK-29764
> Project: Flink
> Issue Type: New Feature
> Components: Table SQL / API, Table SQL / Planner
> Affects Versions: 1.16.0, 1.15.2
> Reporter: waywtdcc
> Priority: Major
> Fix For: 1.17.0
>
>
> The parallelism of the source is automatically judged. The parallelism of the source should not be determined by jobmanager. adaptive batch scheduler The default source parallelism is judged by the two configurations of jobmanager.adaptive batch-scheduler.min-parallelism and jobmanager.adaptive batch-scheduler.max-parallelism and the number of partitions
--
This message was sent by Atlassian Jira
(v8.20.10#820010)