You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "xingbe (Jira)" <ji...@apache.org> on 2024/06/18 11:22:00 UTC
[jira] [Updated] (FLINK-35635) Release Testing: Verify FLIP-445: Support dynamic parallelism inference for HiveSource
[ https://issues.apache.org/jira/browse/FLINK-35635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
xingbe updated FLINK-35635:
---------------------------
Description:
This issue aims to verify FLIP-445.
The Hive Source now supports dynamic parallelism inference, and the default parallelism inference mode has also changed from static to dynamic inference. For detailed information, please refer to the [documentation|https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/table/hive/hive_read_write/#source-parallelism-inference].
We may need to cover the following types of test cases:
Test 1: Confirm that the dynamic parallelism inference feature is effective.
Test 2: Confirm whether it is possible to switch the parallelism inference mode or disable parallelism inference through the config option `table.exec.hive.infer-source-parallelism.mode`.
Test 3: Construct scenarios where DynamicPartitionPruning is effective, and confirm whether the dynamically inferred source parallelism has been optimized.
Follow up the test for https://issues.apache.org/jira/browse/FLINK-35293
was:Follow up the test for https://issues.apache.org/jira/browse/FLINK-35293
> Release Testing: Verify FLIP-445: Support dynamic parallelism inference for HiveSource
> --------------------------------------------------------------------------------------
>
> Key: FLINK-35635
> URL: https://issues.apache.org/jira/browse/FLINK-35635
> Project: Flink
> Issue Type: Sub-task
> Components: Connectors / Hive
> Reporter: xingbe
> Assignee: xingbe
> Priority: Blocker
> Labels: release-testing
> Fix For: 1.20.0
>
>
> This issue aims to verify FLIP-445.
> The Hive Source now supports dynamic parallelism inference, and the default parallelism inference mode has also changed from static to dynamic inference. For detailed information, please refer to the [documentation|https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/table/hive/hive_read_write/#source-parallelism-inference].
> We may need to cover the following types of test cases:
> Test 1: Confirm that the dynamic parallelism inference feature is effective.
> Test 2: Confirm whether it is possible to switch the parallelism inference mode or disable parallelism inference through the config option `table.exec.hive.infer-source-parallelism.mode`.
> Test 3: Construct scenarios where DynamicPartitionPruning is effective, and confirm whether the dynamically inferred source parallelism has been optimized.
>
> Follow up the test for https://issues.apache.org/jira/browse/FLINK-35293
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)