You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "SuDewei (Jira)" <ji...@apache.org> on 2024/02/22 16:17:00 UTC

[jira] [Created] (FLINK-34500) Release Testing: Verify FLINK-33261 Support Setting Parallelism for Table/SQL Sources

SuDewei created FLINK-34500:
-------------------------------

             Summary: Release Testing: Verify FLINK-33261 Support Setting Parallelism for Table/SQL Sources
                 Key: FLINK-34500
                 URL: https://issues.apache.org/jira/browse/FLINK-34500
             Project: Flink
          Issue Type: Sub-task
          Components: Connectors / Parent, Table SQL / API
    Affects Versions: 1.19.0
            Reporter: SuDewei
             Fix For: 1.19.0


This issue aims to verify [FLIP-367|https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=263429150].
Volunteers can verify it by following the [doc changes|https://github.com/apache/flink/pull/24234]. Since currently only the pre-defined DataGen connector and user-defined connector supports setting source parallelism, volunteers can verify it through DataGen Connector. The basic steps include:
1. Start a Flink cluster and submit a Flink SQL Job to the cluster.
2. In this Flink Job, use the DataGen SQL Connector to generate data.
3. Specify the parameter scan.parallelism in DataGen connector options as user-defined parallelism instead of default parallelism.
4. Observe whether the parallelism of the source has changed on the job graph of the Flink Application UI, and whether the shuffle mode is correct.
If everything is normal, you will see that the parallelism of the source operator is indeed different from that of downstream, and the shuffle mode is rebalanced by default.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)