You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Zhanghao Chen (Jira)" <ji...@apache.org> on 2023/05/09 03:23:00 UTC

[jira] [Created] (FLINK-32037) The edge on Web UI is wrong after parallelism changes via parallelism overrides or AdaptiveScheduler

Zhanghao Chen created FLINK-32037:
-------------------------------------

             Summary: The edge on Web UI is wrong after parallelism changes via parallelism overrides or AdaptiveScheduler 
                 Key: FLINK-32037
                 URL: https://issues.apache.org/jira/browse/FLINK-32037
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / Coordination, Runtime / REST
    Affects Versions: 1.17.0
            Reporter: Zhanghao Chen


*Background*

After FLINK-30213, in case of parallelism changes to the JobGraph, as done via the AdaptiveScheduler or through providing JobVertexId overrides in PipelineOptions#PARALLELISM_OVERRIDES, when the consumer parallelism doesn't match the local parallelism, the original ForwardPartitioner will be replaced with the RebalancePartitioner.

*Problem*

Although the actual partitioner changes underneath, the ship strategy seen on the Web UI is still FORWARD.

This is because the fix patch applies when we init StreamTask, and the job graph is not touched. Web UI uses the JSON plan generated from the job graph for display, and the ship strategy is get by JobEdge#getShipStrategyName.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)