You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "Lei Yang (Jira)" <ji...@apache.org> on 2024/10/30 08:20:00 UTC

[jira] [Created] (FLINK-36629) Introducing the AdaptiveSkewedJoinOptimizationStrategy

Lei Yang created FLINK-36629:
--------------------------------

             Summary: Introducing the AdaptiveSkewedJoinOptimizationStrategy
                 Key: FLINK-36629
                 URL: https://issues.apache.org/jira/browse/FLINK-36629
             Project: Flink
          Issue Type: Sub-task
          Components: Runtime / Coordination
            Reporter: Lei Yang


The AdaptiveSkewedJoinOptimizationStrategy is responsible for adjusting the StreamGraph for the skewed join operators at the runtime stage before the scheduling of the AdaptiveJoin operator. It has the following works:
 # Introduce the capability to record edges that meet the conditions for adaptive skewed join optimization to BatchExecAdaptiveJoin and the capability to query optimizable skewed sides to the AdaptiveJoinOperatorFactory.
 # Determine whether to optimize for skewed join based on the skewness of the actual input data from upstream and the type of input edge in the AdaptiveSkewedJoinOptimizationStrategy.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)