You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Rui Fan (Jira)" <ji...@apache.org> on 2024/01/01 03:13:00 UTC

[jira] [Created] (FLINK-33960) Adaptive Scheduler doesn't respect the lowerBound for tasks

Rui Fan created FLINK-33960:
-------------------------------

             Summary: Adaptive Scheduler doesn't respect the lowerBound for tasks
                 Key: FLINK-33960
                 URL: https://issues.apache.org/jira/browse/FLINK-33960
             Project: Flink
          Issue Type: Bug
          Components: Runtime / Coordination
    Affects Versions: 1.17.2, 1.18.1
            Reporter: Rui Fan
            Assignee: Rui Fan


Adaptive Scheduler doesn't respect the lowerBound for tasks when one flink job has more than 1 tasks.

 

When we using the adaptive scheduler and the rescale api, users will set the lowerBound and upperBound for each job vertices. And users expect the parallelism of all vertices between lowerBound and upperBound.

But when one flink job  has more than 1 vertex, and resource isn't enough. Some of lowerBound won't be respect.
h2. How to reproduce this bug:

One job has 3 job vertices, we set the resource requirements are:
 * Vertex1: lowerBound=2, upperBound=2
 * Vertex2: lowerBound=8, upperBound=8
 * Vertex3: lowerBound=2, upperBound=2

They are same slotSharingGroup, and we only 5 available slots. This job shouldn't run due to the slots cannot meets the resource requiremnt for vertex2.

But the job can runs, and the parallelism of vertex2 is 5.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)