[GitHub] [airflow] mik-laj commented on a diff in pull request #25102: Incorrect parallelism definition in config.yml

[GitBox <gi...@apache.org>]

mik-laj commented on code in PR #25102:
URL: https://github.com/apache/airflow/pull/25102#discussion_r922639514


##########
airflow/config_templates/config.yml:
##########
@@ -62,10 +62,9 @@
       default: "SequentialExecutor"
     - name: parallelism
       description: |
-        This defines the maximum number of task instances that can run concurrently per scheduler in
-        Airflow, regardless of the worker count. Generally this value, multiplied by the number of
-        schedulers in your cluster, is the maximum number of task instances with the running
-        state in the metadata database.
+        This defines the maximum number of task instances that can run concurrently in
+        Airflow, regardless of the worker or scheduler count. This value represents the maximum number
+        of tasks that can be in the running or queued states in the metadata database.

Review Comment:
   Because this value is not synchronized between schedulers due to performance reasons.. Each scheduler only monitors its own tasks, so everyone has their own quota.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org