[airflow] branch main updated: Update scheduler docs about low priority tasks (#28831)

[as...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

ash pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git


The following commit(s) were added to refs/heads/main by this push:
     new 493b433ad5 Update scheduler docs about low priority tasks (#28831)
493b433ad5 is described below

commit 493b433ad57088a5f5cabc466c949445e500b4c1
Author: eladkal <45...@users.noreply.github.com>
AuthorDate: Wed Jan 11 13:25:31 2023 +0200

    Update scheduler docs about low priority tasks (#28831)
    
    Gathered insights from discussion in https://github.com/apache/airflow/issues/26933 into a paragraph in scheduler docs to clarify why sometimes low priority tasks are scheduled before high priority tasks
---
 docs/apache-airflow/administration-and-deployment/scheduler.rst | 8 ++++++++
 1 file changed, 8 insertions(+)

diff --git a/docs/apache-airflow/administration-and-deployment/scheduler.rst b/docs/apache-airflow/administration-and-deployment/scheduler.rst
index a499ad4ee0..7600e244f0 100644
--- a/docs/apache-airflow/administration-and-deployment/scheduler.rst
+++ b/docs/apache-airflow/administration-and-deployment/scheduler.rst
@@ -59,6 +59,14 @@ In the UI, it appears as if Airflow is running your tasks a day **late**
 
     You should refer to :doc:`../core-concepts/dag-run` for details on scheduling a DAG.
 
+.. note::
+    The scheduler is designed for high throughput. This is an informed design decision to achieve scheduling
+    tasks as soon as possible. The scheduler checks how many free slots available in a pool and schedule at most that number of tasks instances in one iteration.
+    This means that task priority will only come in to effect when there are more scheduled tasks
+    waiting than the queue slots. Thus there can be cases where low priority tasks will be schedule before high priority tasks if they share the same batch.
+    For more read about that you can reference `this GitHub discussion <https://github.com/apache/airflow/discussions/28809>`__.
+
+
 DAG File Processing
 -------------------