You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2023/01/11 08:08:11 UTC

[GitHub] [airflow] uranusjr commented on a diff in pull request #28831: Update scheduler docs about low priority tasks

uranusjr commented on code in PR #28831:
URL: https://github.com/apache/airflow/pull/28831#discussion_r1066682250


##########
docs/apache-airflow/administration-and-deployment/scheduler.rst:
##########
@@ -59,6 +59,14 @@ In the UI, it appears as if Airflow is running your tasks a day **late**
 
     You should refer to :doc:`../core-concepts/dag-run` for details on scheduling a DAG.
 
+.. note::
+    The scheduler is designed for high throughput. This is an informed design decision to achieve scheduling
+    tasks as soon as possible. The scheduler checks how many free slots available in a pool and schedule at most that number of tasks instances in one iteration.
+    This means that task priority will only come in to effect when there are more scheduled tasks
+    waiting than the queue slots. Thus there can be cases where low priority tasks will be schedule before high priority tasks if they share the same batch.
+    For more read about that you can reference this `Github discussion <https://github.com/apache/airflow/discussions/28809>`_.

Review Comment:
   ```suggestion
       For more read about that you can reference `this GitHub discussion <https://github.com/apache/airflow/discussions/28809>`__.
   ```



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org