You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2022/06/10 18:14:41 UTC
[GitHub] [airflow] PrincipalsOffice opened a new issue, #24381: Prioritize tasks based on execution_date
PrincipalsOffice opened a new issue, #24381:
URL: https://github.com/apache/airflow/issues/24381
### Description
A config that lets the scheduler choose tasks with the latest/oldest execution_date to run first. Or perhaps a way to dynamically assign pool slots based on the execution_date could also work.
### Use case/motivation
Sometimes the same task can have multiple task instances from different dag runs queued and occupying pool slots. The task instance from the most recent dag run could have a higher priority than the older ones. Currently there is no way to prioritize that.
### Related issues
_No response_
### Are you willing to submit a PR?
- [X] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #24381: Prioritize tasks based on execution_date
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #24381:
URL: https://github.com/apache/airflow/issues/24381#issuecomment-1160813762
> @eladkal So currently there is no walkaround to prioritize tasks from the latest dag_run?
No.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] eladkal closed issue #24381: Prioritize tasks based on execution_date
Posted by GitBox <gi...@apache.org>.
eladkal closed issue #24381: Prioritize tasks based on execution_date
URL: https://github.com/apache/airflow/issues/24381
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] eladkal commented on issue #24381: Prioritize tasks based on execution_date
Posted by GitBox <gi...@apache.org>.
eladkal commented on issue #24381:
URL: https://github.com/apache/airflow/issues/24381#issuecomment-1153136728
duplicate of https://github.com/apache/airflow/issues/9176
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] PrincipalsOffice commented on issue #24381: Prioritize tasks based on execution_date
Posted by GitBox <gi...@apache.org>.
PrincipalsOffice commented on issue #24381:
URL: https://github.com/apache/airflow/issues/24381#issuecomment-1160752482
@eladkal So currently there is no walkaround to prioritize tasks from the latest dag_run?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org