You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2021/09/02 07:50:57 UTC
[GitHub] [airflow] ephraimbuddy opened a new issue #17979: Running dagruns are not visible in the UI when there are many queued dagruns
ephraimbuddy opened a new issue #17979:
URL: https://github.com/apache/airflow/issues/17979
### Apache Airflow version
2.1.3 (latest released)
### Operating System
Ubuntu 20.04.2 LTS (Focal Fossa)
### Versions of Apache Airflow Providers
_No response_
### Deployment
Other
### Deployment details
Local dev environment with breeze
### What happened
Running dagruns are not visible in the UI when there are many queued dagruns.
# Running not visible in tree view
# Running not visible in graph view
# Running visible in details page
### What you expected to happen
I expected to see the running dagruns in the tree view and graph view
### How to reproduce
Run this dag and check the tree/graph view when queued dagruns is more than 20:
```
from airflow import models
from airflow.operators.bash import BashOperator
from datetime import datetime, timedelta
with models.DAG('my-test-dag-for-active-runs',
schedule_interval= '@daily',
start_date = datetime(2021, 4, 4, 19, 20)
catchup=True,
max_active_runs=2
) as dag:
start = BashOperator(
task_id='start',
bash_command='echo "Starting"; echo "Sleeping for 10 seconds"; sleep 10; echo "Finished"'
)
task2 = BashOperator(
task_id='next_task',
bash_command='echo "Starting"; echo "Sleeping for 10 seconds"; sleep 10'
)
```
### Anything else
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] bbovenzi edited a comment on issue #17979: Running dagruns are not visible in the UI when there are many queued dagruns
Posted by GitBox <gi...@apache.org>.
bbovenzi edited a comment on issue #17979:
URL: https://github.com/apache/airflow/issues/17979#issuecomment-911537808
It is working correctly since its showing the 25 most recent runs going back from the current date. Expanding the number of runs to 100 or 365 or manipulating the date will let you see the running tasks.
I'm not sure if this is something we want to fix.
Although I do notice a separate issue with how the tree refresh isn't always rendering new dag runs correctly.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] bbovenzi commented on issue #17979: Running dagruns are not visible in the UI when there are many queued dagruns
Posted by GitBox <gi...@apache.org>.
bbovenzi commented on issue #17979:
URL: https://github.com/apache/airflow/issues/17979#issuecomment-911617190
We'd have to change the query for the tree data to set the date to the current running dag run, but that would be changing as dags finish running so I'd have to think about it more. In that case I'm going to change this to a feature request instead of a bug.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] bbovenzi edited a comment on issue #17979: Running dagruns are not visible in the UI when there are many queued dagruns
Posted by GitBox <gi...@apache.org>.
bbovenzi edited a comment on issue #17979:
URL: https://github.com/apache/airflow/issues/17979#issuecomment-911617190
We'd have to change the query for the tree data to set the date to the current running dag run, but the date would be changing as dags finish running so I'd have to think about it more. In that case I'm going to change this to a feature request instead of a bug.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] bbovenzi commented on issue #17979: Running dagruns are not visible in the UI when there are many queued dagruns
Posted by GitBox <gi...@apache.org>.
bbovenzi commented on issue #17979:
URL: https://github.com/apache/airflow/issues/17979#issuecomment-911537808
It is working correctly since its showing the 25 most recent runs going back from the current date. Expanding the number of runs to 100 or 365 or manipulating the date will let you see the running tasks.
I'm not sure if this is something we want to fix.
Although I do notice a separate issue of how the tree refresh will render many newly created dag runs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] ephraimbuddy commented on issue #17979: Running dagruns are not visible in the UI when there are many queued dagruns
Posted by GitBox <gi...@apache.org>.
ephraimbuddy commented on issue #17979:
URL: https://github.com/apache/airflow/issues/17979#issuecomment-911603511
> It is working correctly since its showing the 25 most recent runs going back from the current date. Expanding the number of runs to 100 or 365 or manipulating the date will let you see the running tasks.
>
> I'm not sure if this is something we want to fix.
>
> Although I do notice a separate issue with how the tree refresh isn't always rendering new dag runs correctly.
I'm thinking that we should make the running dags visible. Is there a way we could prioritize running dagruns to show first?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] ephraimbuddy commented on issue #17979: Running dagruns are not visible in the UI when there are many queued dagruns
Posted by GitBox <gi...@apache.org>.
ephraimbuddy commented on issue #17979:
URL: https://github.com/apache/airflow/issues/17979#issuecomment-911352996
@bbovenzi
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org