You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "jsnb-devoted (via GitHub)" <gi...@apache.org> on 2023/03/09 01:50:46 UTC
[GitHub] [airflow] jsnb-devoted opened a new issue, #29988: Mapped Task details view "success" counts are off
jsnb-devoted opened a new issue, #29988:
URL: https://github.com/apache/airflow/issues/29988
### Apache Airflow version
2.5.1
### What happened
After the upgrade to `2.5.1` we have noticed that the counts in the details page for mapped tasks seems to be wrong. The "success" count is typically stuck at 1 and then if you look at the actual tasks there are many successful tasks.
### What you think should happen instead
Here is the details page saying there is 1 successful task:
In the "Mapped Tasks" view you can see there are many successful tasks
### How to reproduce
Run a DAG with mapped tasks -- watch the success count
### Operating System
Ubuntu
### Versions of Apache Airflow Providers
```
apache-airflow-providers-amazon==7.2.1
apache-airflow-providers-cncf-kubernetes==5.2.1
apache-airflow-providers-common-sql==1.3.3
apache-airflow-providers-datadog==3.1.0
apache-airflow-providers-facebook==3.1.0
apache-airflow-providers-ftp==3.3.1
apache-airflow-providers-http==4.2.0
apache-airflow-providers-imap==3.1.1
apache-airflow-providers-jdbc==3.3.0
apache-airflow-providers-postgres==5.4.0
apache-airflow-providers-snowflake==4.0.4
apache-airflow-providers-sqlite==3.3.1
apache-airflow-providers-ssh==3.4.0
```
### Deployment
Official Apache Airflow Helm Chart
### Deployment details
k8s on EKS with the official helm chart 1.8.0
### Anything else
_No response_
### Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] vvnekb commented on issue #29988: Mapped Task details view "success" counts are off
Posted by "vvnekb (via GitHub)" <gi...@apache.org>.
vvnekb commented on issue #29988:
URL: https://github.com/apache/airflow/issues/29988#issuecomment-1737045700
It affects us too, mapped tasks counters are off nearly all the time. Success counter and total mapped tasks counter are incorrect.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] jsnb-devoted commented on issue #29988: Mapped Task details view "success" counts are off
Posted by "jsnb-devoted (via GitHub)" <gi...@apache.org>.
jsnb-devoted commented on issue #29988:
URL: https://github.com/apache/airflow/issues/29988#issuecomment-1464975804
@bbovenzi -- `count` and `success` are both wrong. `running` `queued` `scheduled` and `up for retry` look closer to the right numbers but I didn't scrutinize them.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Mapped Task details view "success" counts are off [airflow]
Posted by "JosephABC (via GitHub)" <gi...@apache.org>.
JosephABC commented on issue #29988:
URL: https://github.com/apache/airflow/issues/29988#issuecomment-1925104565
We are using v2.7.3 and encountered this issue as well
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] jsnb-devoted commented on issue #29988: Mapped Task details view "success" counts are off
Posted by "jsnb-devoted (via GitHub)" <gi...@apache.org>.
jsnb-devoted commented on issue #29988:
URL: https://github.com/apache/airflow/issues/29988#issuecomment-1474091274
Thanks so much @bbovenzi -- I hadn't had time to dig into the code or the meta db to diagnose the issue. Appreciate you doing the legwork here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] bbovenzi commented on issue #29988: Mapped Task details view "success" counts are off
Posted by "bbovenzi (via GitHub)" <gi...@apache.org>.
bbovenzi commented on issue #29988:
URL: https://github.com/apache/airflow/issues/29988#issuecomment-1474087755
I just replicated this issue. Hope to figure out a fix soon.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Mapped Task details view "success" counts are off [airflow]
Posted by "bbovenzi (via GitHub)" <gi...@apache.org>.
bbovenzi commented on issue #29988:
URL: https://github.com/apache/airflow/issues/29988#issuecomment-1932605688
I know I replicated this a while ago, but then got distracted. Could anyone please provide an example dag that this happens with consistently?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] bbovenzi commented on issue #29988: Mapped Task details view "success" counts are off
Posted by "bbovenzi (via GitHub)" <gi...@apache.org>.
bbovenzi commented on issue #29988:
URL: https://github.com/apache/airflow/issues/29988#issuecomment-1462289087
Is auto-refresh active on the page?
If you refresh the page yourself does the issue persist?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Mapped Task details view "success" counts are off [airflow]
Posted by "attilaszombati (via GitHub)" <gi...@apache.org>.
attilaszombati commented on issue #29988:
URL: https://github.com/apache/airflow/issues/29988#issuecomment-1827660346
We are using v2.5.3 and the the bug is here as well
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] bbovenzi commented on issue #29988: Mapped Task details view "success" counts are off
Posted by "bbovenzi (via GitHub)" <gi...@apache.org>.
bbovenzi commented on issue #29988:
URL: https://github.com/apache/airflow/issues/29988#issuecomment-1464118492
I have yet to replicate this issue.
Interesting how the count is also different from the table of mapped tasks. Do you know which one is the correct count?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] jsnb-devoted commented on issue #29988: Mapped Task details view "success" counts are off
Posted by "jsnb-devoted (via GitHub)" <gi...@apache.org>.
jsnb-devoted commented on issue #29988:
URL: https://github.com/apache/airflow/issues/29988#issuecomment-1462398088
> Is auto-refresh active on the page? If you refresh the page yourself does the issue persist?
@bbovenzi yep auto-refresh is turned on and I tried manually refreshing but the issue persisted.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Mapped Task details view "success" counts are off [airflow]
Posted by "leodrivera (via GitHub)" <gi...@apache.org>.
leodrivera commented on issue #29988:
URL: https://github.com/apache/airflow/issues/29988#issuecomment-1755384792
We are using version 2.7.1 and are also being affected.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org