You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "ellisms (via GitHub)" <gi...@apache.org> on 2026/01/09 13:25:31 UTC
[I] dag_processing.last_duration. metric missing [airflow]
ellisms opened a new issue, #60325:
URL: https://github.com/apache/airflow/issues/60325
### Apache Airflow version
Other Airflow 3 version (please specify below)
### If "Other Airflow 3 version" selected, which one?
3.0.6
### What happened?
Prior to version 3x, Airflow emitted the `dag_processing.last_duration.<dag_file>` metric. While working in MWAA with version 3.0.6, I noticed this metric is no longer available in CloudWatch. I verified MWAA is not excluding any metrics, so I expect the metric to be present.
For a sanity check, I enabled StatsD in Breeze to see if the metric is emitted or not. I don't see the metric in Grafana.
The other python file-level metric (dag_processing.last_run.seconds_ago.<dag_file>) is still emitted and visible in CloudWatch.
The metric is still listed in the [Airflow metrics documentation](https://airflow.apache.org/docs/apache-airflow/3.0.6/administration-and-deployment/logging-monitoring/metrics.html#timers).
### What you think should happen instead?
I expected the metric to be present. I find it useful when identifying python files that may need to be tuned for performance.
### How to reproduce
For MWAA, create an MWAA environment with version 3.0.6 and upload a python file (with dag) to the Amazon S3 bucket. Once parsing takes place, attempt to find the metric in Amazon CloudWatch.
### Operating System
AL2023
### Versions of Apache Airflow Providers
_No response_
### Deployment
Amazon (AWS) MWAA
### Deployment details
This is a standard MWAA deployment. I did not add/modify any of the `[metrics]` config items.
### Anything else?
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [x] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] dag_processing.last_duration. metric missing [airflow]
Posted by "arjav1528 (via GitHub)" <gi...@apache.org>.
arjav1528 commented on issue #60325:
URL: https://github.com/apache/airflow/issues/60325#issuecomment-3731791861
Hi, I would like to work on this issue
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] dag_processing.last_duration. metric missing [airflow]
Posted by "suii2210 (via GitHub)" <gi...@apache.org>.
suii2210 commented on issue #60325:
URL: https://github.com/apache/airflow/issues/60325#issuecomment-3730325067
Hi @ellisms, I’d like to work on this issue. I’ll investigate why dag_processing.last_duration.<dag_file> is no longer emitted in Airflow 3.x and propose a fix.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] dag_processing.last_duration. metric missing [airflow]
Posted by "shahar1 (via GitHub) via commits" <co...@airflow.apache.org>.
shahar1 closed issue #60325: dag_processing.last_duration.<dag_file> metric missing
URL: https://github.com/apache/airflow/issues/60325
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] dag_processing.last_duration. metric missing [airflow]
Posted by "GaneshPatil7517 (via GitHub)" <gi...@apache.org>.
GaneshPatil7517 commented on issue #60325:
URL: https://github.com/apache/airflow/issues/60325#issuecomment-3729997420
hey @ellisms assign me i want to work on this...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] dag_processing.last_duration. metric missing [airflow]
Posted by "shahar1 (via GitHub) via commits" <co...@airflow.apache.org>.
shahar1 commented on issue #60325:
URL: https://github.com/apache/airflow/issues/60325#issuecomment-6686468228
Solved by https://github.com/apache/airflow/pull/61079
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org