You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "iamhritik (via GitHub)" <gi...@apache.org> on 2025/02/16 16:41:00 UTC
[I] Metrics missing in v2.10.1 [airflow]
iamhritik opened a new issue, #46805:
URL: https://github.com/apache/airflow/issues/46805
### Apache Airflow version
Other Airflow 2 version (please specify below)
### If "Other Airflow 2 version" selected, which one?
v2.10.1
### What happened?
Currently I have following metrics missing from statsd (mapping samples):
mappings ---
```
- labels:
airflow_id: $1
dag_id: $2
match: '*.dagrun.duration.success.*'
match_metric_type: observer
name: af_agg_dagrun_duration_success
- labels:
airflow_id: $1
dag_id: $2
match: '*.dagrun.duration.failed.*'
match_metric_type: observer
name: af_agg_dagrun_duration_failed
- labels:
airflow_id: $1
dag_id: $2
task_id: $3
match: '*.dag.*.*.duration'
match_metric_type: observer
name: af_agg_dag_task_duration
- labels:
airflow_id: $1
dag_id: $2
match: '*.dagrun.schedule_delay.*'
match_metric_type: observer
name: af_agg_dagrun_schedule_delay
```
executor = LocalExecutor
statsd-exporter:v0.26.1
Metrics configuration in airflow.cfg
```
[metrics]
statsd_on = True
statsd_host = localhost
statsd_port = 8125
statsd_prefix = airflow
metrics_use_pattern_match = True
```
### What you think should happen instead?
It will expose these metrics as well which is required for Airflow DAGs Grafana dashboard
### How to reproduce
Simply exposed metrics from airflow and then scrape it using prometheus
### Operating System
VERSION="22.04.5 LTS (Jammy Jellyfish)"
### Versions of Apache Airflow Providers
_No response_
### Deployment
Other
### Deployment details
python package installed on aws ec2 instance
### Anything else?
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [x] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Metrics missing in v2.10.1 [airflow]
Posted by "ubaid-sh (via GitHub)" <gi...@apache.org>.
ubaid-sh commented on issue #46805:
URL: https://github.com/apache/airflow/issues/46805#issuecomment-2812583401
My airflow version is `2.10.3`. I use opentelemetry collector as the exporter. I am observing a weird issue where I can see airflow sending metrics `*.dagrun.duration.success.*` only for `run_type: Str(scheduled)`. I would like to have the same metric `*.dagrun.duration.success.*` for manual dag runs as well, i.e. for `run_type: Str(manual)`. I have checked this in the output of otel collector (with a debug exporter enabled).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Metrics missing in v2.10.1 [airflow]
Posted by "boring-cyborg[bot] (via GitHub)" <gi...@apache.org>.
boring-cyborg[bot] commented on issue #46805:
URL: https://github.com/apache/airflow/issues/46805#issuecomment-2661517000
Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Metrics missing in v2.10.1 [airflow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #46805:
URL: https://github.com/apache/airflow/issues/46805#issuecomment-5324884925
This issue has been closed because it has not received response from the issue author.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Metrics missing in v2.10.1 [airflow]
Posted by "iamhritik (via GitHub)" <gi...@apache.org>.
iamhritik commented on issue #46805:
URL: https://github.com/apache/airflow/issues/46805#issuecomment-2692561542
any update on this ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Metrics missing in v2.10.1 [airflow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #46805:
URL: https://github.com/apache/airflow/issues/46805#issuecomment-5010418649
This issue has been automatically marked as stale because it has been open for 365 days without any activity. There has been several Airflow releases since last activity on this issue. Kindly asking to recheck the report against latest Airflow version and let us know if the issue is reproducible. The issue will be closed in next 30 days if no further activity occurs from the issue author.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Metrics missing in v2.10.1 [airflow]
Posted by "akshith-yalla (via GitHub)" <gi...@apache.org>.
akshith-yalla commented on issue #46805:
URL: https://github.com/apache/airflow/issues/46805#issuecomment-2720071254
> any update on this ?
Hi @iamhritik, I'm able to replicate this issue, and I want to work on this issue. Can you please assign it to me?
Thank you!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Metrics missing in v2.10.1 [airflow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #46805: Metrics missing in v2.10.1
URL: https://github.com/apache/airflow/issues/46805
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org