You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "cbuffett (via GitHub)" <gi...@apache.org> on 2024/01/10 00:41:14 UTC
[I] Support writing custom DAG tags in metrics [airflow]
cbuffett opened a new issue, #36704:
URL: https://github.com/apache/airflow/issues/36704
### Description
With the ability to include tags for both Datadog and Telegraf metrics, it doesn't currently appear possible to include any custom tags defined on the DAG as part of those metrics. Telegraf for instance, supports including arbitrary key/value pairs as part of the metric name, but the set of tags that are included are limited, e.g., TaskInstance includes only `dag_id` and `task_id`
### Use case/motivation
We include several metadata tags in our DAGs that we'd like to use as filters within our TIG stack, for example things like environment or stakeholder. One idea would be to modify DAG tags to add support for a dictionary and then use those tags wherever metrics are emitted.
### Related issues
_No response_
### Are you willing to submit a PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Support writing custom DAG tags in metrics [airflow]
Posted by "dirrao (via GitHub)" <gi...@apache.org>.
dirrao commented on issue #36704:
URL: https://github.com/apache/airflow/issues/36704#issuecomment-1884750795
@cbuffett
It is a big feature request and it requires a discussion. So, converting it to a discussion.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Support writing custom DAG tags in metrics [airflow]
Posted by "dirrao (via GitHub)" <gi...@apache.org>.
dirrao closed issue #36704: Support writing custom DAG tags in metrics
URL: https://github.com/apache/airflow/issues/36704
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Support writing custom DAG tags in metrics [airflow]
Posted by "dirrao (via GitHub)" <gi...@apache.org>.
dirrao commented on issue #36704:
URL: https://github.com/apache/airflow/issues/36704#issuecomment-1884728953
@cbuffett
Yes, this is a good idea.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org