You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Chandu Kavar (JIRA)" <ji...@apache.org> on 2019/07/10 05:25:00 UTC
[jira] [Comment Edited] (AIRFLOW-2906) DataDog Integration for
Airflow
[ https://issues.apache.org/jira/browse/AIRFLOW-2906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16881743#comment-16881743 ]
Chandu Kavar edited comment on AIRFLOW-2906 at 7/10/19 5:24 AM:
----------------------------------------------------------------
We also need this functionality to collect metrics from multiple airflow instances and aggregate by tags. Currently, we can't send the tags using statsd.
[~ah46657] Is there any progress on this?
was (Author: cckavar):
We also need this functionlities to collect metrics from multiple airflow instances and aggregate by tags. Currently, we can't send the tags using statsd.
Is there any progress on this?
> DataDog Integration for Airflow
> -------------------------------
>
> Key: AIRFLOW-2906
> URL: https://issues.apache.org/jira/browse/AIRFLOW-2906
> Project: Apache Airflow
> Issue Type: Improvement
> Components: utils
> Affects Versions: 1.8.0
> Reporter: Austin Hsu
> Assignee: Austin Hsu
> Priority: Minor
> Labels: metrics
>
> Add functionality to Airflow to enable sending of metrics to DataDog. DataDog provides support for tags which allows us to aggregate data more easily and visualize it. We can utilize the [Datadog python library|https://github.com/DataDog/datadogpy] python library and the [Datadog ThreadStats module|https://datadogpy.readthedocs.io/en/latest/#datadog-threadstats-module] to send metrics directly to DataDog without needing to spin up an agent to forward the metrics. The current implementation in 1.8 uses the statsd library to send the metrics which provides us with much less control to filter our data.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)