[GitHub] [skywalking] potiuk commented on issue #10341: [Feature] Setup dashboard for Airflow monitoring

["potiuk (via GitHub)" <gi...@apache.org>]

potiuk commented on issue #10341:
URL: https://github.com/apache/skywalking/issues/10341#issuecomment-1427239675

   Not much time to help (catching up with some stuff) , but from what it is worth - statsd of Airflow is not the "best" to consume for Skywalking - unforatunately you'd indeed need to parse the metric name and while I am not sure how OTEL processor might work, regexp approach might be a good idea.
   
   However just to give you perspective - Airflow's metrics are evolving.
   
   Quite recently (coming in next version of Airflow)  - 2.6 most likely  @hussein-awala improved Statsd metrics with DataDog metadata tags -  https://github.com/apache/airflow/pull/28961  and maybe, rather than focusing on pure statsd metrics you could integrate those.
   
   Also - a bit more long term - In Airlfow we already approved Open Telemetry support for Airflow https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-49+OpenTelemetry+Support+for+Apache+Airflow and we even have a chance to progress with the implementation - @feruzzi is looking into the integration and even is adding better support for Airflow's statsd metrics testing in Breeze (Airflow development environment) with Grafana and Prometheus - https://github.com/apache/airflow/pull/29449
   
   So maybe it could be a nice teamwork.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org