[GitHub] [airflow] ags2121 edited a comment on issue #18630: Missing dagrun.duration.success/failed. metric in statsd exporter for airflow deployed on Kubernetes cluster

[GitBox <gi...@apache.org>]

ags2121 edited a comment on issue #18630:
URL: https://github.com/apache/airflow/issues/18630#issuecomment-931339671


   > > HEy @bhupixb - I looked at the code and it seems it might be even fixable without any change to airflow.
   > > We already have https://airflow.apache.org/docs/apache-airflow/stable/configurations-ref.html#statsd-custom-client-path configuration parameter and setting it to `statsd.TCPStatsClient` might solve the problem.
   > > Can you please try it (you need to make sure that your `statsd` accepts TCP connections')?
   > 
   > Will try this and update here.
   
   Curious if this works for you, I'm seeing a similar thing with CeleryExecutor on ECS Fargate/Redis (same set up otherwise). These are the only metrics coming through at the moment, but I expect to see a lot more:
   ```
   airflow.can_connect
   airflow.dagbag_size
   airflow.collect_dags
   airflow.executor.open_slots
   airflow.scheduler_heartbeat
   airflow.dagbag_import_errors
   airflow.executor.queued_tasks
   airflow.executor.running_tasks
   airflow.dag.loading_duration.avg
   airflow.dag.loading_duration.max
   airflow.dag_processing.processes
   airflow.dag.loading_duration.count
   airflow.dag.loading_duration.median
   airflow.dag_processing.import_errors
   check_run.airflow.can_connect.critical
   airflow.dag_processing.last_runtime.avg
   airflow.dag_processing.last_runtime.max
   airflow.dag_processing.total_parse_time
   airflow.dag_processing.last_duration.avg
   airflow.dag_processing.last_duration.max
   airflow.dag.loading_duration.95percentile
   airflow.dag_processing.last_runtime.count
   airflow.dag_processing.last_duration.count
   airflow.dag_processing.last_runtime.median
   airflow.dag_processing.last_duration.median
   airflow.dag_processing.last_run.seconds_ago
   airflow.dag_processing.last_runtime.95percentile
   airflow.dag_processing.last_duration.95percentile
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org