[airflow] branch main updated: scheduler_job, add metric for scheduler loop timer (#27605)

[po...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

potiuk pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git


The following commit(s) were added to refs/heads/main by this push:
     new b717853e4c scheduler_job, add metric for scheduler loop timer (#27605)
b717853e4c is described below

commit b717853e4c17d67f8ea317536c98c7416eb080ca
Author: Michael Petro <40...@users.noreply.github.com>
AuthorDate: Thu Nov 17 12:00:10 2022 -0500

    scheduler_job, add metric for scheduler loop timer (#27605)
---
 airflow/jobs/scheduler_job.py                      | 2 +-
 docs/apache-airflow/logging-monitoring/metrics.rst | 1 +
 2 files changed, 2 insertions(+), 1 deletion(-)

diff --git a/airflow/jobs/scheduler_job.py b/airflow/jobs/scheduler_job.py
index 413bdf2fb8..eba3c27831 100644
--- a/airflow/jobs/scheduler_job.py
+++ b/airflow/jobs/scheduler_job.py
@@ -849,7 +849,7 @@ class SchedulerJob(BaseJob):
             )
 
         for loop_count in itertools.count(start=1):
-            with Stats.timer() as timer:
+            with Stats.timer("scheduler.scheduler_loop_duration") as timer:
 
                 if self.using_sqlite and self.processor_agent:
                     self.processor_agent.run_single_parsing_loop()
diff --git a/docs/apache-airflow/logging-monitoring/metrics.rst b/docs/apache-airflow/logging-monitoring/metrics.rst
index a5baa902d0..e81e10cab2 100644
--- a/docs/apache-airflow/logging-monitoring/metrics.rst
+++ b/docs/apache-airflow/logging-monitoring/metrics.rst
@@ -161,6 +161,7 @@ Name                                                Description
                                                     start date and the actual DagRun start date
 ``scheduler.critical_section_duration``             Milliseconds spent in the critical section of scheduler loop --
                                                     only a single scheduler can enter this loop at a time
+``scheduler.scheduler_loop_duration``               Milliseconds spent running one scheduler loop
 ``dagrun.<dag_id>.first_task_scheduling_delay``     Seconds elapsed between first task start_date and dagrun expected start
 ``collect_db_dags``                                 Milliseconds taken for fetching all Serialized Dags from DB
 =================================================== ========================================================================