[jira] [Created] (AIRFLOW-2763) No precheck mechanism in place during worker initialisation for the connection to metadata database

["Aishwarya Mohan (JIRA)" <ji...@apache.org>]

Aishwarya Mohan created AIRFLOW-2763:
----------------------------------------

             Summary: No precheck mechanism in place during worker initialisation for the connection to metadata database
                 Key: AIRFLOW-2763
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2763
             Project: Apache Airflow
          Issue Type: Improvement
          Components: db, worker
            Reporter: Aishwarya Mohan
            Assignee: Aishwarya Mohan


Currently when airflow worker is started, no initialization check is in place to see if the connection to metadata database is healthy or not. The worker threads remain alive(after throwing exceptions - OperationalError) leading to a misconception that the worker is up and running the tasks allocated. 

In the case of worker interaction with the broker, a reconnection mechanism exists the exits the worker  due to timeout operational error if it failed to establish connection within the configured number of attempts(connection_max_retries).

An exit/shutdown mechanism needs to be included during worker initialization incase the connection to  metadata DB is not established. This will assure the airflow users that the connection to database is in place before they proceed with task scheduling.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)