You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by "Peter van 't Hof (JIRA)" <ji...@apache.org> on 2018/12/24 12:37:00 UTC

[jira] [Created] (AIRFLOW-3562) Remove DagBag dependency inside the webserver

Peter van 't Hof created AIRFLOW-3562:
-----------------------------------------

             Summary: Remove DagBag dependency inside the webserver
                 Key: AIRFLOW-3562
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-3562
             Project: Apache Airflow
          Issue Type: Improvement
          Components: webserver
    Affects Versions: 1.10.1, 1.10.0
            Reporter: Peter van 't Hof


Currently the webserver does depend on the dag directory and reparsing the dag files. Because this happens with gunicorn each process has there own DagBag. The means the webserver is statefull and depending which process is assigned a request the information can be changed. If all information will come from the database this will not happen. The only process that should add dag/dagruns is the scheduler.

The webserver should have enough on only the database. Currently not all information is already in the database. This could be fixable, already started this in  AIRFLOW-3561.

I do notice this might give some conflicts with the brace change that is coming. Any suggestion how to approach this?

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)