[jira] [Commented] (AIRFLOW-2762) Parallelize DAG parsing in webserver

["Ash Berlin-Taylor (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/AIRFLOW-2762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16547040#comment-16547040 ] 

Ash Berlin-Taylor commented on AIRFLOW-2762:
--------------------------------------------

Webserver should probably look at the DagModel/"ORM" dag only. Though we should give some though to the "getting started"/demo flow where you run the webserver first (and haven't yet run a scheduler) and the dags table will be empty.

> Parallelize DAG parsing in webserver
> ------------------------------------
>
>                 Key: AIRFLOW-2762
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2762
>             Project: Apache Airflow
>          Issue Type: Improvement
>            Reporter: Kevin Yang
>            Priority: Major
>
> Currently the webserver parses DagBag in a single thread fashion and causes the start up time to be slow when we have large # of DAG files. Webservers should not need the actual DAG object and this should be parallelized.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)