You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by "Kaxil Naik (Jira)" <ji...@apache.org> on 2019/12/17 23:24:00 UTC

[jira] [Updated] (AIRFLOW-5943) DAG Serialization & DB Persistence

     [ https://issues.apache.org/jira/browse/AIRFLOW-5943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kaxil Naik updated AIRFLOW-5943:
--------------------------------
    Fix Version/s:     (was: 1.10.7)
                       (was: 2.0.0)

> DAG Serialization & DB Persistence
> ----------------------------------
>
>                 Key: AIRFLOW-5943
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-5943
>             Project: Apache Airflow
>          Issue Type: Epic
>          Components: core
>    Affects Versions: 1.10.5, 1.10.6
>            Reporter: Kaxil Naik
>            Assignee: Kaxil Naik
>            Priority: Major
>
> This Epic aims to decouple Webserver from having to parse the DAG files. Short-term Scheduler will parse the DAG files and persist it in DB. Longer term we would have a new airflow component "Serializer"/"Parser" that would be the component parsing DAG files, serializing DAG objects and persisting it to DB. This would be the Webserver & Scheduler would not need access to DAG files.
> More details Implementing AIP-24: https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-24+DAG+Persistence+in+DB+using+JSON+for+Airflow+Webserver+and+%28optional%29+Scheduler



--
This message was sent by Atlassian Jira
(v8.3.4#803005)