You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by "Kaxil Naik (Jira)" <ji...@apache.org> on 2020/03/17 19:13:00 UTC

[jira] [Updated] (AIRFLOW-5948) Replace SimpleDag with serialized version

     [ https://issues.apache.org/jira/browse/AIRFLOW-5948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kaxil Naik updated AIRFLOW-5948:
--------------------------------
    Description: 
Replace SimpleDag with serialized version (json over multiprocessing) in SchedulerJob etc., no other change in scheduler behaviour. (This doesn't make sense long term, but does tidy up the code)

Currently, we have 2 Serialized Representation:

SimpleDags (were created because SimpleDags were not pickleable)
Serialized DAG
We should remove SimpleDags

  was:Replace SimpleDag with serialized version (json over multiprocessing) in SchedulerJob etc., no other change in scheduler behaviour. (This doesn't make sense long term, but does tidy up the code)


> Replace SimpleDag with serialized version
> -----------------------------------------
>
>                 Key: AIRFLOW-5948
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-5948
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: core, scheduler
>    Affects Versions: 2.0.0, 1.10.7
>            Reporter: Kaxil Naik
>            Assignee: Kaxil Naik
>            Priority: Critical
>              Labels: dag-serialization
>
> Replace SimpleDag with serialized version (json over multiprocessing) in SchedulerJob etc., no other change in scheduler behaviour. (This doesn't make sense long term, but does tidy up the code)
> Currently, we have 2 Serialized Representation:
> SimpleDags (were created because SimpleDags were not pickleable)
> Serialized DAG
> We should remove SimpleDags



--
This message was sent by Atlassian Jira
(v8.3.4#803005)