You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2019/01/23 10:10:13 UTC

[GitHub] ashb edited a comment on issue #4396: [WIP][AIRFLOW-3585] - Add edges to database

ashb edited a comment on issue #4396: [WIP][AIRFLOW-3585] - Add edges to database
URL: https://github.com/apache/airflow/pull/4396#issuecomment-456743947
 
 
   > @ashb: Maybe I even have a much better idea. Versioned graphs. Meaning, storing the graph only if it was been changed comparing to the last run.
   > 
   >     * Add graph id/version to DagRun
   > 
   >     * Change execution_date -> graph_id in DagEdge
   > 
   > 
   > This is not such a hard change. The good thing here is that be can detect graph change and less data is stored in the database.
   
   @ffinfo I like the idea of Versioned graphs - and storing it once per dag run when it hasn't changed seems wasteful? But as Fokko says that may be more complex so..

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services