[GitHub] ashb commented on issue #4396: [WIP][AIRFLOW-3585] - Add edges to database

[GitBox <gi...@apache.org>]

ashb commented on issue #4396: [WIP][AIRFLOW-3585] - Add edges to database
URL: https://github.com/apache/airflow/pull/4396#issuecomment-456743947
 
 
   > @ashb: Maybe I even have a much better idea. Versioned graphs. Meaning, storing the graph only if it was been changed comparing to the last run.
   > 
   >     * Add graph id/version to DagRun
   > 
   >     * Change execution_date -> graph_id in DagEdge
   > 
   > 
   > This is not such a hard change. The good thing here is that be can detect graph change and less data is stored in the database.
   
   @ffinfo I like the idea of Versioned graphs - and storing it once per dag run when it hasn't changed seems wasteful?

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services