[GitHub] [airflow] collinmcnulty commented on pull request #19637: Trigger DAG re-serialization after upgrade

[GitBox <gi...@apache.org>]

collinmcnulty commented on pull request #19637:
URL: https://github.com/apache/airflow/pull/19637#issuecomment-973172102


   I unfortunately do not have logs. I have encountered three kinds of scenarios where clearing the serialized dag representations was required, but the latter two seem to be fixed in 2.2:
   
   - Incompatibilities related to the 2.2 upgrade, as has been thoroughly discussed
   - When DAG authors have made changes to working DAGs such that they no longer parse correctly. The effect of this has been lessened significantly by surfacing the DAG import error on the individual DAG view. 
   - For dynamically generated DAGs, some authors I've worked with wanted only the currently existing DAGs to show up in the UI, but dags that were previously generated and serialized still showed up. This could be dozens of DAGs
   
   Having thought about it more, I'm no longer in favor of reserializing on upgrade as I don't want to have to start caveating advising people to upgrade (needing maintenance downtime windows, etc.) I'll update my original Issue to reflect my evolution in opinion.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org