You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2018/10/23 09:28:56 UTC
[GitHub] ashb commented on issue #4083: [AIRFLOW-3211] Reattach to GCP
Dataproc jobs upon Airflow restart
ashb commented on issue #4083: [AIRFLOW-3211] Reattach to GCP Dataproc jobs upon Airflow restart
URL: https://github.com/apache/incubator-airflow/pull/4083#issuecomment-432170898
This PR seems sensible - though I would have fixed this by changing your deploy process to not kill your workers - you don't need to do that to pick up the latest version of DAGs.
(Airflow is very careful to not load DAG definitions in to any long running process, so each time a task form a dag runs it will pick up the latest definition from disk)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services