[GitHub] drewsonne edited a comment on issue #4531: [WIP] Add dag source plugin hooks

[GitBox <gi...@apache.org>]

drewsonne edited a comment on issue #4531: [WIP] Add dag source plugin hooks
URL: https://github.com/apache/airflow/pull/4531#issuecomment-454308596
 
 
   This doesn't assume DAGs are plugins, and although it would be easier for this specific functionality, yes, if someone wanted to:
    - to load dags from (for example) S3, GCP Cloud Storage, Azure Blob Storage (using the built in hooks);
    - integration with say, https://github.com/wooga/airconditioner without mixing yaml *and* python for dag definitions; 
    - tighter integration with https://github.com/python-bonobo/bonobo
    - or as an intermediary step to handle some automatic lineage injection on DAG load
   
   then we need new PRs for each of those pieces of functionality and wait for the release cycle, unless we're building airflow from src in our prod env's.
   
   If this (eventually, after I clean the PR up) is approved, the next step is a built-in plugin to load DAGs from entrypoints.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services