Dumping DAGs

[Andy Welch <aw...@nerdwallet.com>]

Aloha!

I'm working on a PR that will allow for dumping the configuration of a DAG
to a json record, such that my team can run analytics on the resulting
structure.  I'm modifying cli.py's list_tasks command, adding an option to
request such.  I thought that it's best to dump from Airflow's internal
model rather than trying to emulate how it (allows for) dynamic dag
creation.

Please advise if there is history around this or major objections,
otherwise, I'll be sending along a PR as per the Contributor's Guide.

Thanks for making Airflow open source :)

-- 
*Andy Welch*
awelch@nerdwallet.com
<http://www.nerdwallet.com/?trk=emaiL_sig>
<https://www.facebook.com/NerdWallet>
<https://www.linkedin.com/company/2029368>
<https://twitter.com/NerdWallet> (415)
549-8913
901 Market Street
San Francisco, CA 94103

Providing clarity for all of life's financial decisions

Re: Dumping DAGs

[Bolke de Bruin <bd...@gmail.com>]

Please make sure to code it as an API endpoint (see trigger_dag as an example). Just changing the cli won't be enough to get the pr accepted. 

Yes that would ask you to refactor list_tasks. 

Bolke

Sent from my iPhone

> On 22 Feb 2017, at 00:17, Andy Welch <aw...@nerdwallet.com> wrote:
> 
> Aloha!
> 
> I'm working on a PR that will allow for dumping the configuration of a DAG
> to a json record, such that my team can run analytics on the resulting
> structure.  I'm modifying cli.py's list_tasks command, adding an option to
> request such.  I thought that it's best to dump from Airflow's internal
> model rather than trying to emulate how it (allows for) dynamic dag
> creation.
> 
> Please advise if there is history around this or major objections,
> otherwise, I'll be sending along a PR as per the Contributor's Guide.
> 
> Thanks for making Airflow open source :)
> 
> -- 
> *Andy Welch*
> awelch@nerdwallet.com
> <http://www.nerdwallet.com/?trk=emaiL_sig>
> <https://www.facebook.com/NerdWallet>
> <https://www.linkedin.com/company/2029368>
> <https://twitter.com/NerdWallet> (415)
> 549-8913
> 901 Market Street
> San Francisco, CA 94103
> 
> Providing clarity for all of life's financial decisions