You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2020/10/05 20:52:26 UTC

[GitHub] [airflow] nikste commented on issue #7907: End-to-end DAG testing

nikste commented on issue #7907:
URL: https://github.com/apache/airflow/issues/7907#issuecomment-703882074


   Sorry, this somehow drowned in other messages.
   So, I have a DAG and some specified input, and i expect a certain output. I want to run all operators end to end.
   
   Currently I'm trying to write some unit test in python that will mock over the some configuration,
   and then I also want to overwrite some input paramters in `dag_run.conf`. 
   This seems to be super cumbersome, since i did not find a way yet to both mock `Variables.get, `BaseHook.get_connection` and trigger a dag in the python unit test, where i can specify the `dag_run.conf`.
   Is there some further documentation on how Airflow works internally (I'm suspecting it starts different processes that overwrite the mocks?) 
   Or maybe I'm just not doing this the way it was intended to be done?  


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org