[GitHub] amichai07 opened a new pull request #4614: Decreasing scheduler delay between tasks

[GitBox <gi...@apache.org>]

amichai07 opened a new pull request #4614:  Decreasing scheduler delay between tasks
URL: https://github.com/apache/airflow/pull/4614
 
 
   ### Jira
   -  My PR addresses the following https://issues.apache.org/jira/browse/AIRFLOW-3607 and references them in the PR title
     - Decreasing scheduler delay between tasks
   
   
   ### Description
   -  The delay between tasks can be a major issue, especially when we have dags with many subdags, 
      figures out that the scheduling process spends plenty of time in dependency checking,  we took the 
      trigger rule dependency which calls the db for each task instance,  we made it call the db just once for 
      each dag_run. 
    
   
   ### Tests
   -  My PR does not need extra testing for this extremely good reason:
   My pr uses the code from the  and also has a fall back to the original behaviour, the ci covers all of the logic and cases that might happen already
   
   
   ### Commits
   - removed unnecessary queries  - run on each dag run instead of each ti 
   
   
   ### Documentation
   no need for new docs
   
   
   ### Code Quality
   - Passes `flake8`
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services