You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Dan Davydov (JIRA)" <ji...@apache.org> on 2018/01/09 23:33:00 UTC
[jira] [Updated] (AIRFLOW-1980) Scheduler DB Queries Should be
Batched
[ https://issues.apache.org/jira/browse/AIRFLOW-1980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dan Davydov updated AIRFLOW-1980:
---------------------------------
Description:
DB queries in the scheduler should be batched, since the larger ones can get quite big and cause lock wait timeouts.
One example is the queries in the _change_state_for_tis_without_dagrun function in jobs.py
The orphan task cleanup is another such piece of code that should have the queries done in batch.
was:
DB queries in the scheduler should be batched, since the larger ones can get quite big and cause lock wait timeouts.
One example is the queries in the _change_state_for_tis_without_dagrun function in jobs.py
The orphan task cleanup is another such piece of code.
> Scheduler DB Queries Should be Batched
> --------------------------------------
>
> Key: AIRFLOW-1980
> URL: https://issues.apache.org/jira/browse/AIRFLOW-1980
> Project: Apache Airflow
> Issue Type: Bug
> Components: scheduler
> Reporter: Dan Davydov
>
> DB queries in the scheduler should be batched, since the larger ones can get quite big and cause lock wait timeouts.
> One example is the queries in the _change_state_for_tis_without_dagrun function in jobs.py
> The orphan task cleanup is another such piece of code that should have the queries done in batch.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)