You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Daniel Imberman (Jira)" <ji...@apache.org> on 2020/03/29 15:33:00 UTC
[jira] [Commented] (AIRFLOW-627) Tasks getting Queued when Pool is
full sometimes never run
[ https://issues.apache.org/jira/browse/AIRFLOW-627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17070397#comment-17070397 ]
Daniel Imberman commented on AIRFLOW-627:
-----------------------------------------
This issue has been moved to https://github.com/apache/airflow/issues/7965
> Tasks getting Queued when Pool is full sometimes never run
> ----------------------------------------------------------
>
> Key: AIRFLOW-627
> URL: https://issues.apache.org/jira/browse/AIRFLOW-627
> Project: Apache Airflow
> Issue Type: Bug
> Components: scheduler
> Affects Versions: 1.8.0
> Environment: Celery Executor, Master Branch, Postgres
> Reporter: Ben Tallman
> Priority: Major
>
> Log data when this happens:
> [2016-11-14 10:54:04,174] {models.py:168} INFO - Filling up the DagBag from /opt/efs/airflow/dags/crawl_traffic_prod.py
> [2016-11-14 10:54:07,562] {base_hook.py:67} INFO - Using connection to: db.xyz.com
> [2016-11-14 10:54:07,667] {base_hook.py:67} INFO - Using connection to: db.xyz.com
> [2016-11-14 10:54:27,214] {models.py:168} INFO - Filling up the DagBag from /opt/efs/airflow/dags/crawl_traffic_prod.py
> [2016-11-14 10:54:30,150] {base_hook.py:67} INFO - Using connection to: db.xyz.com
> [2016-11-14 10:54:30,311] {base_hook.py:67} INFO - Using connection to: db.xyz.com
> [2016-11-14 10:54:32,438] {models.py:1072} INFO - Dependencies all met for <TaskInstance: crawl_traffic_prod_pod.orgs_beginning_with_350 2016-11-13 01:00:00 [queued]>
> [2016-11-14 10:54:32,700] {models.py:1069} WARNING - Dependencies not met for <TaskInstance: crawl_traffic_prod_pod.orgs_beginning_with_350 2016-11-13 01:00:00 [queued]>, dependency 'DAG's Pool Has Space' FAILED: Task's pool 'prod_pod_crawler' is full.
> Task Details info:
> depends_on_past False
> deps set([<TIDep(Not In Retry Period)>, <TIDep(Trigger Rule)>, <TIDep(Previous Dagrun State)>])
--
This message was sent by Atlassian Jira
(v8.3.4#803005)