You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2020/03/29 15:32:49 UTC

[GitHub] [airflow] dimberman opened a new issue #7965: Tasks getting Queued when Pool is full sometimes never run

dimberman opened a new issue #7965: Tasks getting Queued when Pool is full sometimes never run
URL: https://github.com/apache/airflow/issues/7965
 
 
   
   
   **Apache Airflow version**: 1.8.0
   
   Ticket was created 14/Nov/16 20:24
   
   **Kubernetes version (if you are using kubernetes)** (use `kubectl version`):
   
   **Environment**:
   
   - **Cloud provider or hardware configuration**:
   - **OS** (e.g. from /etc/os-release):
   - **Kernel** (e.g. `uname -a`):
   - **Install tools**:
   - **Others**:
   **What happened**:
   
   Log data when this happens:
   [2016-11-14 10:54:04,174] 
   {models.py:168}
    INFO - Filling up the DagBag from /opt/efs/airflow/dags/crawl_traffic_prod.py
   [2016-11-14 10:54:07,562] 
   {base_hook.py:67}
    INFO - Using connection to: db.xyz.com
   [2016-11-14 10:54:07,667] 
   {base_hook.py:67}
    INFO - Using connection to: db.xyz.com
   [2016-11-14 10:54:27,214] 
   {models.py:168}
    INFO - Filling up the DagBag from /opt/efs/airflow/dags/crawl_traffic_prod.py
   [2016-11-14 10:54:30,150] 
   {base_hook.py:67}
    INFO - Using connection to: db.xyz.com
   [2016-11-14 10:54:30,311] 
   {base_hook.py:67}
    INFO - Using connection to: db.xyz.com
   [2016-11-14 10:54:32,438] 
   {models.py:1072}
    INFO - Dependencies all met for <TaskInstance: crawl_traffic_prod_pod.orgs_beginning_with_350 2016-11-13 01:00:00 [queued]>
   [2016-11-14 10:54:32,700] 
   {models.py:1069}
    WARNING - Dependencies not met for <TaskInstance: crawl_traffic_prod_pod.orgs_beginning_with_350 2016-11-13 01:00:00 [queued]>, dependency 'DAG's Pool Has Space' FAILED: Task's pool 'prod_pod_crawler' is full.
   
   Task Details info:
   depends_on_past	False
   deps	set([<TIDep(Not In Retry Period)>, <TIDep(Trigger Rule)>, <TIDep(Previous Dagrun State)>])
   
   **What you expected to happen**:
   
   
   **How to reproduce it**:
   
   
   **Anything else we need to know**:
   
   Moved here from https://issues.apache.org/jira/browse/AIRFLOW-627
       

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services