You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Nadeem Ahmed Nazeer (JIRA)" <ji...@apache.org> on 2016/08/08 22:10:20 UTC

[jira] [Created] (AIRFLOW-401) scheduler gets stuck without a trace

Nadeem Ahmed Nazeer created AIRFLOW-401:
-------------------------------------------

             Summary: scheduler gets stuck without a trace
                 Key: AIRFLOW-401
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-401
             Project: Apache Airflow
          Issue Type: Bug
          Components: executor, scheduler
    Affects Versions: Airflow 1.7.1.3
            Reporter: Nadeem Ahmed Nazeer
            Priority: Minor


The scheduler gets stuck without a trace or error. When this happens, the CPU usage of scheduler service is at 100%. No jobs get submitted and everything comes to a halt. 
The only way I could make it run again is by manually restarting the scheduler service. But again, after running some tasks it gets stuck. I've tried with both Celery and Local executors but same issue occurs. I am using the -n 3 parameter while starting scheduler. 

Scheduler configs,
job_heartbeat_sec = 5
scheduler_heartbeat_sec = 5
executor = LocalExecutor
parallelism = 32




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)