You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2020/03/31 08:51:12 UTC

[GitHub] [airflow] abhijit-kottur commented on issue #7935: scheduler gets stuck without a trace

abhijit-kottur commented on issue #7935: scheduler gets stuck without a trace
URL: https://github.com/apache/airflow/issues/7935#issuecomment-606489074
 
 
   I'm running Airflow 1.10.4 as Celery in k8s. The scheduler pod is getting stuck while starting up at the step 'Resetting orphaned tasks'. 
   
   ```
   [2020-03-31 19:34:36,955] {{__init__.py:51}} INFO - Using executor CeleryExecutor
     ____________       _____________
    ____    |__( )_________  __/__  /________      __
   ____  /| |_  /__  ___/_  /_ __  /_  __ \_ | /| / /
   ___  ___ |  / _  /   _  __/ _  / / /_/ /_ |/ |/ /
    _/_/  |_/_/  /_/    /_/    /_/  \____/____/|__/
   [2020-03-31 19:34:37,533] {{scheduler_job.py:1288}} INFO - Starting the scheduler
   [2020-03-31 19:34:37,534] {{scheduler_job.py:1296}} INFO - Running execute loop for -1 seconds
   [2020-03-31 19:34:37,534] {{scheduler_job.py:1297}} INFO - Processing each file at most -1 times
   [2020-03-31 19:34:37,535] {{scheduler_job.py:1300}} INFO - Searching for files in /usr/local/airflow/dags
   [2020-03-31 19:34:38,124] {{scheduler_job.py:1302}} INFO - There are 39 files in /usr/local/airflow/dags
   [2020-03-31 19:34:38,124] {{scheduler_job.py:1349}} INFO - Resetting orphaned tasks for active dag runs
   ```
   
   This causes the UI to say 
   
   > The scheduler does not appear to be running. Last heartbeat was received 5 minutes ago
   
   The same thing happens even after restarting the scheduler pod. (regardless of the CPU usage)
   
   Any leads to solve this?

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services