You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2021/08/13 10:11:07 UTC
[GitHub] [airflow] vengi57 opened a new issue #17602: Scheduler is not working
vengi57 opened a new issue #17602:
URL: https://github.com/apache/airflow/issues/17602
The scheduler does not appear to be running. Last heartbeat was received 2 days ago. The DAGs list may not update, and new tasks will not be scheduled.
Scheduler service is up and running due to unhealthy it cant able to execute any dag runs


--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] vengi57 commented on issue #17602: Scheduler is not working
Posted by GitBox <gi...@apache.org>.
vengi57 commented on issue #17602:
URL: https://github.com/apache/airflow/issues/17602#issuecomment-898576675
I have cross-checked whether the scheduler is running or not but it was running on the background

--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk closed issue #17602: Scheduler is not working
Posted by GitBox <gi...@apache.org>.
potiuk closed issue #17602:
URL: https://github.com/apache/airflow/issues/17602
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] boring-cyborg[bot] commented on issue #17602: Scheduler is not working
Posted by GitBox <gi...@apache.org>.
boring-cyborg[bot] commented on issue #17602:
URL: https://github.com/apache/airflow/issues/17602#issuecomment-898349071
Thanks for opening your first issue here! Be sure to follow the issue template!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #17602: Scheduler is not working
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #17602:
URL: https://github.com/apache/airflow/issues/17602#issuecomment-898582034
I'd recommend you to restart the scheduler and see if it is really "stuck" - the fact that the process is running does not mean that it's "working" - there are many ways things can go wrong.
Have you checked your logs? did you make any investigation what happened? Without any of that, we are not able to help - you need to provide us enough information (and show that you have done investigation). Actually I recommend you to fill-in the template of the issue when you raise the bug (it has all the information on what you need to provide in order to be able to investigate any problems). Can you please gather that information and open a new bug, actually filling all the information, logs and results of your investigation. We are not able to help otherwise - only you have access to your system, only you know how it is configured, only you have access to logs and can investigate it . Only when we see some results of your investigation and when there is an indication that there is a bug in airflow (with reproduction path) we can try to help here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #17602: Scheduler is not working
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #17602:
URL: https://github.com/apache/airflow/issues/17602#issuecomment-898566397
The information you provided are not nearly enough to help you. My wild guess is that you are using Sequential Executor and SQlite with indeed will work this way and make scheduler unhealthy. You should never use it beyond testing if that's the case.
Closing it for now until you provide some more details (in case you are not using the Sequential Executor).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] vengi57 commented on issue #17602: Scheduler is not working
Posted by GitBox <gi...@apache.org>.
vengi57 commented on issue #17602:
URL: https://github.com/apache/airflow/issues/17602#issuecomment-898574720
I was using executor ad LocalExecutor and Postgres as database which modified on airflow.cfg
I was triggering multiple dags one after the other and each dag is a little heavy it will take around 4 to 5 hrs to complete each. In-between scheduler got stuck and I am getting warning messages as "The scheduler does not appear to be running. The last heartbeat was received 2 days ago. The DAGs list may not update, and new tasks will not be scheduled."
So that my next dag get stuck and task on the dag was on in-progress state and cant go further
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org