You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@airflow.apache.org by "Cieplucha, Michal" <mi...@intel.com> on 2017/07/13 07:42:24 UTC

Scheduler hangs after a while on MSSql

Hi,

We have switched to MsSql and scheduler hangs after a while. It is hanging always on heart beating the scheduler, in most cases on that line: https://github.com/apache/incubator-airflow/blob/5fe25d8598b23b8f641911242fad2061dddbfeec/airflow/jobs.py#L158. The database is fresh, there are no deadlocks nor hanging connections. The scheduler is not timeouting it just hangs forever. We have other home-grown apps with sql alchemy that are using same server and we don't see any other app to behave abnormally. Have you seen that issue?

Airflow 1.8.2 RC2 on Ubuntu 14.04, 3x scheduler, 3xworker, 3xwebserver (saw the issue also on 16.04 with sequential executor)
MSSql 2014

Thanks
mC

---------------------------------------------------------------------------------------------------------------------------------
I am an Intel employee. All comments and opinions are my own and do not represent the views of Intel.
--------------------------------------------------------------------

Intel Technology Poland sp. z o.o.
ul. Slowackiego 173 | 80-298 Gdansk | Sad Rejonowy Gdansk Polnoc | VII Wydzial Gospodarczy Krajowego Rejestru Sadowego - KRS 101882 | NIP 957-07-52-316 | Kapital zakladowy 200.000 PLN.

Ta wiadomosc wraz z zalacznikami jest przeznaczona dla okreslonego adresata i moze zawierac informacje poufne. W razie przypadkowego otrzymania tej wiadomosci, prosimy o powiadomienie nadawcy oraz trwale jej usuniecie; jakiekolwiek
przegladanie lub rozpowszechnianie jest zabronione.
This e-mail and any attachments may contain confidential material for the sole use of the intended recipient(s). If you are not the intended recipient, please contact the sender and delete all copies; any review or distribution by
others is strictly prohibited.