You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2021/02/25 19:44:13 UTC

[GitHub] [airflow] lewismc commented on issue #14261: Airflow Scheduler liveness probe crashing (version 2.0)

lewismc commented on issue #14261:
URL: https://github.com/apache/airflow/issues/14261#issuecomment-786154745


   We are experiencing this when deploying the chart into a local installations of k3d
   ```
   % kubectl get pods -n airflow-test-local            
   NAME                 READY   STATUS       RESTARTS  AGE
   airflow-statsd-5556dc96bc-w28cz   1/1    Running      0     7m29s
   airflow-postgresql-0         1/1    Running      0     7m29s
   airflow-webserver-7d5fbc5675-x6dc7  1/1    Running      0     7m29s
   airflow-scheduler-7f59d9c69c-5v9pl  2/3    CrashLoopBackOff  7     7m29s
   airflow-cleanup-1614276000-xbcmz   0/1    Completed     0     39s
   airflow-scheduler-7f59d9c69c-cvzvx  2/3    CrashLoopBackOff  7     7m29s
   ```
   We also found some interesting `WARNING`'s when looking into the `wait-for-airflow-migrations` container...
   ```
   % kubectl logs airflow-webserver-7d5fbc5675-x6dc7 -c wait-for-airflow-migrations -n airflow-test-local
   BACKEND=postgresql
   DB_HOST=airflow-postgresql.airflow-test-local.svc.cluster.local
   DB_PORT=5432
   ....
   [2021-02-25 17:53:43,435] {migration.py:163} INFO - Context impl PostgresqlImpl.
   [2021-02-25 17:53:43,436] {migration.py:170} INFO - Will assume transactional DDL.
   [2021-02-25 17:53:49,416] {providers_manager.py:299} WARNING - Exception when importing 'airflow.providers.microsoft.azure.hooks.wasb.WasbHook' from 'apache-airflow-providers-microsoft-azure' package: No module named 'azure.storage.blob'
   [2021-02-25 17:53:50,300] {providers_manager.py:299} WARNING - Exception when importing 'airflow.providers.microsoft.azure.hooks.wasb.WasbHook' from 'apache-airflow-providers-microsoft-azure' package: No module named 'azure.storage.blob'
   [2021-02-25 17:53:51,345] {<string>:35} INFO - Waiting for migrations... 1 second(s)
   [2021-02-25 17:53:52,349] {<string>:35} INFO - Waiting for migrations... 2 second(s)
   [2021-02-25 17:53:53,352] {<string>:35} INFO - Waiting for migrations... 3 second(s)
   [2021-02-25 17:53:54,355] {<string>:35} INFO - Waiting for migrations... 4 second(s)
   [2021-02-25 17:53:55,358] {<string>:35} INFO - Waiting for migrations... 5 second(s)
   echiu@MT-308022 chart %
   ```
   I don't think that Azure hooks should be interpreted by default... 


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org