You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2021/02/21 18:20:11 UTC
[GitHub] [airflow] norfe commented on issue #14261: Airflow Scheduler liveness probe crashing (version 2.0)
norfe commented on issue #14261:
URL: https://github.com/apache/airflow/issues/14261#issuecomment-782901575
I'm seeing a similar issue when trying to run airflow on minikube.
```
$ minikube version
minikube version: v1.17.1
$ kubectl version
Client Version: version.Info{Major:"1", Minor:"19", GitVersion:"v1.19.3", GitCommit:"1e11e4a2108024935ecfcb2912226cedeafd99df", GitTreeState:"clean", BuildDate:"2020-10-14T12:50:19Z", GoVersion:"go1.15.2", Compiler:"gc", Platform:"darwin/amd64"}
Server Version: version.Info{Major:"1", Minor:"20", GitVersion:"v1.20.2", GitCommit:"faecb196815e248d3ecfb03c680a4507229c2a56", GitTreeState:"clean", BuildDate:"2021-01-13T13:20:00Z", GoVersion:"go1.15.5", Compiler:"gc", Platform:"linux/amd64"}
```
I can reproduce it always with:
```
$ minikube delete
$ minikube start
$ curl -OL https://github.com/apache/airflow/archive/master.zip
$ unzip master.zip
$ helm dep update airflow-master/chart/
$ helm install airflow ./airflow-master/chart
```
After running for a while, scheduler restarts periodically:
```
$ kubectl get pods
NAME READY STATUS RESTARTS AGE
airflow-postgresql-0 1/1 Running 0 17m
airflow-scheduler-5567f545c8-qv7cg 2/2 Running 3 17m
airflow-statsd-5556dc96bc-twbz9 1/1 Running 0 17m
airflow-webserver-65cc966d7c-68wnv 1/1 Running 0 17m
```
```
$ kubectl describe pod airflow-scheduler-5567f545c8-qv7cg
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 18m default-scheduler Successfully assigned default/airflow-scheduler-5567f545c8-qv7cg to minikube
Normal Pulling 18m kubelet Pulling image "apache/airflow:2.0.0"
Normal Pulled 17m kubelet Successfully pulled image "apache/airflow:2.0.0" in 42.1015082s
Normal Created 17m kubelet Created container wait-for-airflow-migrations
Normal Started 17m kubelet Started container wait-for-airflow-migrations
Normal Started 16m kubelet Started container scheduler-gc
Normal Pulled 16m kubelet Container image "apache/airflow:2.0.0" already present on machine
Normal Created 16m kubelet Created container scheduler-gc
Normal Killing 11m kubelet Container scheduler failed liveness probe, will be restarted
Normal Pulled 11m (x2 over 16m) kubelet Container image "apache/airflow:2.0.0" already present on machine
Normal Started 11m (x2 over 16m) kubelet Started container scheduler
Normal Created 11m (x2 over 16m) kubelet Created container scheduler
Warning Unhealthy 3m20s (x27 over 16m) kubelet Liveness probe failed:
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org