You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2020/12/23 11:36:30 UTC
[GitHub] [airflow] dstandish commented on issue #13263: CeleryKubernetesExecutor appears to be broken
dstandish commented on issue #13263:
URL: https://github.com/apache/airflow/issues/13263#issuecomment-750188878
Better error message:
```
[2020-12-23 11:33:29,740: ERROR/ForkPoolWorker-2] Failed to execute task daemonic processes are not allowed to have children.
[2020-12-23 11:33:29,750: WARNING/ForkPoolWorker-8] Running <TaskInstance: my_example_bash_operator.also_run_this 2020-12-23T11:19:39.581233+00:00 [queued]> on host airflow-worker-0.airflow-worker.airflow.svc.cluster.local
[2020-12-23 11:33:29,831: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[72e4178f-d55d-4a0a-9c59-45c6cddd8186] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.airflow.svc.cluster.local')
Traceback (most recent call last):
File "/home/airflow/.local/lib/python3.7/site-packages/celery/app/trace.py", line 412, in trace_task
R = retval = fun(*args, **kwargs)
File "/home/airflow/.local/lib/python3.7/site-packages/celery/app/trace.py", line 704, in __protected_call__
return self.run(*args, **kwargs)
File "/home/airflow/.local/lib/python3.7/site-packages/airflow/executors/celery_executor.py", line 87, in execute_command
_execute_in_fork(command_to_exec)
File "/home/airflow/.local/lib/python3.7/site-packages/airflow/executors/celery_executor.py", line 98, in _execute_in_fork
raise AirflowException('Celery command failed on host: ' + get_hostname())
airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.airflow.svc.cluster.local
[2020-12-23 11:33:29,851: WARNING/ForkPoolWorker-1] Running <TaskInstance: my_example_bash_operator.runme_0 2020-12-23T11:19:39.581233+00:00 [queued]> on host airflow-worker-0.airflow-worker.airflow.svc.cluster.local
[2020-12-23 11:33:29,940: ERROR/ForkPoolWorker-8] Failed to execute task daemonic processes are not allowed to have children.
[2020-12-23 11:33:29,978: ERROR/ForkPoolWorker-1] Failed to execute task daemonic processes are not allowed to have children.
[2020-12-23 11:33:30,015: ERROR/ForkPoolWorker-8] Task airflow.executors.celery_executor.execute_command[57945b84-6700-46d9-ad00-03c7cb3e98b3] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.airflow.svc.cluster.local')
Traceback (most recent call last):
File "/home/airflow/.local/lib/python3.7/site-packages/celery/app/trace.py", line 412, in trace_task
R = retval = fun(*args, **kwargs)
File "/home/airflow/.local/lib/python3.7/site-packages/celery/app/trace.py", line 704, in __protected_call__
return self.run(*args, **kwargs)
File "/home/airflow/.local/lib/python3.7/site-packages/airflow/executors/celery_executor.py", line 87, in execute_command
_execute_in_fork(command_to_exec)
File "/home/airflow/.local/lib/python3.7/site-packages/airflow/executors/celery_executor.py", line 98, in _execute_in_fork
raise AirflowException('Celery command failed on host: ' + get_hostname())
airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.airflow.svc.cluster.local
[2020-12-23 11:33:30,042: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f2b39878-d19b-4da1-bc2c-1460f384382e] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.airflow.svc.cluster.local')
Traceback (most recent call last):
File "/home/airflow/.local/lib/python3.7/site-packages/celery/app/trace.py", line 412, in trace_task
R = retval = fun(*args, **kwargs)
File "/home/airflow/.local/lib/python3.7/site-packages/celery/app/trace.py", line 704, in __protected_call__
return self.run(*args, **kwargs)
File "/home/airflow/.local/lib/python3.7/site-packages/airflow/executors/celery_executor.py", line 87, in execute_command
_execute_in_fork(command_to_exec)
File "/home/airflow/.local/lib/python3.7/site-packages/airflow/executors/celery_executor.py", line 98, in _execute_in_fork
raise AirflowException('Celery command failed on host: ' + get_hostname())
airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.airflow.svc.cluster.local
[2020-12-23 11:33:32,303: INFO/MainProcess] Events of group {task} enabled by remote.
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org