[GitHub] [airflow] sraviteja07 commented on issue #18041: Tasks intermittently gets terminated with SIGTERM on kubernetes executor

[GitBox <gi...@apache.org>]

sraviteja07 commented on issue #18041:
URL: https://github.com/apache/airflow/issues/18041#issuecomment-1091100989

   We are also facing the same problem and facing the issue with belo stack trace :
   
   **ERROR - Received SIGTERM. Terminating subprocesses.
   ERROR - Task failed with exception
   Traceback (most recent call last):
     File "/usr/local/lib/python3.7/site-packages/airflow/models/taskinstance.py", line 1164, in _run_raw_task
       self._prepare_and_execute_task_with_callbacks(context, task)
     File "/usr/local/lib/python3.7/site-packages/airflow/models/taskinstance.py", line 1282, in _prepare_and_execute_task_with_callbacks
       result = self._execute_task(context, task_copy)
     File "/usr/local/lib/python3.7/site-packages/airflow/models/taskinstance.py", line 1312, in _execute_task
       result = task_copy.execute(context=context)
     File "/usr/local/airflow/dags/flow_airflow/operator/dts_operator.py", line 100, in execute
       self.to_email_address)
     File "/usr/local/airflow/dags/flow_airflow/operator/dts_operator.py", line 111, in run_process
       for line in iter(process.stdout.readline, ""):
     File "/usr/local/lib/python3.7/site-packages/airflow/models/taskinstance.py", line 1237, in signal_handler
       raise AirflowException("Task received SIGTERM signal")
       
       WARNING - process psutil.Process(pid=25806, name='python3', status='zombie', started='20:09:10') did not respond to SIGTERM. Trying SIGKILL
    {process_utils.py:124} ERROR - Process psutil.Process(pid=54556, name='python3', status='zombie', started='20:09:10') (54556) could not be killed. Giving up.**
   
   
   
   We also have thousands of tasks and happens to some intermittently
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org