[jira] [Created] (AIRFLOW-2385) Airflow task is not stopped when execution timeout gets triggered

["Yohei Onishi (JIRA)" <ji...@apache.org>]

Yohei Onishi created AIRFLOW-2385:
-------------------------------------

             Summary: Airflow task is not stopped when execution timeout gets triggered
                 Key: AIRFLOW-2385
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2385
             Project: Apache Airflow
          Issue Type: Bug
          Components: DAG
    Affects Versions: 1.9.0
            Reporter: Yohei Onishi


I have my own custom operator extends BaseOperator as follows. I tried to kill a task if the task runs for more than 30 minutes. timeout seems to be triggered according to a log but the task still continued.

Am I missing something? I checked the official document but do not know what is wrong.[https://airflow.apache.org/code.html#baseoperator]

My operator is like as follows.
{code:java}
class MyOperator(BaseOperator):
  @apply_defaults
  def __init__(
    self,
    some_parameters_here,
    *args,
    **kwargs):
    super(MyOperator, self).__init__(*args, **kwargs)
    # some initialization here

  def execute(self, context):
    # some code here
{code}
 

{{}}My task is like as follows.
{code:java}
t = MyOperator(
  task_id='task',
  dag=scheduled_dag,
  execution_timeout=timedelta(minutes=30)
{code}
 

I found this error but the task continued.
{code:java}
[2018-04-12 03:30:28,353] {base_task_runner.py:98} INFO - Subtask: [Stage 6:==================================================(1380 + -160) / 1224][2018-04- 12 03:30:28,353] {timeout.py:36} ERROR - Process timed out
{code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)