You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Michael Lyons (JIRA)" <ji...@apache.org> on 2016/07/15 21:00:22 UTC

[jira] [Commented] (AIRFLOW-338) BackfillJob is deadlocked

    [ https://issues.apache.org/jira/browse/AIRFLOW-338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15380104#comment-15380104 ] 

Michael Lyons commented on AIRFLOW-338:
---------------------------------------

I just ran into this on my dev instance with 1.7.1.3, and nuking my airflow db seemed to do the trick. I've also seen this spring up if the date I entered for backfill was before the start date of the DAG

> BackfillJob is deadlocked
> -------------------------
>
>                 Key: AIRFLOW-338
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-338
>             Project: Apache Airflow
>          Issue Type: Test
>          Components: DagRun
>    Affects Versions: Airflow 1.7.1.2
>         Environment: v1.7.1.2
>            Reporter: SARAVANAN SANKARANARAYANAN
>            Priority: Minor
>             Fix For: Airflow 1.7.1.2
>
>
> Hi,
> We are testing Airflow scheduler and getting deadlock error during backfill:-
> airflow backfill bwdc_il_abor_bcp_1 -s 2016-07-14T15:10:00 -e 2016-07-14T15:20:00
> [2016-07-14 15:08:27,249] {__init__.py:36} INFO - Using executor SequentialExecutor
> [2016-07-14 15:08:27,678] {models.py:154} INFO - Filling up the DagBag from /users/home/adcwq5r/airflow/dags
> [2016-07-14 15:08:32,789] {jobs.py:997} INFO - [backfill progress] | waiting: 0 | succeeded: 0 | kicked_off: 0 | failed: 0 | skipped: 0 | deadlocked: 21
> Traceback (most recent call last):
>   File "/usr/local/bin/airflow", line 15, in <module>
>     args.func(args)
>   File "/usr/local/lib/python2.7/site-packages/airflow/bin/cli.py", line 117, in backfill
>     pool=args.pool)
>   File "/usr/local/lib/python2.7/site-packages/airflow/models.py", line 3023, in run
>     job.run()
>   File "/usr/local/lib/python2.7/site-packages/airflow/jobs.py", line 173, in run
>     self._execute()
>   File "/usr/local/lib/python2.7/site-packages/airflow/jobs.py", line 1024, in _execute
>     raise AirflowException(err)
> airflow.exceptions.AirflowException: ---------------------------------------------------
> BackfillJob is deadlocked. These tasks were unable to run:



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)