You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@airflow.apache.org by Tobias Feldhaus <To...@localsearch.ch> on 2017/07/12 09:51:22 UTC

ignore depends on past is not honoured when using backfill

I am trying to backfill my DAG with the following command:

airflow backfill -t search_log_sensor -s 2017-07-10 -e 2017-07-11 -I google_pipelines

However, the –I does not have any effect, I see:

BackfillJob is deadlocked.Some of the deadlocked tasks were unable to run because of "depends_on_past" relationships. Try running the backfill with the option "ignore_first_depends_on_past=True" or passing "-I" at the command line.


How do I make airflow ignore the first depends on past condition when using backfill?

Thank you!

Tobi

Re: ignore depends on past is not honoured when using backfill

Posted by Tobias Feldhaus <To...@localsearch.ch>.

Passing --ignore_depends_on_past=True does not work either:

airflow backfill: error: argument -I/--ignore_first_depends_on_past: ignored explicit argument 'True'

Passing --ignore_depends_on_past has no effect as well.

I opened a JIRA ticket here: https://issues.apache.org/jira/browse/AIRFLOW-1406

Best,
Tobi

On 12.07.2017, 11:51, "Tobias Feldhaus" <To...@localsearch.ch> wrote:

    I am trying to backfill my DAG with the following command:
    
    airflow backfill -t search_log_sensor -s 2017-07-10 -e 2017-07-11 -I google_pipelines
    
    However, the –I does not have any effect, I see:
    
    BackfillJob is deadlocked.Some of the deadlocked tasks were unable to run because of "depends_on_past" relationships. Try running the backfill with the option "ignore_first_depends_on_past=True" or passing "-I" at the command line.
    
    
    How do I make airflow ignore the first depends on past condition when using backfill?
    
    Thank you!
    
    Tobi