You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Tao Feng (JIRA)" <ji...@apache.org> on 2019/01/15 08:47:00 UTC
[jira] [Comment Edited] (AIRFLOW-3702) Reverse Backfilling(from
current date to start date)
[ https://issues.apache.org/jira/browse/AIRFLOW-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16742873#comment-16742873 ]
Tao Feng edited comment on AIRFLOW-3702 at 1/15/19 8:46 AM:
------------------------------------------------------------
[~shubhamod] , the pr is [https://github.com/apache/airflow/pull/4533,] with the branch name tfeng_reverse_backfill. If you do a git fetch upstream, you should be able to checkout that branch.
was (Author: taofeng):
[~shubhamod] , the pr is [https://github.com/apache/airflow/pull/4533,] with the branch name tfeng_reverse_backfill. If you do a git fetch upstream, you should be able to see it.
> Reverse Backfilling(from current date to start date)
> ----------------------------------------------------
>
> Key: AIRFLOW-3702
> URL: https://issues.apache.org/jira/browse/AIRFLOW-3702
> Project: Apache Airflow
> Issue Type: Improvement
> Components: configuration, DAG, models
> Affects Versions: 1.10.1
> Environment: MacOS High Sierra
> python2.7
> Airflow-1.10.1
> Reporter: Shubham Gupta
> Assignee: Tao Feng
> Priority: Major
> Labels: critical, improvement, priority
> Fix For: 1.10.2
>
> Original Estimate: 336h
> Remaining Estimate: 336h
>
> Hello,
> I think there is a need to have reverse backfilling option as well because recent jobs would take precedence over the historical jobs. We can come up with some variable in the DAG such as dagrun_order_default = True/False . This would help in many use cases, in which previous date pipeline does not depends on current pipeline.
> I saw this page which talks about this -> http://mail-archives.apache.org/mod_mbox/airflow-dev/201804.mbox/%3CCAPUwX3M7_qrn=1BqYSMkDV_ifjbTA6LBtq7CzHhEXSZmDJkDnw@mail.gmail.com%3E
> Thanks!
> Regards,
> Shubham
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)