You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "pateash (via GitHub)" <gi...@apache.org> on 2024/03/15 07:01:08 UTC

[I] Adding max_consecutive_failed_dag_runs in UI for dag [airflow]

pateash opened a new issue, #38171:
URL: https://github.com/apache/airflow/issues/38171

   ### Description
   
   We are adding the  ability to automatically turn off DAG after X number of consecutive failures.
   
   There are 2 ways to configure this
   
   in DAG() using max_consecutive_failed_dag_runs parameter this will override any config (as below)
   Using core config inside airflow.cfg or variable AIRFLOW__CORE_MAX_CONSECUTIVE_FAILED_DAG_RUNS_PER_DAG
   environment variable.
   
   ### Use case/motivation
   
   We should also show this information into dag_id(besides dag_id) if this is being used,
   although we are showing this in dag details for now.
   
    
   <img width="838" alt="image" src="https://github.com/apache/airflow/assets/16856802/b1e098b1-a8ed-4bf6-831a-3d33b0fe4b08">
   
   
   ### Related issues
   
    #36935
   
   ### Are you willing to submit a PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Adding max_consecutive_failed_dag_runs in UI for dag [airflow]

Posted by "ashb (via GitHub)" <gi...@apache.org>.
ashb commented on issue #38171:
URL: https://github.com/apache/airflow/issues/38171#issuecomment-4719136432

   @ruettere This was merged into 2.9. If that isn't available in 3.3 anymore please open a new issue. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Adding max_consecutive_failed_dag_runs in UI for dag [airflow]

Posted by "ruettere (via GitHub)" <gi...@apache.org>.
ruettere commented on issue #38171:
URL: https://github.com/apache/airflow/issues/38171#issuecomment-4718847689

   Hi, this variable is really helpful. Is it intended to be GA in the near future?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Adding max_consecutive_failed_dag_runs in UI for dag [airflow]

Posted by "eladkal (via GitHub)" <gi...@apache.org>.
eladkal closed issue #38171: Adding max_consecutive_failed_dag_runs in UI for dag
URL: https://github.com/apache/airflow/issues/38171


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Adding max_consecutive_failed_dag_runs in UI for dag [airflow]

Posted by "Taragolis (via GitHub)" <gi...@apache.org>.
Taragolis commented on issue #38171:
URL: https://github.com/apache/airflow/issues/38171#issuecomment-2001955303

   This one required significant changes in Airflow. There any existed options for the change the behavior of the DAG/Task thought the UI. Only thought the configurations (explicit or cluster policies) or by the code.
   
   So I guess it might comes thought AIP (Airflow Improvement Proposals) first, see: https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+Improvement+Proposals
   
   But lets see what the other say.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org