You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "rjgoyln (via GitHub)" <gi...@apache.org> on 2026/08/13 18:57:53 UTC

[PR] Fail Glue job tasks promptly when a verbose job run errors [airflow]

rjgoyln opened a new pull request, #71570:
URL: https://github.com/apache/airflow/pull/71570

   ## Summary
   
   A run in `ERROR` is finished and will never reach `SUCCEEDED`, but the verbose polling loop keeps polling it to exhaustion — 75 minutes for `GlueJobOperator`, two hours for `GlueJobSensor` at default settings — and then reports `waiter exceeded max attempts`, which reads as a timeout rather than the job error it is. The `job_complete` waiter behind the non-verbose branch fails on `ERROR` explicitly, so this is the last state the two deferrable paths disagree on.
   
   ## Scope
   
   Stacked on #71495, whose commit shows here until it merges. `EXPIRED`, terminal for the operator, is left out on purpose: the waiter has no acceptor for it either, so handling it only here would put the verbose branch ahead of the non-verbose one rather than level with it.
   
   Raised in review of #71495: https://github.com/apache/airflow/pull/71495#pullrequestreview-4930029658
   
   ---
   
   ##### Was generative AI tooling used to co-author this PR?
   
   - [X] Yes — Claude Code (Opus 5)
   
   Generated-by: Claude Code (Opus 5) following [the guidelines](https://github.com/apache/airflow/blob/main/contributing-docs/05_pull_requests.rst#gen-ai-assisted-contributions)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] Fail Glue job tasks promptly when a verbose job run errors [airflow]

Posted by "henry3260 (via GitHub)" <gi...@apache.org>.
henry3260 merged PR #71570:
URL: https://github.com/apache/airflow/pull/71570


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org