You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Vamsi-klu (via GitHub)" <gi...@apache.org> on 2026/06/07 00:34:58 UTC
[PR] Add CloudSQLNoOperationInProgressSensor for parallel admin ops [airflow]
Vamsi-klu opened a new pull request, #68151:
URL: https://github.com/apache/airflow/pull/68151
Cloud SQL serializes administrative operations per instance, so two parallel `CloudSQLImportInstanceOperator` / `CloudSQLExportInstanceOperator` tasks against the same instance race and the second fails with HTTP 409 `operationInProgress` (#68040).
This adds an operation-agnostic, deferrable `CloudSQLNoOperationInProgressSensor` that polls `sqladmin.operations.list` for the instance and succeeds once no operation is in a non-terminal (PENDING/RUNNING) state. Place it upstream of the import/export operators to serialize work. Fails fast on HTTP 403/404. Operator submit semantics are unchanged.
Adds: a `list_operations` hook method, a `CloudSQLNoOperationInProgressTrigger`, the new sensor, provider.yaml registration, a howto doc section, and unit tests for the hook/trigger/sensor.
closes: #68040
---
##### Was generative AI tooling used to co-author this PR?
- [X] Yes — Claude Code (Opus 4.8)
Generated-by: Claude Code (Opus 4.8) following [the guidelines](https://github.com/apache/airflow/blob/main/contributing-docs/05_pull_requests.rst#gen-ai-assisted-contributions)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Add CloudSQLNoOperationInProgressSensor for parallel admin ops [airflow]
Posted by "Vamsi-klu (via GitHub)" <gi...@apache.org>.
Vamsi-klu commented on PR #68151:
URL: https://github.com/apache/airflow/pull/68151#issuecomment-4702692974
Progress update (2026-06-14): this PR is intentionally kept as the best-effort sensor lane for #68040 (it reduces collision likelihood only). It does not attempt the submit-time correctness fix for `operationInProgress`.
The active hook-level correctness fix is being tracked in #68361, which is still open and currently marked `ready for maintainer review`.
Environment note: in this environment, full unit/E2E execution is limited (no Docker runtime and no usable GCP config here), so full in-app-browser E2E could not be completed.
---
Drafted-by: Codex (GPT-5) (no human review before posting)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Add CloudSQLNoOperationInProgressSensor for parallel admin ops [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk merged PR #68151:
URL: https://github.com/apache/airflow/pull/68151
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Add CloudSQLNoOperationInProgressSensor for parallel admin ops [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on PR #68151:
URL: https://github.com/apache/airflow/pull/68151#issuecomment-4658481318
@Vamsi-klu A few things need addressing before review — see our [Pull Request quality criteria](https://github.com/apache/airflow/blob/main/contributing-docs/05_pull_requests.rst#pull-request-quality-criteria).
- :x: **Merge conflicts** with `main`. See [docs](https://github.com/apache/airflow/blob/main/contributing-docs/10_working_with_git.rst).
No rush.
_Note: This comment was drafted by an AI-assisted triage tool and may contain mistakes. Once you have addressed the points above, an Apache Airflow maintainer — a real person — will take the next look at your PR. We use this [two-stage triage process](https://github.com/apache/airflow/blob/main/contributing-docs/25_maintainer_pr_triage.md#why-the-first-pass-is-automated) so that our maintainers' limited time is spent where it matters most: the conversation with you._
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org