You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jobs@airflow.apache.org by GitBox <gi...@apache.org> on 2026/06/05 01:59:15 UTC
[GH] (airflow/shared-stream-ack): Workflow run "Check newsfragment PR number" is working again!
The GitHub Actions job "Check newsfragment PR number" on airflow.git/shared-stream-ack has succeeded.
Run started by GitHub user Lee-W (triggered by Lee-W).
Head commit for run:
4c32f7a44eb91795e3e5b4bcb5ea88e0b91f9f31 / Wei Lee <we...@gmail.com>
feat(triggers): add producer-side ack channel to shared-stream triggers
Extend the SharedStreamManager + BaseEventTrigger shared-stream API from
PR #66584 so it can also host upstreams that need a producer-held handle
to advance (Kafka manual commit, SQS delete / visibility extend, Pub/Sub
ack_id, Service Bus peek-lock).
Producer triggers opt in by overriding the new
`BaseEventTrigger.advance_shared_stream` classmethod and yielding
`(event, broker_payload)` tuples from `open_shared_stream`. Subscribers
receive an `AckToken` alongside each raw event; the manager invokes the
producer's advance hook once all subscribers in scope at fan-out time
have called `await token.ack()`. Triggers that don't override the hook
keep the existing fast path (subscribers see raw events, no ack table),
so `DirectoryFileDeleteTrigger` is unaffected.
Slow subscribers are bounded by a per-event ack timeout
(`SharedStreamManager(ack_timeout=...)`, default 300s); a single slow
subscriber is force-failed via the existing `_PollFailure` path without
blocking siblings. Broker advance failures are logged via
`_on_advance_done` rather than swallowed.
Closes #67179
Report URL: https://github.com/apache/airflow/actions/runs/26990766459
With regards,
GitHub Actions via GitBox
---------------------------------------------------------------------
To unsubscribe, e-mail: jobs-unsubscribe@airflow.apache.org
For additional commands, e-mail: jobs-help@airflow.apache.org