You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by "stankiewicz (via GitHub)" <gi...@apache.org> on 2025/01/16 09:43:20 UTC
[PR] Introduce sampling to StateBackedIterable [beam]
stankiewicz opened a new pull request, #33621:
URL: https://github.com/apache/beam/pull/33621
Fixes #33620
StateBackedIterable currently encodes every element to report it's size to observer.
With this change it will take into account isRegisterByteSizeObserverCheap response and depending on it it will encode or sample. Sampling algorithm is similar to other places e.g. [OutputObjectAndByteCounter](runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/util/common/worker/OutputObjectAndByteCounter.java].
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Introduce sampling to StateBackedIterable [beam]
Posted by "stankiewicz (via GitHub)" <gi...@apache.org>.
stankiewicz closed pull request #33621: Introduce sampling to StateBackedIterable
URL: https://github.com/apache/beam/pull/33621
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Introduce sampling to StateBackedIterable [beam]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #33621:
URL: https://github.com/apache/beam/pull/33621#issuecomment-2595227152
Assigning reviewers. If you would like to opt out of this review, comment `assign to next reviewer`:
R: @Abacn for label java.
Available commands:
- `stop reviewer notifications` - opt out of the automated review tooling
- `remind me after tests pass` - tag the comment author after tests pass
- `waiting on author` - shift the attention set back to the author (any comment or push by the author will return the attention set to the reviewers)
The PR bot will only process comments in the main thread (not review comments).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org