You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Sam Whittle (Jira)" <ji...@apache.org> on 2022/01/18 20:21:00 UTC
[jira] [Created] (BEAM-13684) Consider adding information to ProcessBundleRequest indicating there is no existing state
Sam Whittle created BEAM-13684:
----------------------------------
Summary: Consider adding information to ProcessBundleRequest indicating there is no existing state
Key: BEAM-13684
URL: https://issues.apache.org/jira/browse/BEAM-13684
Project: Beam
Issue Type: Improvement
Components: beam-model
Reporter: Sam Whittle
This allows for skipping all state fetches made during processing this key, preloading the cache with empty values for the key, or extending the cache to include this negative state information to avoid fetches as long as no state is evicted for the key.
This is particularly beneficial in sparse key streaming pipelines where such new keys are common.
It could also be used to avoid fetches in batch pipelines where there is no persisted state.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)