You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Sam Whittle (Jira)" <ji...@apache.org> on 2022/01/18 20:21:00 UTC

[jira] [Created] (BEAM-13684) Consider adding information to ProcessBundleRequest indicating there is no existing state

Sam Whittle created BEAM-13684:
----------------------------------

             Summary: Consider adding information to ProcessBundleRequest indicating there is no existing state
                 Key: BEAM-13684
                 URL: https://issues.apache.org/jira/browse/BEAM-13684
             Project: Beam
          Issue Type: Improvement
          Components: beam-model
            Reporter: Sam Whittle


This allows for skipping all state fetches made during processing this key, preloading the cache with empty values for the key, or extending the cache to include this negative state information to avoid fetches as long as no state is evicted for the key.

This is particularly beneficial in sparse key streaming pipelines where such new keys are common.

It could also be used to avoid fetches in batch pipelines where there is no persisted state.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)