You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/03 21:16:26 UTC

[GitHub] [beam] kennknowles opened a new issue, #18944: Go SDK-Tune in memory pre-combine caching for Lifted Combines.

kennknowles opened a new issue, #18944:
URL: https://github.com/apache/beam/issues/18944

   Requires [BEAM-4276](https://issues.apache.org/jira/browse/BEAM-4276) to be completed first.
   
   Additional performance tweaks to the in memory per-key accumulator cache during the pre-combine phase of a lifted combine.
   
   This can include any of
    * capping the number of key-accumulator in the cache, and draining them eagerly after x elements seen, or evicting keys by some heuristic after the cache has seen X distinct keys.
    * providing a counter on cache size (key/element counts) exposable through the metrics interface or another runner standard counter, to permit observing the cache's status, especially if it could grow without bound within a bundle.
   
    
   
   Imported from Jira [BEAM-4468](https://issues.apache.org/jira/browse/BEAM-4468). Original Jira may contain additional context.
   Reported by: lostluck.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org