You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Kenneth Knowles (Jira)" <ji...@apache.org> on 2021/05/05 23:16:00 UTC

[jira] [Commented] (BEAM-12292) 2.29.0 cherrypick: WindmillStateCache has a 0% hit rate in 2.29

    [ https://issues.apache.org/jira/browse/BEAM-12292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17339930#comment-17339930 ] 

Kenneth Knowles commented on BEAM-12292:
----------------------------------------

I have cherrypicked this internal as part of the Dataflow release. We should also get it on the {{release-2.29.0}} branch as part of repo hygiene, so that the {{2.29}} series has it in the future without a cherrypick. (not that likely to have another release, but CP is easy)

> 2.29.0 cherrypick: WindmillStateCache has a 0% hit rate in 2.29
> ---------------------------------------------------------------
>
>                 Key: BEAM-12292
>                 URL: https://issues.apache.org/jira/browse/BEAM-12292
>             Project: Beam
>          Issue Type: Bug
>          Components: runner-dataflow
>            Reporter: Steve Niemitz
>            Assignee: Sam Whittle
>            Priority: P1
>             Fix For: 2.29.0
>
>
> After upgrading to 2.29, I noticed that our jobs have a 0% state cache hit rate.  I see a very high eviction rate from the cache as well (it used to be ~0, now its ~100,000+ evictions / second).
> We never were on 2.28, so I can't say if it worked there, but it did work on 2.27.
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)