You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Kenneth Knowles (Jira)" <ji...@apache.org> on 2021/10/27 15:23:00 UTC

[jira] [Updated] (BEAM-13130) [Go SDK] Side Input Memory Leak

     [ https://issues.apache.org/jira/browse/BEAM-13130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kenneth Knowles updated BEAM-13130:
-----------------------------------
    Status: Open  (was: Triage Needed)

> [Go SDK] Side Input Memory Leak
> -------------------------------
>
>                 Key: BEAM-13130
>                 URL: https://issues.apache.org/jira/browse/BEAM-13130
>             Project: Beam
>          Issue Type: Bug
>          Components: sdk-go
>            Reporter: Jack McCluskey
>            Assignee: Jack McCluskey
>            Priority: P2
>
> Keeping a list of the open stateKeyReader structs in the ScopedStateReader is holding on to memory for the life of bundles, leading to significant memory usage in large batch jobs. This list needs to be removed to the garbage collector can clean up stateKeyReader structs sooner.
>  
> stateKeyReader: [https://github.com/apache/beam/blob/d916c1f55e57a61b54135d0922ad8660735bd287/sdks/go/pkg/beam/core/runtime/harness/statemgr.go#L105]
> List kept by ScopedStateReader: https://github.com/apache/beam/blob/d916c1f55e57a61b54135d0922ad8660735bd287/sdks/go/pkg/beam/core/runtime/harness/statemgr.go#L39



--
This message was sent by Atlassian Jira
(v8.3.4#803005)