You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Jack McCluskey (Jira)" <ji...@apache.org> on 2021/10/27 15:23:00 UTC

[jira] [Created] (BEAM-13130) [Go SDK] Side Input Memory Leak

Jack McCluskey created BEAM-13130:
-------------------------------------

             Summary: [Go SDK] Side Input Memory Leak
                 Key: BEAM-13130
                 URL: https://issues.apache.org/jira/browse/BEAM-13130
             Project: Beam
          Issue Type: Bug
          Components: sdk-go
            Reporter: Jack McCluskey
            Assignee: Jack McCluskey


Keeping a list of the open stateKeyReader structs in the ScopedStateReader is holding on to memory for the life of bundles, leading to significant memory usage in large batch jobs. This list needs to be removed to the garbage collector can clean up stateKeyReader structs sooner.

 

stateKeyReader: [https://github.com/apache/beam/blob/d916c1f55e57a61b54135d0922ad8660735bd287/sdks/go/pkg/beam/core/runtime/harness/statemgr.go#L105]

List kept by ScopedStateReader: https://github.com/apache/beam/blob/d916c1f55e57a61b54135d0922ad8660735bd287/sdks/go/pkg/beam/core/runtime/harness/statemgr.go#L39



--
This message was sent by Atlassian Jira
(v8.3.4#803005)