You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@gobblin.apache.org by "Sudarshan Vasudevan (Jira)" <ji...@apache.org> on 2020/01/28 18:12:00 UTC

[jira] [Created] (GOBBLIN-1034) Ensure underlying writers are expired from the PartitionedDataWriter cache to avoid accumulation of writers for long running Gobblin jobs

Sudarshan Vasudevan created GOBBLIN-1034:
--------------------------------------------

             Summary: Ensure underlying writers are expired from the PartitionedDataWriter cache to avoid accumulation of writers for long running Gobblin jobs
                 Key: GOBBLIN-1034
                 URL: https://issues.apache.org/jira/browse/GOBBLIN-1034
             Project: Apache Gobblin
          Issue Type: Improvement
          Components: gobblin-core
    Affects Versions: 0.15.0
            Reporter: Sudarshan Vasudevan
            Assignee: Abhishek Tiwari
             Fix For: 0.15.0


Currently, the underlying writers are never evicted from the PartitionedDataWriter cache. For long running Gobblin jobs (e.g. streaming), this will cause a memory leak particularly if the underlying writers maintain state. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)