You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@gobblin.apache.org by "Sudarshan Vasudevan (Jira)" <ji...@apache.org> on 2020/02/12 19:16:00 UTC

[jira] [Closed] (GOBBLIN-1034) Ensure underlying writers are expired from the PartitionedDataWriter cache to avoid accumulation of writers for long running Gobblin jobs

     [ https://issues.apache.org/jira/browse/GOBBLIN-1034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sudarshan Vasudevan closed GOBBLIN-1034.
----------------------------------------

> Ensure underlying writers are expired from the PartitionedDataWriter cache to avoid accumulation of writers for long running Gobblin jobs
> -----------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: GOBBLIN-1034
>                 URL: https://issues.apache.org/jira/browse/GOBBLIN-1034
>             Project: Apache Gobblin
>          Issue Type: Improvement
>          Components: gobblin-core
>    Affects Versions: 0.15.0
>            Reporter: Sudarshan Vasudevan
>            Assignee: Abhishek Tiwari
>            Priority: Major
>             Fix For: 0.15.0
>
>          Time Spent: 2h
>  Remaining Estimate: 0h
>
> Currently, the underlying writers are never evicted from the PartitionedDataWriter cache. For long running Gobblin jobs (e.g. streaming), this will cause a memory leak particularly if the underlying writers maintain state. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)