You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@gobblin.apache.org by "Joel Baranick (JIRA)" <ji...@apache.org> on 2017/11/23 07:11:01 UTC

[jira] [Commented] (GOBBLIN-187) Gobblin Helix doesn't clean up `.job.state` files, causing unbounded disk usage

    [ https://issues.apache.org/jira/browse/GOBBLIN-187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16263899#comment-16263899 ] 

Joel Baranick commented on GOBBLIN-187:
---------------------------------------

[~abti] Any ideas here?  This ends up causing our EFS to keep growing, incurring more cost.

> Gobblin Helix doesn't clean up `.job.state` files, causing unbounded disk usage
> -------------------------------------------------------------------------------
>
>                 Key: GOBBLIN-187
>                 URL: https://issues.apache.org/jira/browse/GOBBLIN-187
>             Project: Apache Gobblin
>          Issue Type: Bug
>            Reporter: Joel Baranick
>
> Then Gobblin is running on `GobblinHelixJobLauncher.createJob` method writes the job state to a `.job.state` file.  Nothing cleans up these files.  The result is unbounded disk usage.  `.job.state` files should be deleted at the completion of jobs.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)