You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@gobblin.apache.org by "Hung Tran (JIRA)" <ji...@apache.org> on 2019/01/25 06:02:00 UTC

[jira] [Created] (GOBBLIN-671) Close the underlying writer when a HiveWritableHdfsDataWriter is closed

Hung Tran created GOBBLIN-671:
---------------------------------

             Summary: Close the underlying writer when a HiveWritableHdfsDataWriter is closed
                 Key: GOBBLIN-671
                 URL: https://issues.apache.org/jira/browse/GOBBLIN-671
             Project: Apache Gobblin
          Issue Type: Task
            Reporter: Hung Tran
            Assignee: Hung Tran


The HiveWritableHdfsDataWriter writer does not close the underlying writer when close() is called. This results in holding onto writer resources after the close. For some underlying writers like an OrcRecordWriter this case result a large amount of memory being buffered which leads to OOMs.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)