You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-dev@hadoop.apache.org by "Da Zhou (JIRA)" <ji...@apache.org> on 2019/04/09 23:20:00 UTC

[jira] [Created] (HADOOP-16242) ABFS: add bufferpool to AbfsOutputStream

Da Zhou created HADOOP-16242:
--------------------------------

             Summary: ABFS: add bufferpool to AbfsOutputStream
                 Key: HADOOP-16242
                 URL: https://issues.apache.org/jira/browse/HADOOP-16242
             Project: Hadoop Common
          Issue Type: Sub-task
          Components: fs/azure
    Affects Versions: 3.2.0
         Environment: In current AbfsOutPutStream, new temporary buffers always get allocated when uploading the data to server. These big chunk creates huge pressure on the GC, and in some extreme cases that GC doesn't happen in time(observed in some customer's env), it also lead to OutOfMemory issue easily.
Hence we need to replace the current implementation with a bufferpool.
            Reporter: Da Zhou
            Assignee: Da Zhou






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org