You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-issues@hadoop.apache.org by "Gopal V (JIRA)" <ji...@apache.org> on 2014/06/13 21:15:03 UTC

[jira] [Created] (HADOOP-10694) Remove synchronized input streams from Writable deserialization

Gopal V created HADOOP-10694:
--------------------------------

             Summary: Remove synchronized input streams from Writable deserialization
                 Key: HADOOP-10694
                 URL: https://issues.apache.org/jira/browse/HADOOP-10694
             Project: Hadoop Common
          Issue Type: Bug
          Components: io
            Reporter: Gopal V
            Assignee: Gopal V
         Attachments: writable-read-sync.png

Writable deserialization is slowing down due to a synchronized block within DataInputBuffer$Buffer.

ByteArrayInputStream::read() is synchronized and this shows up as a slow uncontested lock.

Hive ships with its own faster thread-unsafe version with hive.common.io.NonSyncByteArrayInputStream.

!writable-read-sync.png!

The DataInputBuffer and Writable deserialization should not require a lock per readInt()/read().



--
This message was sent by Atlassian JIRA
(v6.2#6252)