You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Gopal V (JIRA)" <ji...@apache.org> on 2016/05/29 03:16:13 UTC
[jira] [Created] (TEZ-3284) Synchronization for every byte in
UnorderdKVWriter
Gopal V created TEZ-3284:
----------------------------
Summary: Synchronization for every byte in UnorderdKVWriter
Key: TEZ-3284
URL: https://issues.apache.org/jira/browse/TEZ-3284
Project: Apache Tez
Issue Type: Bug
Affects Versions: 0.9.0
Reporter: Gopal V
Priority: Critical
{code}
baos = new ByteArrayOutputStream();
dos = new DataOutputStream(baos);
keySerializer.open(dos);
valSerializer.open(dos);
{code}
This is a known performance issue as documented in HADOOP-10694
Both ByteArrayOutputStream::write() and DataOutputStream::write() have lock prefix calls in them, because they are object synchronized methods.
Recommended solution is to replicate the Hive NonSync impls similar to HADOOP-10694
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)