You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Konstantin Shvachko (JIRA)" <ji...@apache.org> on 2011/01/13 22:06:49 UTC
[jira] Commented: (HADOOP-6949) Reduces RPC packet size for
primitive arrays, especially long[], which is used at block reporting
[ https://issues.apache.org/jira/browse/HADOOP-6949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12981484#action_12981484 ]
Konstantin Shvachko commented on HADOOP-6949:
---------------------------------------------
>From [comment|https://issues.apache.org/jira/browse/HDFS-1583?focusedCommentId=12981455&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#action_12981455]
> move ObjectWritable's array i/o to protected methods, add a subclass with an optimized
> implementation of these methods, then use that subclass in RPC in place of ObjectWritable.
Sounds like a plan to me.
There is a patch for arrays with primitive types attached to this jira. Can be used as a starting point I guess.
> Reduces RPC packet size for primitive arrays, especially long[], which is used at block reporting
> -------------------------------------------------------------------------------------------------
>
> Key: HADOOP-6949
> URL: https://issues.apache.org/jira/browse/HADOOP-6949
> Project: Hadoop Common
> Issue Type: Improvement
> Components: io
> Reporter: Navis
> Priority: Trivial
> Attachments: ObjectWritable.diff
>
> Original Estimate: 0.17h
> Remaining Estimate: 0.17h
>
> Current implementation of oah.io.ObjectWritable marshals primitive array types as general object array ; array type string + array length + (element type string + value)*n
> It would not be needed to specify each element types for primitive arrays.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.