You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Konstantin Shvachko (JIRA)" <ji...@apache.org> on 2011/01/13 22:06:49 UTC

[jira] Commented: (HADOOP-6949) Reduces RPC packet size for primitive arrays, especially long[], which is used at block reporting

    [ https://issues.apache.org/jira/browse/HADOOP-6949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12981484#action_12981484 ] 

Konstantin Shvachko commented on HADOOP-6949:
---------------------------------------------

>From [comment|https://issues.apache.org/jira/browse/HDFS-1583?focusedCommentId=12981455&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#action_12981455]
> move ObjectWritable's array i/o to protected methods, add a subclass with an optimized 
> implementation of these methods, then use that subclass in RPC in place of ObjectWritable. 

Sounds like a plan to me.

There is a patch for arrays with primitive types attached to this jira. Can be used as a starting point I guess.

> Reduces RPC packet size for primitive arrays, especially long[], which is used at block reporting
> -------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-6949
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6949
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: io
>            Reporter: Navis
>            Priority: Trivial
>         Attachments: ObjectWritable.diff
>
>   Original Estimate: 0.17h
>  Remaining Estimate: 0.17h
>
> Current implementation of oah.io.ObjectWritable marshals primitive array types as general object array ; array type string + array length + (element type string + value)*n
> It would not be needed to specify each element types for primitive arrays.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.