You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Devaraj Das (JIRA)" <ji...@apache.org> on 2008/05/19 18:55:55 UTC
[jira] Commented: (HADOOP-3414) Facility to query serializable
types such as Writables for 'raw length'
[ https://issues.apache.org/jira/browse/HADOOP-3414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12598000#action_12598000 ]
Devaraj Das commented on HADOOP-3414:
-------------------------------------
This doesn't look straightforward (i wish it were). Especially given that post HADOOP-1986, we could use any serialization technique (including java's native one)...
> Facility to query serializable types such as Writables for 'raw length'
> -----------------------------------------------------------------------
>
> Key: HADOOP-3414
> URL: https://issues.apache.org/jira/browse/HADOOP-3414
> Project: Hadoop Core
> Issue Type: Improvement
> Components: io
> Reporter: Arun C Murthy
>
> Currently we need to jump through hoops to get the 'raw length' of serializable types for e.g. SequenceFile.Writer.append needs to copy the key/value into a buffer and then check the buffer's size to figure the record/key/value lenghts. Obviously this can be improved to do away with the extra copy if we had types which could be queried for it's raw-length.
> Thoughts?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.