You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-issues@hadoop.apache.org by "Tim Broberg (Commented) (JIRA)" <ji...@apache.org> on 2012/04/20 20:06:41 UTC

[jira] [Commented] (HDFS-3051) A zero-copy ScatterGatherRead api from FSDataInputStream

    [ https://issues.apache.org/jira/browse/HDFS-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13258432#comment-13258432 ] 

Tim Broberg commented on HDFS-3051:
-----------------------------------

This interface adds some complexity to the ZeroCopyCompressor interface, HADOOP-8148. Debugging traversal of a list of objects across JNI is likely to take some work.

Are we approaching any kind of consensus on whether to incorporate this or not?

Also, how large are the individual buffers in these lists, typically?
                
> A zero-copy ScatterGatherRead api from FSDataInputStream
> --------------------------------------------------------
>
>                 Key: HDFS-3051
>                 URL: https://issues.apache.org/jira/browse/HDFS-3051
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: hdfs client
>            Reporter: dhruba borthakur
>            Assignee: dhruba borthakur
>
> It will be nice if we can get a new API from FSDtaInputStream that allows for zero-copy read for hdfs readers.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira