You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-dev@hadoop.apache.org by "Jay Booth (JIRA)" <ji...@apache.org> on 2009/07/31 22:54:14 UTC

[jira] Created: (HDFS-516) Low Latency distributed reads

Low Latency distributed reads
-----------------------------

                 Key: HDFS-516
                 URL: https://issues.apache.org/jira/browse/HDFS-516
             Project: Hadoop HDFS
          Issue Type: New Feature
            Reporter: Jay Booth
            Priority: Minor


I created a method for low latency random reads using NIO on the server side and simulated OS paging with LRU caching and lookahead on the client side.  Some applications could include lucene searching (term->doc and doc->offset mappings are likely to be in local cache, thus much faster than nutch's current FsDirectory impl and binary search through record files (bytes at 1/2, 1/4, 1/8 marks are likely to be cached)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.