[jira] Resolved: (HADOOP-603) Extend SequenceFile to provide MapFile function by storing index at the end of the file

["Owen O'Malley (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HADOOP-603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Owen O'Malley resolved HADOOP-603.
----------------------------------

    Resolution: Duplicate

This is a duplicate of HADOOP-3315.

> Extend SequenceFile to provide MapFile function by storing index at the end of the file
> ---------------------------------------------------------------------------------------
>
>                 Key: HADOOP-603
>                 URL: https://issues.apache.org/jira/browse/HADOOP-603
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: dfs
>            Reporter: Jim Kellerman
>            Assignee: Sameer Paranjpye
>
> MapFile increases the load on the name node as two files are created to provide a index file format. If SequenceFile were extended by storing the index at the end of the file, 1/2 of the files currently created for a map/reduce operation would be needed, reducing the load on the name node.
> Perhaps this is why Google implemented SSTable files in this manner. (SSTable files are functionally identical to Hadoop MapFiles) (see the paper on BigTable - section 4 "Building Blocks" http://labs.google.com/papers/bigtable.html)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.