You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Owen O'Malley (JIRA)" <ji...@apache.org> on 2006/06/22 17:50:29 UTC

[jira] Created: (HADOOP-314) remove the append phase in sorting the reduce inputs

remove the append phase in sorting the reduce inputs
----------------------------------------------------

         Key: HADOOP-314
         URL: http://issues.apache.org/jira/browse/HADOOP-314
     Project: Hadoop
        Type: Improvement

  Components: mapred  
    Versions: 0.3.2    
    Reporter: Owen O'Malley
 Assigned to: Owen O'Malley 
     Fix For: 0.4.0
 Attachments: no-append.patch

This patch creates a new interface to SequenceFile.sort that allows both a list of files to be passed as input and specifying whether the inputs should be deleted. The ReduceTask is changed to pass the list of map inputs and to delete them as they are sorted.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira


[jira] Updated: (HADOOP-314) remove the append phase in sorting the reduce inputs

Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
     [ http://issues.apache.org/jira/browse/HADOOP-314?page=all ]

Owen O'Malley updated HADOOP-314:
---------------------------------

    Attachment: no-append.patch

> remove the append phase in sorting the reduce inputs
> ----------------------------------------------------
>
>          Key: HADOOP-314
>          URL: http://issues.apache.org/jira/browse/HADOOP-314
>      Project: Hadoop
>         Type: Improvement

>   Components: mapred
>     Versions: 0.3.2
>     Reporter: Owen O'Malley
>     Assignee: Owen O'Malley
>      Fix For: 0.4.0
>  Attachments: no-append.patch
>
> This patch creates a new interface to SequenceFile.sort that allows both a list of files to be passed as input and specifying whether the inputs should be deleted. The ReduceTask is changed to pass the list of map inputs and to delete them as they are sorted.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira


[jira] Resolved: (HADOOP-314) remove the append phase in sorting the reduce inputs

Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
     [ http://issues.apache.org/jira/browse/HADOOP-314?page=all ]
     
Doug Cutting resolved HADOOP-314:
---------------------------------

    Resolution: Fixed

I just committed this.  Thanks, Owen!

> remove the append phase in sorting the reduce inputs
> ----------------------------------------------------
>
>          Key: HADOOP-314
>          URL: http://issues.apache.org/jira/browse/HADOOP-314
>      Project: Hadoop
>         Type: Improvement

>   Components: mapred
>     Versions: 0.3.2
>     Reporter: Owen O'Malley
>     Assignee: Owen O'Malley
>      Fix For: 0.4.0
>  Attachments: no-append.patch
>
> This patch creates a new interface to SequenceFile.sort that allows both a list of files to be passed as input and specifying whether the inputs should be deleted. The ReduceTask is changed to pass the list of map inputs and to delete them as they are sorted.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira