You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Gautam Kowshik (JIRA)" <ji...@apache.org> on 2007/05/10 12:52:15 UTC

[jira] Created: (HADOOP-1346) Provide alternatives to merge sort while sorting map output values in memory

Provide alternatives to merge sort while sorting map output values in memory
----------------------------------------------------------------------------

                 Key: HADOOP-1346
                 URL: https://issues.apache.org/jira/browse/HADOOP-1346
             Project: Hadoop
          Issue Type: New Feature
          Components: mapred
            Reporter: Gautam Kowshik
         Assigned To: Gautam Kowshik


Currently we have only do a merge sort while sorting map output. We can have alternatives to this for the user to choose from, in particular, QuickSort could provide a good improvement.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-1346) Provide alternatives to merge sort while sorting map output values in memory

Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12495114 ] 

Owen O'Malley commented on HADOOP-1346:
---------------------------------------

-1

The in memory sort is a negligible portion of the time. Allowing choices will increase the complexity of the system while providing very little benefit.

> Provide alternatives to merge sort while sorting map output values in memory
> ----------------------------------------------------------------------------
>
>                 Key: HADOOP-1346
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1346
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: mapred
>    Affects Versions: 0.12.3
>            Reporter: Gautam Kowshik
>         Assigned To: Gautam Kowshik
>
> Currently we have only do a merge sort while sorting map output. We can have alternatives to this for the user to choose from, in particular, QuickSort could provide a good improvement.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (HADOOP-1346) Provide alternatives to merge sort while sorting map output values in memory

Posted by "Sameer Paranjpye (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sameer Paranjpye resolved HADOOP-1346.
--------------------------------------

    Resolution: Won't Fix

This is not a performance concern at the present time.

> Provide alternatives to merge sort while sorting map output values in memory
> ----------------------------------------------------------------------------
>
>                 Key: HADOOP-1346
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1346
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: mapred
>    Affects Versions: 0.12.3
>            Reporter: Gautam Kowshik
>         Assigned To: Gautam Kowshik
>
> Currently we have only do a merge sort while sorting map output. We can have alternatives to this for the user to choose from, in particular, QuickSort could provide a good improvement.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1346) Provide alternatives to merge sort while sorting map output values in memory

Posted by "Gautam Kowshik (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Gautam Kowshik updated HADOOP-1346:
-----------------------------------

           Issue Type: Improvement  (was: New Feature)
    Affects Version/s: 0.12.3

> Provide alternatives to merge sort while sorting map output values in memory
> ----------------------------------------------------------------------------
>
>                 Key: HADOOP-1346
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1346
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: mapred
>    Affects Versions: 0.12.3
>            Reporter: Gautam Kowshik
>         Assigned To: Gautam Kowshik
>
> Currently we have only do a merge sort while sorting map output. We can have alternatives to this for the user to choose from, in particular, QuickSort could provide a good improvement.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.