You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-user@hadoop.apache.org by Dan Fundatureanu <da...@gmail.com> on 2010/04/28 19:42:47 UTC

Shuffle algorithm

What is the sorting algorithm used at the Shuffle step?

Re: Shuffle algorithm

Posted by Dan Fundatureanu <da...@gmail.com>.

Thank you!
I think you are right:

this is from "hadoop-default.xml"

<property>
  <name>map.sort.class</name>
  <value>org.apache.hadoop.util.QuickSort</value>
  <description>The default sort class for sorting keys.</description>
</property>

Dan

On Wed, Apr 28, 2010 at 11:13 PM, himanshu chandola <
himanshu_coolguy@yahoo.com> wrote:

> Hi Dan,
> If I remember it right, it was quick sort. The default setting can be found
> in hadoop-default.xml.
>
> Best
> H
>  Morpheus: Do you believe in fate, Neo?
> Neo: No.
> Morpheus: Why Not?
> Neo: Because I don't like the idea that I'm not in control of my life.
>
>
>
> ----- Original Message ----
> From: Dan Fundatureanu <da...@gmail.com>
> To: core-user@hadoop.apache.org
> Sent: Wed, April 28, 2010 1:42:47 PM
> Subject: Shuffle algorithm
>
> What is the sorting algorithm used at the Shuffle step?
>
>
>
>
>

Re: Shuffle algorithm

Posted by himanshu chandola <hi...@yahoo.com>.

Hi Dan,
If I remember it right, it was quick sort. The default setting can be found in hadoop-default.xml.

Best
H
 Morpheus: Do you believe in fate, Neo?
Neo: No.
Morpheus: Why Not?
Neo: Because I don't like the idea that I'm not in control of my life.



----- Original Message ----
From: Dan Fundatureanu <da...@gmail.com>
To: core-user@hadoop.apache.org
Sent: Wed, April 28, 2010 1:42:47 PM
Subject: Shuffle algorithm

What is the sorting algorithm used at the Shuffle step?