You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-issues@hadoop.apache.org by "patrick white (JIRA)" <ji...@apache.org> on 2014/05/01 00:17:18 UTC

[jira] [Created] (HADOOP-10553) Performance: AM scaleability is 10% slower in 2.4 compared to 0.23.9

patrick white created HADOOP-10553:
--------------------------------------

             Summary: Performance: AM scaleability is 10% slower in 2.4 compared to 0.23.9
                 Key: HADOOP-10553
                 URL: https://issues.apache.org/jira/browse/HADOOP-10553
             Project: Hadoop Common
          Issue Type: Bug
    Affects Versions: 2.4.0
            Reporter: patrick white


Performance comparison benchmarks from 2.x against 0.23 shows AM scalability benchmark's runtime is approximately 10% slower in 2.4.0. The trend is consistent across later releases in both lines, latest release numbers are:

2.4.0.0     runtime 255.6 seconds (avg 5 passes)
0.23.9.12 runtime 230.4 seconds (avg 5 passes)
Diff: -9.9% 

AM Scalability test is essentially a sleep job that measures time to launch and complete a large number of mappers.

The diff is consistent and has been reproduced in both a larger (350 node, 100,000 mappers) perf environment, as well as a small (10 node, 2,900 mappers) demo cluster.




--
This message was sent by Atlassian JIRA
(v6.2#6252)