You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Vinod Kumar Vavilapalli (JIRA)" <ji...@apache.org> on 2014/05/02 00:52:22 UTC
[jira] [Commented] (HADOOP-10553) Performance: AM scaleability is
10% slower in 2.4 compared to 0.23.9
[ https://issues.apache.org/jira/browse/HADOOP-10553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13987125#comment-13987125 ]
Vinod Kumar Vavilapalli commented on HADOOP-10553:
--------------------------------------------------
Note sure whether it is a MR issue or YARN issue yet. Moving to YARN for now.
> Performance: AM scaleability is 10% slower in 2.4 compared to 0.23.9
> --------------------------------------------------------------------
>
> Key: HADOOP-10553
> URL: https://issues.apache.org/jira/browse/HADOOP-10553
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 2.4.0
> Reporter: patrick white
>
> Performance comparison benchmarks from 2.x against 0.23 shows AM scalability benchmark's runtime is approximately 10% slower in 2.4.0. The trend is consistent across later releases in both lines, latest release numbers are:
> 2.4.0.0 runtime 255.6 seconds (avg 5 passes)
> 0.23.9.12 runtime 230.4 seconds (avg 5 passes)
> Diff: -9.9%
> AM Scalability test is essentially a sleep job that measures time to launch and complete a large number of mappers.
> The diff is consistent and has been reproduced in both a larger (350 node, 100,000 mappers) perf environment, as well as a small (10 node, 2,900 mappers) demo cluster.
--
This message was sent by Atlassian JIRA
(v6.2#6252)