You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Karam Singh (Created) (JIRA)" <ji...@apache.org> on 2011/12/09 12:08:40 UTC
[jira] [Created] (MAPREDUCE-3525) Shuffle runtime is nearly 1.5x
slower in 0.23
Shuffle runtime is nearly 1.5x slower in 0.23
---------------------------------------------
Key: MAPREDUCE-3525
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3525
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.23.1
Reporter: Karam Singh
Shuffle runtime is nearly 1.5X slower(almost 55% increased) in 0.23 than Hadoop-0.20.204 on 350 nodes size cluster.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3525) Shuffle benchmark is nearly 1.5x
slower in 0.23
Posted by "Vinod Kumar Vavilapalli (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinod Kumar Vavilapalli updated MAPREDUCE-3525:
-----------------------------------------------
Description: Shuffle benchmark is nearly 1.5X slower(almost 55% increased) in 0.23 than Hadoop-0.20.204 on 350 nodes size cluster. (was: Shuffle runtime is nearly 1.5X slower(almost 55% increased) in 0.23 than Hadoop-0.20.204 on 350 nodes size cluster.)
Priority: Blocker (was: Major)
Summary: Shuffle benchmark is nearly 1.5x slower in 0.23 (was: Shuffle runtime is nearly 1.5x slower in 0.23)
> Shuffle benchmark is nearly 1.5x slower in 0.23
> -----------------------------------------------
>
> Key: MAPREDUCE-3525
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3525
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.1
> Reporter: Karam Singh
> Assignee: Vinod Kumar Vavilapalli
> Priority: Blocker
>
> Shuffle benchmark is nearly 1.5X slower(almost 55% increased) in 0.23 than Hadoop-0.20.204 on 350 nodes size cluster.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3525) Shuffle benchmark is nearly
1.5x slower in 0.23
Posted by "Amol Kekre (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13190600#comment-13190600 ]
Amol Kekre commented on MAPREDUCE-3525:
---------------------------------------
Shuffle passed and it is 13.5% better. We will keep running this with new builds. Closing this jira for now
> Shuffle benchmark is nearly 1.5x slower in 0.23
> -----------------------------------------------
>
> Key: MAPREDUCE-3525
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3525
> Project: Hadoop Map/Reduce
> Issue Type: Sub-task
> Components: mrv2
> Affects Versions: 0.23.1
> Reporter: Karam Singh
> Assignee: Vinod Kumar Vavilapalli
> Priority: Blocker
>
> Shuffle benchmark is nearly 1.5X slower(almost 55% increased) in 0.23 than Hadoop-0.20.204 on 350 nodes size cluster.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (MAPREDUCE-3525) Shuffle benchmark is nearly 1.5x
slower in 0.23
Posted by "Mahadev konar (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mahadev konar resolved MAPREDUCE-3525.
--------------------------------------
Resolution: Fixed
Fix Version/s: 0.23.1
Fixed via MAPREDUCE-3641. Thanks for the performance update Amol.
> Shuffle benchmark is nearly 1.5x slower in 0.23
> -----------------------------------------------
>
> Key: MAPREDUCE-3525
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3525
> Project: Hadoop Map/Reduce
> Issue Type: Sub-task
> Components: mrv2
> Affects Versions: 0.23.1
> Reporter: Karam Singh
> Assignee: Vinod Kumar Vavilapalli
> Priority: Blocker
> Fix For: 0.23.1
>
>
> Shuffle benchmark is nearly 1.5X slower(almost 55% increased) in 0.23 than Hadoop-0.20.204 on 350 nodes size cluster.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3525) Shuffle benchmark is nearly 1.5x
slower in 0.23
Posted by "Vinod Kumar Vavilapalli (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinod Kumar Vavilapalli updated MAPREDUCE-3525:
-----------------------------------------------
Issue Type: Sub-task (was: Bug)
Parent: MAPREDUCE-3561
> Shuffle benchmark is nearly 1.5x slower in 0.23
> -----------------------------------------------
>
> Key: MAPREDUCE-3525
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3525
> Project: Hadoop Map/Reduce
> Issue Type: Sub-task
> Components: mrv2
> Affects Versions: 0.23.1
> Reporter: Karam Singh
> Assignee: Vinod Kumar Vavilapalli
> Priority: Blocker
>
> Shuffle benchmark is nearly 1.5X slower(almost 55% increased) in 0.23 than Hadoop-0.20.204 on 350 nodes size cluster.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (MAPREDUCE-3525) Shuffle runtime is nearly 1.5x
slower in 0.23
Posted by "Arun C Murthy (Assigned) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy reassigned MAPREDUCE-3525:
----------------------------------------
Assignee: Vinod Kumar Vavilapalli
> Shuffle runtime is nearly 1.5x slower in 0.23
> ---------------------------------------------
>
> Key: MAPREDUCE-3525
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3525
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.1
> Reporter: Karam Singh
> Assignee: Vinod Kumar Vavilapalli
>
> Shuffle runtime is nearly 1.5X slower(almost 55% increased) in 0.23 than Hadoop-0.20.204 on 350 nodes size cluster.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3525) Shuffle benchmark is nearly
1.5x slower in 0.23
Posted by "Amol Kekre (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13188222#comment-13188222 ]
Amol Kekre commented on MAPREDUCE-3525:
---------------------------------------
MAPREDUCE:3641 has been fixed. We are rechecking the results
> Shuffle benchmark is nearly 1.5x slower in 0.23
> -----------------------------------------------
>
> Key: MAPREDUCE-3525
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3525
> Project: Hadoop Map/Reduce
> Issue Type: Sub-task
> Components: mrv2
> Affects Versions: 0.23.1
> Reporter: Karam Singh
> Assignee: Vinod Kumar Vavilapalli
> Priority: Blocker
>
> Shuffle benchmark is nearly 1.5X slower(almost 55% increased) in 0.23 than Hadoop-0.20.204 on 350 nodes size cluster.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3525) Shuffle benchmark is nearly
1.5x slower in 0.23
Posted by "Amol Kekre (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13190601#comment-13190601 ]
Amol Kekre commented on MAPREDUCE-3525:
---------------------------------------
hmm! maybe needs a committer to mark it fixed.
> Shuffle benchmark is nearly 1.5x slower in 0.23
> -----------------------------------------------
>
> Key: MAPREDUCE-3525
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3525
> Project: Hadoop Map/Reduce
> Issue Type: Sub-task
> Components: mrv2
> Affects Versions: 0.23.1
> Reporter: Karam Singh
> Assignee: Vinod Kumar Vavilapalli
> Priority: Blocker
>
> Shuffle benchmark is nearly 1.5X slower(almost 55% increased) in 0.23 than Hadoop-0.20.204 on 350 nodes size cluster.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira