You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Oliver Meyn (Created) (JIRA)" <ji...@apache.org> on 2012/02/15 15:22:59 UTC
[jira] [Created] (HBASE-5401) PerformanceEvaluation generates 10x
the number of expected mappers
PerformanceEvaluation generates 10x the number of expected mappers
------------------------------------------------------------------
Key: HBASE-5401
URL: https://issues.apache.org/jira/browse/HBASE-5401
Project: HBase
Issue Type: Bug
Components: performance
Reporter: Oliver Meyn
With a command line like 'hbase org.apache.hadoop.hbase.PerformanceEvaluation randomWrite 10' there are 100 mappers spawned, rather than the expected 10. The culprit appears to be the outer loop in writeInputFile which sets up 10 splits for every "asked-for client". I think the fix is just to remove that outer loop.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5401) PerformanceEvaluation generates 10x
the number of expected mappers
Posted by "Ian Varley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446199#comment-13446199 ]
Ian Varley commented on HBASE-5401:
-----------------------------------
Hey Oliver, I see in your blog post (http://gbif.blogspot.com/2012/02/performance-evaluation-of-hbase.html) that you patched this issue. Mind posting that patch back here?
> PerformanceEvaluation generates 10x the number of expected mappers
> ------------------------------------------------------------------
>
> Key: HBASE-5401
> URL: https://issues.apache.org/jira/browse/HBASE-5401
> Project: HBase
> Issue Type: Bug
> Components: test
> Reporter: Oliver Meyn
>
> With a command line like 'hbase org.apache.hadoop.hbase.PerformanceEvaluation randomWrite 10' there are 100 mappers spawned, rather than the expected 10. The culprit appears to be the outer loop in writeInputFile which sets up 10 splits for every "asked-for client". I think the fix is just to remove that outer loop.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5401) PerformanceEvaluation generates 10x
the number of expected mappers
Posted by "Oliver Meyn (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Oliver Meyn updated HBASE-5401:
-------------------------------
Component/s: (was: performance)
test
> PerformanceEvaluation generates 10x the number of expected mappers
> ------------------------------------------------------------------
>
> Key: HBASE-5401
> URL: https://issues.apache.org/jira/browse/HBASE-5401
> Project: HBase
> Issue Type: Bug
> Components: test
> Reporter: Oliver Meyn
>
> With a command line like 'hbase org.apache.hadoop.hbase.PerformanceEvaluation randomWrite 10' there are 100 mappers spawned, rather than the expected 10. The culprit appears to be the outer loop in writeInputFile which sets up 10 splits for every "asked-for client". I think the fix is just to remove that outer loop.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira