You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "David S. Wang (JIRA)" <ji...@apache.org> on 2012/05/25 03:07:42 UTC
[jira] [Created] (HBASE-6091) Come up with strawman proposal for RC
testing matrix
David S. Wang created HBASE-6091:
------------------------------------
Summary: Come up with strawman proposal for RC testing matrix
Key: HBASE-6091
URL: https://issues.apache.org/jira/browse/HBASE-6091
Project: HBase
Issue Type: Bug
Components: documentation
Affects Versions: 0.96.0
Reporter: David S. Wang
Assignee: David S. Wang
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6091) Come up with strawman proposal for
RC testing matrix
Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13289673#comment-13289673 ]
Andrew Purtell commented on HBASE-6091:
---------------------------------------
Under the performance section of http://wiki.apache.org/hadoop/ReleaseCandidateTestMatrix, we have YCSB and PerformanceEvaluation. One is a tool in our tree that we can maintain, the other is not. I'll note we have LoadTestTool now from 0.92 forward. Why don't we use that instead of YCSB?
> Come up with strawman proposal for RC testing matrix
> ----------------------------------------------------
>
> Key: HBASE-6091
> URL: https://issues.apache.org/jira/browse/HBASE-6091
> Project: HBase
> Issue Type: Bug
> Components: documentation
> Affects Versions: 0.96.0
> Reporter: David S. Wang
> Assignee: David S. Wang
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6091) Come up with strawman proposal for
RC testing matrix
Posted by "David S. Wang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13285804#comment-13285804 ]
David S. Wang commented on HBASE-6091:
--------------------------------------
I have some content ready; however is there some format I should post it in (e.g. Confluence wiki, etc.)?
> Come up with strawman proposal for RC testing matrix
> ----------------------------------------------------
>
> Key: HBASE-6091
> URL: https://issues.apache.org/jira/browse/HBASE-6091
> Project: HBase
> Issue Type: Bug
> Components: documentation
> Affects Versions: 0.96.0
> Reporter: David S. Wang
> Assignee: David S. Wang
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HBASE-6091) Come up with strawman proposal for
RC testing matrix
Posted by "David S. Wang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
David S. Wang resolved HBASE-6091.
----------------------------------
Resolution: Implemented
> Come up with strawman proposal for RC testing matrix
> ----------------------------------------------------
>
> Key: HBASE-6091
> URL: https://issues.apache.org/jira/browse/HBASE-6091
> Project: HBase
> Issue Type: Bug
> Components: documentation
> Affects Versions: 0.96.0
> Reporter: David S. Wang
> Assignee: David S. Wang
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6091) Come up with strawman proposal for
RC testing matrix
Posted by "David S. Wang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13289681#comment-13289681 ]
David S. Wang commented on HBASE-6091:
--------------------------------------
YCSB is something we use quite a bit and is easy to setup. I don't see the lack of ownership of the tool as something that would preclude it from being used at least for some basic first-level testing. Why don't we have both? I've added LoadTestTool to the matrix.
> Come up with strawman proposal for RC testing matrix
> ----------------------------------------------------
>
> Key: HBASE-6091
> URL: https://issues.apache.org/jira/browse/HBASE-6091
> Project: HBase
> Issue Type: Bug
> Components: documentation
> Affects Versions: 0.96.0
> Reporter: David S. Wang
> Assignee: David S. Wang
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6091) Come up with strawman proposal for
RC testing matrix
Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13289691#comment-13289691 ]
Andrew Purtell commented on HBASE-6091:
---------------------------------------
I've not used YCSB but if I recall correctly Ryan Rawson and others had to rework it's HBase client code substantially. You using that version?
Agree it depends what we are after. I think first order of approximation initial testing is covered by PerformanceEvaluation. Tools like YCSB or LoadTestTool I'd expect to more accurately measure something. It's likely the methodology for such measurements will be imperfect at the start and will need to evolve as HBase evolves. Therefore the tool should evolve in tandem.
> Come up with strawman proposal for RC testing matrix
> ----------------------------------------------------
>
> Key: HBASE-6091
> URL: https://issues.apache.org/jira/browse/HBASE-6091
> Project: HBase
> Issue Type: Bug
> Components: documentation
> Affects Versions: 0.96.0
> Reporter: David S. Wang
> Assignee: David S. Wang
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6091) Come up with strawman proposal for
RC testing matrix
Posted by "David S. Wang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13289517#comment-13289517 ]
David S. Wang commented on HBASE-6091:
--------------------------------------
My wiki name is DavidWang.
> Come up with strawman proposal for RC testing matrix
> ----------------------------------------------------
>
> Key: HBASE-6091
> URL: https://issues.apache.org/jira/browse/HBASE-6091
> Project: HBase
> Issue Type: Bug
> Components: documentation
> Affects Versions: 0.96.0
> Reporter: David S. Wang
> Assignee: David S. Wang
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6091) Come up with strawman proposal for
RC testing matrix
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13285950#comment-13285950 ]
stack commented on HBASE-6091:
------------------------------
This seems like good candidate for wiki page at least until it hardens some. Thereafter, it could go into the reference guide? Good on you David.
> Come up with strawman proposal for RC testing matrix
> ----------------------------------------------------
>
> Key: HBASE-6091
> URL: https://issues.apache.org/jira/browse/HBASE-6091
> Project: HBase
> Issue Type: Bug
> Components: documentation
> Affects Versions: 0.96.0
> Reporter: David S. Wang
> Assignee: David S. Wang
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6091) Come up with strawman proposal for
RC testing matrix
Posted by "David S. Wang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13289717#comment-13289717 ]
David S. Wang commented on HBASE-6091:
--------------------------------------
Probably ... IIRC we are using YCSB 0.14.
In any case, it's not like every single field in the matrix has to be filled out before an RC is +1'ed; that would make RCs take a very long time indeed. I think leaving them both in is good for now; if it turns out that some rows never get filled out, we can always remove them later.
> Come up with strawman proposal for RC testing matrix
> ----------------------------------------------------
>
> Key: HBASE-6091
> URL: https://issues.apache.org/jira/browse/HBASE-6091
> Project: HBase
> Issue Type: Bug
> Components: documentation
> Affects Versions: 0.96.0
> Reporter: David S. Wang
> Assignee: David S. Wang
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6091) Come up with strawman proposal for
RC testing matrix
Posted by "David S. Wang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13289649#comment-13289649 ]
David S. Wang commented on HBASE-6091:
--------------------------------------
I posted it at:
http://wiki.apache.org/hadoop/ReleaseCandidateTestMatrix
and made a link to it from:
http://wiki.apache.org/hadoop/Hbase/HowToRelease
I had to edit the source a bit as the Apache JIRA is not Atlassian format.
What are the next steps here?
> Come up with strawman proposal for RC testing matrix
> ----------------------------------------------------
>
> Key: HBASE-6091
> URL: https://issues.apache.org/jira/browse/HBASE-6091
> Project: HBase
> Issue Type: Bug
> Components: documentation
> Affects Versions: 0.96.0
> Reporter: David S. Wang
> Assignee: David S. Wang
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6091) Come up with strawman proposal for
RC testing matrix
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13289152#comment-13289152 ]
stack commented on HBASE-6091:
------------------------------
@David Thats ruhl phrutty I think the formatting on hbase/hadoop wiki the same. Whats your wiki name so I can give you access? Thanks.
> Come up with strawman proposal for RC testing matrix
> ----------------------------------------------------
>
> Key: HBASE-6091
> URL: https://issues.apache.org/jira/browse/HBASE-6091
> Project: HBase
> Issue Type: Bug
> Components: documentation
> Affects Versions: 0.96.0
> Reporter: David S. Wang
> Assignee: David S. Wang
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6091) Come up with strawman proposal for
RC testing matrix
Posted by "David S. Wang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13287062#comment-13287062 ]
David S. Wang commented on HBASE-6091:
--------------------------------------
I signed up for a wiki page account, but cannot seem to create a new page, or at least I could not figure out how to do that. Can I get perms to create and edit my own page on the hbase wiki? Otherwise I can just attach what I have so far in ugly text format.
> Come up with strawman proposal for RC testing matrix
> ----------------------------------------------------
>
> Key: HBASE-6091
> URL: https://issues.apache.org/jira/browse/HBASE-6091
> Project: HBase
> Issue Type: Bug
> Components: documentation
> Affects Versions: 0.96.0
> Reporter: David S. Wang
> Assignee: David S. Wang
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6091) Come up with strawman proposal for
RC testing matrix
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13289656#comment-13289656 ]
stack commented on HBASE-6091:
------------------------------
Tell dev list it exists. Chase us if we don't make an attempt at using the template whenever we go to make a release. Thanks David.
> Come up with strawman proposal for RC testing matrix
> ----------------------------------------------------
>
> Key: HBASE-6091
> URL: https://issues.apache.org/jira/browse/HBASE-6091
> Project: HBase
> Issue Type: Bug
> Components: documentation
> Affects Versions: 0.96.0
> Reporter: David S. Wang
> Assignee: David S. Wang
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6091) Come up with strawman proposal for
RC testing matrix
Posted by "David S. Wang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13289046#comment-13289046 ]
David S. Wang commented on HBASE-6091:
--------------------------------------
Here's a first draft in Atlassian JIRA format. I can convert this to something else if needed.
Release version: (e.g. 0.94.1 RC2)
|| Category || Reporter || Underlying Hadoop version || Tests run || +1/0/-1 || Results details ||
|| Master ||
| Log splitting | Dave | Hadoop 2.0.0 | e.g. Configured no distributed log splitting, killed RS | +1 | e.g. looked at logs, verified no data loss |
| Distributed log splitting | | | | | |
| Load balancer | | | | | |
| Regions in transition | | Hadoop 1.0.3 | e.g. unassign region(s) from shell, see that they get reassigned after a while | | e.g. check logs that region was in transition for a little while, not stuck there |
|| Region server ||
| Flushes | | | | | |
| Compactions | | | | | |
| Splits | | | | | |
| Block cache | | | | | |
|| Client ||
| Java | | | | | |
| Thrift | | | | | |
| REST | | | | | |
| Shell | | | | | |
|| Tools ||
| scripts (e.g. graceful stop) | | | | | |
| Bulk load | | | | | |
| CopyTable | | | | | |
| importtsv | | | | | |
| hbck | | | | | |
|| Metrics ||
|| Coprocessors ||
|| Security ||
| Kerberos authentication | | | | | |
| ACL coprocessor | | | | | |
| TokenProvider coprocessor | | | | | |
|| Replication ||
| Master-slave | | | | | |
| Master-master | | | | | |
| Cyclic | | | | | |
|| Compression ||
| Snappy | | | | | |
| LZO | | | | | |
|| Performance ||
| YCSB | | | | | |
| PerformanceEvaluation | | | | | |
|| Compatibility ||
| Client-server compatibility between minor versions | | | | | |
| Server-server compatibility between minor versions | | | | | |
| Client-server compatibility between major versions -+1 | | | | | |
| Server-server compatibility between major versions -+1 | | | | | |
| Client-server compatibility between major versions > -+1 | | | | | |
| Server-server compatibility between major versions > -+1 | | | | | |
| Manual rolling restart between this version and previous version (minor or major) | | | | | |
|| Configuration ||
|| System ||
| TestLoadAndVerify | | | | | |
| TestAcidGuarantees | | | | | |
| TestConcurrentScanAndPut | | | | | |
| Failover to backup master | | | | | |
| Kill RS | | | | | |
| Kill RS holding .META. | | | | | |
| Kill RS holding -ROOT- | | | | | |
|| New features ||
| e.g. Snapshots | | | | | |
|| Documentation ||
| Review section <X> of reference guide | | | | | |
| Review bundled documentation | | | | | |
> Come up with strawman proposal for RC testing matrix
> ----------------------------------------------------
>
> Key: HBASE-6091
> URL: https://issues.apache.org/jira/browse/HBASE-6091
> Project: HBase
> Issue Type: Bug
> Components: documentation
> Affects Versions: 0.96.0
> Reporter: David S. Wang
> Assignee: David S. Wang
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6091) Come up with strawman proposal for
RC testing matrix
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13289524#comment-13289524 ]
stack commented on HBASE-6091:
------------------------------
Try it now boss. Let me know if it doesn't work. Hopefully you can just copy paste the beauty you made above.
> Come up with strawman proposal for RC testing matrix
> ----------------------------------------------------
>
> Key: HBASE-6091
> URL: https://issues.apache.org/jira/browse/HBASE-6091
> Project: HBase
> Issue Type: Bug
> Components: documentation
> Affects Versions: 0.96.0
> Reporter: David S. Wang
> Assignee: David S. Wang
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Comment Edited] (HBASE-6091) Come up with strawman proposal
for RC testing matrix
Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13289691#comment-13289691 ]
Andrew Purtell edited comment on HBASE-6091 at 6/5/12 8:26 PM:
---------------------------------------------------------------
I've not used YCSB [edit: except in a limited way out of curiosity] but if I recall correctly Ryan Rawson and others had to rework it's HBase client code substantially. You using that version?
Agree it depends what we are after. I think first order of approximation initial testing is covered by PerformanceEvaluation. Tools like YCSB or LoadTestTool I'd expect to more accurately measure something. It's likely the methodology for such measurements will be imperfect at the start and will need to evolve as HBase evolves. Therefore the tool should evolve in tandem.
was (Author: apurtell):
I've not used YCSB but if I recall correctly Ryan Rawson and others had to rework it's HBase client code substantially. You using that version?
Agree it depends what we are after. I think first order of approximation initial testing is covered by PerformanceEvaluation. Tools like YCSB or LoadTestTool I'd expect to more accurately measure something. It's likely the methodology for such measurements will be imperfect at the start and will need to evolve as HBase evolves. Therefore the tool should evolve in tandem.
> Come up with strawman proposal for RC testing matrix
> ----------------------------------------------------
>
> Key: HBASE-6091
> URL: https://issues.apache.org/jira/browse/HBASE-6091
> Project: HBase
> Issue Type: Bug
> Components: documentation
> Affects Versions: 0.96.0
> Reporter: David S. Wang
> Assignee: David S. Wang
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira