You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Elliott Clark (JIRA)" <ji...@apache.org> on 2012/05/04 02:14:49 UTC
[jira] [Created] (HBASE-5934) Add the ability for Performance
Evaluation to set the table compression
Elliott Clark created HBASE-5934:
------------------------------------
Summary: Add the ability for Performance Evaluation to set the table compression
Key: HBASE-5934
URL: https://issues.apache.org/jira/browse/HBASE-5934
Project: HBase
Issue Type: Improvement
Reporter: Elliott Clark
Priority: Minor
When testing it's nice to get a more realistic set of numbers. As such allowing the tool to create pre-split regions was needed. Compression should be the same.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5934) Add the ability for Performance
Evaluation to set the table compression
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13400232#comment-13400232 ]
Hudson commented on HBASE-5934:
-------------------------------
Integrated in HBase-TRUNK-on-Hadoop-2.0.0 #67 (See [https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/67/])
HBASE-5934 Add the ability for Performance Evaluation to set the table compression (Matteo) (Revision 1353290)
Result = FAILURE
tedyu :
Files :
* /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/PerformanceEvaluation.java
> Add the ability for Performance Evaluation to set the table compression
> -----------------------------------------------------------------------
>
> Key: HBASE-5934
> URL: https://issues.apache.org/jira/browse/HBASE-5934
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Matteo Bertozzi
> Priority: Minor
> Attachments: HBASE-5934-v0.patch, HBASE-5934-v1.patch
>
>
> When testing it's nice to get a more realistic set of numbers. As such allowing the tool to create pre-split regions was needed. Compression should be the same.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5934) Add the ability for Performance
Evaluation to set the table compression
Posted by "Matteo Bertozzi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13400165#comment-13400165 ]
Matteo Bertozzi commented on HBASE-5934:
----------------------------------------
{quote}Can you explain the purpose for the change in generateValue()?{quote}
The change was done to been able to test the compression.
Instead of a random sequence of byte, you get something compressible.
> Add the ability for Performance Evaluation to set the table compression
> -----------------------------------------------------------------------
>
> Key: HBASE-5934
> URL: https://issues.apache.org/jira/browse/HBASE-5934
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Matteo Bertozzi
> Priority: Minor
> Attachments: HBASE-5934-v0.patch, HBASE-5934-v1.patch
>
>
> When testing it's nice to get a more realistic set of numbers. As such allowing the tool to create pre-split regions was needed. Compression should be the same.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5934) Add the ability for Performance
Evaluation to set the table compression
Posted by "Matteo Bertozzi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matteo Bertozzi updated HBASE-5934:
-----------------------------------
Attachment: HBASE-5934-v0.patch
compression was already in as HBASE-1902 but got lost during the HBASE-2367 merge (r926931 0.90 branch).
I've updated the patch to apply to trunk.
The patch contains two new options:
* --table=NAME
* --compress=NAME (NONE, LZO, GZ, SNAPPY)
The ability to specify a different table name than "TestTable" just to be able to create "tuned" tables. And the compression type option.
> Add the ability for Performance Evaluation to set the table compression
> -----------------------------------------------------------------------
>
> Key: HBASE-5934
> URL: https://issues.apache.org/jira/browse/HBASE-5934
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Priority: Minor
> Attachments: HBASE-5934-v0.patch
>
>
> When testing it's nice to get a more realistic set of numbers. As such allowing the tool to create pre-split regions was needed. Compression should be the same.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5934) Add the ability for Performance
Evaluation to set the table compression
Posted by "Matteo Bertozzi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matteo Bertozzi updated HBASE-5934:
-----------------------------------
Attachment: HBASE-5934-v1.patch
> Add the ability for Performance Evaluation to set the table compression
> -----------------------------------------------------------------------
>
> Key: HBASE-5934
> URL: https://issues.apache.org/jira/browse/HBASE-5934
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Matteo Bertozzi
> Priority: Minor
> Attachments: HBASE-5934-v0.patch, HBASE-5934-v1.patch
>
>
> When testing it's nice to get a more realistic set of numbers. As such allowing the tool to create pre-split regions was needed. Compression should be the same.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5934) Add the ability for Performance
Evaluation to set the table compression
Posted by "Zhihong Ted Yu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13400157#comment-13400157 ]
Zhihong Ted Yu commented on HBASE-5934:
---------------------------------------
Can you explain the purpose for the change in generateValue() ?
{code}
+ System.err.println(" [--miniCluster] [--nomapred] [--rows=ROWS] [--table=NAME] [--compress=TYPE] \\");
{code}
The above line is over 100 characters. Please put '[--compress=TYPE]' on the next line.
{code}
+ System.err.println(" compress Compression type to use. Default: 'NONE'");
{code}
It would be better if other options are listed.
> Add the ability for Performance Evaluation to set the table compression
> -----------------------------------------------------------------------
>
> Key: HBASE-5934
> URL: https://issues.apache.org/jira/browse/HBASE-5934
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Matteo Bertozzi
> Priority: Minor
> Attachments: HBASE-5934-v0.patch
>
>
> When testing it's nice to get a more realistic set of numbers. As such allowing the tool to create pre-split regions was needed. Compression should be the same.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5934) Add the ability for Performance
Evaluation to set the table compression
Posted by "Matteo Bertozzi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matteo Bertozzi updated HBASE-5934:
-----------------------------------
Fix Version/s: 0.96.0
> Add the ability for Performance Evaluation to set the table compression
> -----------------------------------------------------------------------
>
> Key: HBASE-5934
> URL: https://issues.apache.org/jira/browse/HBASE-5934
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Matteo Bertozzi
> Priority: Minor
> Fix For: 0.96.0
>
> Attachments: HBASE-5934-v0.patch, HBASE-5934-v1.patch
>
>
> When testing it's nice to get a more realistic set of numbers. As such allowing the tool to create pre-split regions was needed. Compression should be the same.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5934) Add the ability for Performance
Evaluation to set the table compression
Posted by "Lars Hofhansl (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13267996#comment-13267996 ]
Lars Hofhansl commented on HBASE-5934:
--------------------------------------
+1
> Add the ability for Performance Evaluation to set the table compression
> -----------------------------------------------------------------------
>
> Key: HBASE-5934
> URL: https://issues.apache.org/jira/browse/HBASE-5934
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Priority: Minor
>
> When testing it's nice to get a more realistic set of numbers. As such allowing the tool to create pre-split regions was needed. Compression should be the same.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5934) Add the ability for Performance
Evaluation to set the table compression
Posted by "Zhihong Ted Yu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13400179#comment-13400179 ]
Zhihong Ted Yu commented on HBASE-5934:
---------------------------------------
Patch v1 (actually v2) integrated to trunk.
Thanks for the patch, Matteo.
> Add the ability for Performance Evaluation to set the table compression
> -----------------------------------------------------------------------
>
> Key: HBASE-5934
> URL: https://issues.apache.org/jira/browse/HBASE-5934
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Matteo Bertozzi
> Priority: Minor
> Attachments: HBASE-5934-v0.patch, HBASE-5934-v1.patch
>
>
> When testing it's nice to get a more realistic set of numbers. As such allowing the tool to create pre-split regions was needed. Compression should be the same.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5934) Add the ability for Performance
Evaluation to set the table compression
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13400120#comment-13400120 ]
Hadoop QA commented on HBASE-5934:
----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12533212/HBASE-5934-v0.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
+1 hadoop2.0. The patch compiles against the hadoop 2.0 profile.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
-1 findbugs. The patch appears to introduce 11 new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in .
Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/2237//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2237//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2237//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html
Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/2237//console
This message is automatically generated.
> Add the ability for Performance Evaluation to set the table compression
> -----------------------------------------------------------------------
>
> Key: HBASE-5934
> URL: https://issues.apache.org/jira/browse/HBASE-5934
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Matteo Bertozzi
> Priority: Minor
> Attachments: HBASE-5934-v0.patch
>
>
> When testing it's nice to get a more realistic set of numbers. As such allowing the tool to create pre-split regions was needed. Compression should be the same.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5934) Add the ability for Performance
Evaluation to set the table compression
Posted by "Matteo Bertozzi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matteo Bertozzi updated HBASE-5934:
-----------------------------------
Status: Patch Available (was: Open)
> Add the ability for Performance Evaluation to set the table compression
> -----------------------------------------------------------------------
>
> Key: HBASE-5934
> URL: https://issues.apache.org/jira/browse/HBASE-5934
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Matteo Bertozzi
> Priority: Minor
> Attachments: HBASE-5934-v0.patch
>
>
> When testing it's nice to get a more realistic set of numbers. As such allowing the tool to create pre-split regions was needed. Compression should be the same.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5934) Add the ability for Performance
Evaluation to set the table compression
Posted by "Matteo Bertozzi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matteo Bertozzi updated HBASE-5934:
-----------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
> Add the ability for Performance Evaluation to set the table compression
> -----------------------------------------------------------------------
>
> Key: HBASE-5934
> URL: https://issues.apache.org/jira/browse/HBASE-5934
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Matteo Bertozzi
> Priority: Minor
> Attachments: HBASE-5934-v0.patch, HBASE-5934-v1.patch
>
>
> When testing it's nice to get a more realistic set of numbers. As such allowing the tool to create pre-split regions was needed. Compression should be the same.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5934) Add the ability for Performance
Evaluation to set the table compression
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13400174#comment-13400174 ]
Hadoop QA commented on HBASE-5934:
----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12533221/HBASE-5934-v1.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
+1 hadoop2.0. The patch compiles against the hadoop 2.0 profile.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
-1 findbugs. The patch appears to introduce 11 new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in .
Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/2240//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2240//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2240//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html
Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/2240//console
This message is automatically generated.
> Add the ability for Performance Evaluation to set the table compression
> -----------------------------------------------------------------------
>
> Key: HBASE-5934
> URL: https://issues.apache.org/jira/browse/HBASE-5934
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Matteo Bertozzi
> Priority: Minor
> Attachments: HBASE-5934-v0.patch, HBASE-5934-v1.patch
>
>
> When testing it's nice to get a more realistic set of numbers. As such allowing the tool to create pre-split regions was needed. Compression should be the same.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HBASE-5934) Add the ability for Performance
Evaluation to set the table compression
Posted by "Matteo Bertozzi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matteo Bertozzi reassigned HBASE-5934:
--------------------------------------
Assignee: Matteo Bertozzi
> Add the ability for Performance Evaluation to set the table compression
> -----------------------------------------------------------------------
>
> Key: HBASE-5934
> URL: https://issues.apache.org/jira/browse/HBASE-5934
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Matteo Bertozzi
> Priority: Minor
> Attachments: HBASE-5934-v0.patch
>
>
> When testing it's nice to get a more realistic set of numbers. As such allowing the tool to create pre-split regions was needed. Compression should be the same.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5934) Add the ability for Performance
Evaluation to set the table compression
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13400193#comment-13400193 ]
Hudson commented on HBASE-5934:
-------------------------------
Integrated in HBase-TRUNK #3064 (See [https://builds.apache.org/job/HBase-TRUNK/3064/])
HBASE-5934 Add the ability for Performance Evaluation to set the table compression (Matteo) (Revision 1353290)
Result = FAILURE
tedyu :
Files :
* /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/PerformanceEvaluation.java
> Add the ability for Performance Evaluation to set the table compression
> -----------------------------------------------------------------------
>
> Key: HBASE-5934
> URL: https://issues.apache.org/jira/browse/HBASE-5934
> Project: HBase
> Issue Type: Improvement
> Reporter: Elliott Clark
> Assignee: Matteo Bertozzi
> Priority: Minor
> Attachments: HBASE-5934-v0.patch, HBASE-5934-v1.patch
>
>
> When testing it's nice to get a more realistic set of numbers. As such allowing the tool to create pre-split regions was needed. Compression should be the same.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira