You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Matteo Bertozzi (JIRA)" <ji...@apache.org> on 2012/11/13 10:51:13 UTC

[jira] [Created] (HBASE-7156) Add Data Block Encoding and -D opts to Performance Evaluation

Matteo Bertozzi created HBASE-7156:
--------------------------------------

             Summary: Add Data Block Encoding and -D opts to Performance Evaluation
                 Key: HBASE-7156
                 URL: https://issues.apache.org/jira/browse/HBASE-7156
             Project: HBase
          Issue Type: Improvement
          Components: test
            Reporter: Matteo Bertozzi
            Assignee: Matteo Bertozzi
            Priority: Minor
         Attachments: HBASE-7156-v0.patch

Add the ability to specify Data Block Encoding and other configuration options.

--blockEncoding=TYPE
-D <property=value>

Example:
hbase org.apache.hadoop.hbase.PerformanceEvaluation -D mapreduce.task.timeout=60000 --blockEncoding=DIFF sequentialWrite 1

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HBASE-7156) Add Data Block Encoding and -D opts to Performance Evaluation

Posted by "stack (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

stack updated HBASE-7156:
-------------------------

       Resolution: Fixed
    Fix Version/s: 0.96.0
     Hadoop Flags: Reviewed
           Status: Resolved  (was: Patch Available)

Committed to trunk.  Thanks for the patch Matteo.
                
> Add Data Block Encoding and -D opts to Performance Evaluation
> -------------------------------------------------------------
>
>                 Key: HBASE-7156
>                 URL: https://issues.apache.org/jira/browse/HBASE-7156
>             Project: HBase
>          Issue Type: Improvement
>          Components: test
>            Reporter: Matteo Bertozzi
>            Assignee: Matteo Bertozzi
>            Priority: Minor
>             Fix For: 0.96.0
>
>         Attachments: HBASE-7156-v0.patch, HBASE-7156-v1.patch, HBASE-7156-v2.patch, HBASE-7156-v3.patch
>
>
> Add the ability to specify Data Block Encoding and other configuration options.
> --blockEncoding=TYPE
> -D <property=value>
> Example:
> hbase org.apache.hadoop.hbase.PerformanceEvaluation -D mapreduce.task.timeout=60000 --blockEncoding=DIFF sequentialWrite 1

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HBASE-7156) Add Data Block Encoding and -D opts to Performance Evaluation

Posted by "Ted Yu (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13496404#comment-13496404 ] 

Ted Yu commented on HBASE-7156:
-------------------------------

+1 on second patch.
                
> Add Data Block Encoding and -D opts to Performance Evaluation
> -------------------------------------------------------------
>
>                 Key: HBASE-7156
>                 URL: https://issues.apache.org/jira/browse/HBASE-7156
>             Project: HBase
>          Issue Type: Improvement
>          Components: test
>            Reporter: Matteo Bertozzi
>            Assignee: Matteo Bertozzi
>            Priority: Minor
>         Attachments: HBASE-7156-v0.patch, HBASE-7156-v1.patch
>
>
> Add the ability to specify Data Block Encoding and other configuration options.
> --blockEncoding=TYPE
> -D <property=value>
> Example:
> hbase org.apache.hadoop.hbase.PerformanceEvaluation -D mapreduce.task.timeout=60000 --blockEncoding=DIFF sequentialWrite 1

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HBASE-7156) Add Data Block Encoding and -D opts to Performance Evaluation

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13496600#comment-13496600 ] 

Hadoop QA commented on HBASE-7156:
----------------------------------

{color:red}-1 overall{color}.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12553366/HBASE-7156-v2.patch
  against trunk revision .

    {color:green}+1 @author{color}.  The patch does not contain any @author tags.

    {color:green}+1 tests included{color}.  The patch appears to include 3 new or modified tests.

    {color:green}+1 hadoop2.0{color}.  The patch compiles against the hadoop 2.0 profile.

    {color:red}-1 javadoc{color}.  The javadoc tool appears to have generated 93 warning messages.

    {color:green}+1 javac{color}.  The applied patch does not increase the total number of javac compiler warnings.

    {color:red}-1 findbugs{color}.  The patch appears to introduce 17 new Findbugs (version 1.3.9) warnings.

    {color:green}+1 release audit{color}.  The applied patch does not increase the total number of release audit warnings.

    {color:green}+1 core tests{color}.  The patch passed unit tests in .

Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/3328//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/3328//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/3328//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-examples.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/3328//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/3328//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop1-compat.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/3328//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/3328//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/3328//console

This message is automatically generated.
                
> Add Data Block Encoding and -D opts to Performance Evaluation
> -------------------------------------------------------------
>
>                 Key: HBASE-7156
>                 URL: https://issues.apache.org/jira/browse/HBASE-7156
>             Project: HBase
>          Issue Type: Improvement
>          Components: test
>            Reporter: Matteo Bertozzi
>            Assignee: Matteo Bertozzi
>            Priority: Minor
>         Attachments: HBASE-7156-v0.patch, HBASE-7156-v1.patch, HBASE-7156-v2.patch, HBASE-7156-v3.patch
>
>
> Add the ability to specify Data Block Encoding and other configuration options.
> --blockEncoding=TYPE
> -D <property=value>
> Example:
> hbase org.apache.hadoop.hbase.PerformanceEvaluation -D mapreduce.task.timeout=60000 --blockEncoding=DIFF sequentialWrite 1

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HBASE-7156) Add Data Block Encoding and -D opts to Performance Evaluation

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13496623#comment-13496623 ] 

Hadoop QA commented on HBASE-7156:
----------------------------------

{color:red}-1 overall{color}.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12553372/HBASE-7156-v3.patch
  against trunk revision .

    {color:green}+1 @author{color}.  The patch does not contain any @author tags.

    {color:green}+1 tests included{color}.  The patch appears to include 3 new or modified tests.

    {color:green}+1 hadoop2.0{color}.  The patch compiles against the hadoop 2.0 profile.

    {color:red}-1 javadoc{color}.  The javadoc tool appears to have generated 93 warning messages.

    {color:green}+1 javac{color}.  The applied patch does not increase the total number of javac compiler warnings.

    {color:red}-1 findbugs{color}.  The patch appears to introduce 17 new Findbugs (version 1.3.9) warnings.

    {color:green}+1 release audit{color}.  The applied patch does not increase the total number of release audit warnings.

     {color:red}-1 core tests{color}.  The patch failed these unit tests:
                       org.apache.hadoop.hbase.client.TestMultiParallel

Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/3330//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/3330//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/3330//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-examples.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/3330//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop1-compat.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/3330//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/3330//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/3330//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/3330//console

This message is automatically generated.
                
> Add Data Block Encoding and -D opts to Performance Evaluation
> -------------------------------------------------------------
>
>                 Key: HBASE-7156
>                 URL: https://issues.apache.org/jira/browse/HBASE-7156
>             Project: HBase
>          Issue Type: Improvement
>          Components: test
>            Reporter: Matteo Bertozzi
>            Assignee: Matteo Bertozzi
>            Priority: Minor
>         Attachments: HBASE-7156-v0.patch, HBASE-7156-v1.patch, HBASE-7156-v2.patch, HBASE-7156-v3.patch
>
>
> Add the ability to specify Data Block Encoding and other configuration options.
> --blockEncoding=TYPE
> -D <property=value>
> Example:
> hbase org.apache.hadoop.hbase.PerformanceEvaluation -D mapreduce.task.timeout=60000 --blockEncoding=DIFF sequentialWrite 1

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HBASE-7156) Add Data Block Encoding and -D opts to Performance Evaluation

Posted by "stack (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13496583#comment-13496583 ] 

stack commented on HBASE-7156:
------------------------------

Both are valid.

+1 on latest patch.
                
> Add Data Block Encoding and -D opts to Performance Evaluation
> -------------------------------------------------------------
>
>                 Key: HBASE-7156
>                 URL: https://issues.apache.org/jira/browse/HBASE-7156
>             Project: HBase
>          Issue Type: Improvement
>          Components: test
>            Reporter: Matteo Bertozzi
>            Assignee: Matteo Bertozzi
>            Priority: Minor
>         Attachments: HBASE-7156-v0.patch, HBASE-7156-v1.patch, HBASE-7156-v2.patch, HBASE-7156-v3.patch
>
>
> Add the ability to specify Data Block Encoding and other configuration options.
> --blockEncoding=TYPE
> -D <property=value>
> Example:
> hbase org.apache.hadoop.hbase.PerformanceEvaluation -D mapreduce.task.timeout=60000 --blockEncoding=DIFF sequentialWrite 1

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HBASE-7156) Add Data Block Encoding and -D opts to Performance Evaluation

Posted by "stack (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13496499#comment-13496499 ] 

stack commented on HBASE-7156:
------------------------------

[~mbertozzi] If PE implemented http://hadoop.apache.org/docs/current/api/org/apache/hadoop/util/Tool.html, you'd get the -D stuff and some other bits and pieces for free?   As Himanshu says, this might not work the way folks expect:

{code}
+        if (cmd.equals("-D")) {
{code}

Often they won't have the space between the '-D' and config.
                
> Add Data Block Encoding and -D opts to Performance Evaluation
> -------------------------------------------------------------
>
>                 Key: HBASE-7156
>                 URL: https://issues.apache.org/jira/browse/HBASE-7156
>             Project: HBase
>          Issue Type: Improvement
>          Components: test
>            Reporter: Matteo Bertozzi
>            Assignee: Matteo Bertozzi
>            Priority: Minor
>         Attachments: HBASE-7156-v0.patch, HBASE-7156-v1.patch
>
>
> Add the ability to specify Data Block Encoding and other configuration options.
> --blockEncoding=TYPE
> -D <property=value>
> Example:
> hbase org.apache.hadoop.hbase.PerformanceEvaluation -D mapreduce.task.timeout=60000 --blockEncoding=DIFF sequentialWrite 1

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HBASE-7156) Add Data Block Encoding and -D opts to Performance Evaluation

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13496396#comment-13496396 ] 

Hadoop QA commented on HBASE-7156:
----------------------------------

{color:red}-1 overall{color}.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12553336/HBASE-7156-v1.patch
  against trunk revision .

    {color:green}+1 @author{color}.  The patch does not contain any @author tags.

    {color:green}+1 tests included{color}.  The patch appears to include 3 new or modified tests.

    {color:green}+1 hadoop2.0{color}.  The patch compiles against the hadoop 2.0 profile.

    {color:red}-1 javadoc{color}.  The javadoc tool appears to have generated 93 warning messages.

    {color:green}+1 javac{color}.  The applied patch does not increase the total number of javac compiler warnings.

    {color:red}-1 findbugs{color}.  The patch appears to introduce 17 new Findbugs (version 1.3.9) warnings.

    {color:green}+1 release audit{color}.  The applied patch does not increase the total number of release audit warnings.

     {color:red}-1 core tests{color}.  The patch failed these unit tests:
                       org.apache.hadoop.hbase.client.TestShell

Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/3327//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/3327//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/3327//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-examples.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/3327//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/3327//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop1-compat.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/3327//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/3327//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/3327//console

This message is automatically generated.
                
> Add Data Block Encoding and -D opts to Performance Evaluation
> -------------------------------------------------------------
>
>                 Key: HBASE-7156
>                 URL: https://issues.apache.org/jira/browse/HBASE-7156
>             Project: HBase
>          Issue Type: Improvement
>          Components: test
>            Reporter: Matteo Bertozzi
>            Assignee: Matteo Bertozzi
>            Priority: Minor
>         Attachments: HBASE-7156-v0.patch, HBASE-7156-v1.patch
>
>
> Add the ability to specify Data Block Encoding and other configuration options.
> --blockEncoding=TYPE
> -D <property=value>
> Example:
> hbase org.apache.hadoop.hbase.PerformanceEvaluation -D mapreduce.task.timeout=60000 --blockEncoding=DIFF sequentialWrite 1

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HBASE-7156) Add Data Block Encoding and -D opts to Performance Evaluation

Posted by "Matteo Bertozzi (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Matteo Bertozzi updated HBASE-7156:
-----------------------------------

    Attachment: HBASE-7156-v1.patch
    
> Add Data Block Encoding and -D opts to Performance Evaluation
> -------------------------------------------------------------
>
>                 Key: HBASE-7156
>                 URL: https://issues.apache.org/jira/browse/HBASE-7156
>             Project: HBase
>          Issue Type: Improvement
>          Components: test
>            Reporter: Matteo Bertozzi
>            Assignee: Matteo Bertozzi
>            Priority: Minor
>         Attachments: HBASE-7156-v0.patch, HBASE-7156-v1.patch
>
>
> Add the ability to specify Data Block Encoding and other configuration options.
> --blockEncoding=TYPE
> -D <property=value>
> Example:
> hbase org.apache.hadoop.hbase.PerformanceEvaluation -D mapreduce.task.timeout=60000 --blockEncoding=DIFF sequentialWrite 1

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HBASE-7156) Add Data Block Encoding and -D opts to Performance Evaluation

Posted by "Matteo Bertozzi (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Matteo Bertozzi updated HBASE-7156:
-----------------------------------

    Attachment: HBASE-7156-v3.patch
    
> Add Data Block Encoding and -D opts to Performance Evaluation
> -------------------------------------------------------------
>
>                 Key: HBASE-7156
>                 URL: https://issues.apache.org/jira/browse/HBASE-7156
>             Project: HBase
>          Issue Type: Improvement
>          Components: test
>            Reporter: Matteo Bertozzi
>            Assignee: Matteo Bertozzi
>            Priority: Minor
>         Attachments: HBASE-7156-v0.patch, HBASE-7156-v1.patch, HBASE-7156-v2.patch, HBASE-7156-v3.patch
>
>
> Add the ability to specify Data Block Encoding and other configuration options.
> --blockEncoding=TYPE
> -D <property=value>
> Example:
> hbase org.apache.hadoop.hbase.PerformanceEvaluation -D mapreduce.task.timeout=60000 --blockEncoding=DIFF sequentialWrite 1

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HBASE-7156) Add Data Block Encoding and -D opts to Performance Evaluation

Posted by "Ted Yu (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13496569#comment-13496569 ] 

Ted Yu commented on HBASE-7156:
-------------------------------

The space after '-D' should be removed, right ?
                
> Add Data Block Encoding and -D opts to Performance Evaluation
> -------------------------------------------------------------
>
>                 Key: HBASE-7156
>                 URL: https://issues.apache.org/jira/browse/HBASE-7156
>             Project: HBase
>          Issue Type: Improvement
>          Components: test
>            Reporter: Matteo Bertozzi
>            Assignee: Matteo Bertozzi
>            Priority: Minor
>         Attachments: HBASE-7156-v0.patch, HBASE-7156-v1.patch, HBASE-7156-v2.patch
>
>
> Add the ability to specify Data Block Encoding and other configuration options.
> --blockEncoding=TYPE
> -D <property=value>
> Example:
> hbase org.apache.hadoop.hbase.PerformanceEvaluation -D mapreduce.task.timeout=60000 --blockEncoding=DIFF sequentialWrite 1

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HBASE-7156) Add Data Block Encoding and -D opts to Performance Evaluation

Posted by "Matteo Bertozzi (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Matteo Bertozzi updated HBASE-7156:
-----------------------------------

    Attachment: HBASE-7156-v2.patch

new patch that uses Tool and ToolRunner for the -D option.
                
> Add Data Block Encoding and -D opts to Performance Evaluation
> -------------------------------------------------------------
>
>                 Key: HBASE-7156
>                 URL: https://issues.apache.org/jira/browse/HBASE-7156
>             Project: HBase
>          Issue Type: Improvement
>          Components: test
>            Reporter: Matteo Bertozzi
>            Assignee: Matteo Bertozzi
>            Priority: Minor
>         Attachments: HBASE-7156-v0.patch, HBASE-7156-v1.patch, HBASE-7156-v2.patch
>
>
> Add the ability to specify Data Block Encoding and other configuration options.
> --blockEncoding=TYPE
> -D <property=value>
> Example:
> hbase org.apache.hadoop.hbase.PerformanceEvaluation -D mapreduce.task.timeout=60000 --blockEncoding=DIFF sequentialWrite 1

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HBASE-7156) Add Data Block Encoding and -D opts to Performance Evaluation

Posted by "Matteo Bertozzi (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Matteo Bertozzi updated HBASE-7156:
-----------------------------------

    Attachment: HBASE-7156-v0.patch
    
> Add Data Block Encoding and -D opts to Performance Evaluation
> -------------------------------------------------------------
>
>                 Key: HBASE-7156
>                 URL: https://issues.apache.org/jira/browse/HBASE-7156
>             Project: HBase
>          Issue Type: Improvement
>          Components: test
>            Reporter: Matteo Bertozzi
>            Assignee: Matteo Bertozzi
>            Priority: Minor
>         Attachments: HBASE-7156-v0.patch
>
>
> Add the ability to specify Data Block Encoding and other configuration options.
> --blockEncoding=TYPE
> -D <property=value>
> Example:
> hbase org.apache.hadoop.hbase.PerformanceEvaluation -D mapreduce.task.timeout=60000 --blockEncoding=DIFF sequentialWrite 1

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HBASE-7156) Add Data Block Encoding and -D opts to Performance Evaluation

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13496839#comment-13496839 ] 

Hudson commented on HBASE-7156:
-------------------------------

Integrated in HBase-TRUNK #3537 (See [https://builds.apache.org/job/HBase-TRUNK/3537/])
    HBASE-7156 Add Data Block Encoding and -D opts to Performance Evaluation (Revision 1408986)

     Result = FAILURE
stack : 
Files : 
* /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/PerformanceEvaluation.java

                
> Add Data Block Encoding and -D opts to Performance Evaluation
> -------------------------------------------------------------
>
>                 Key: HBASE-7156
>                 URL: https://issues.apache.org/jira/browse/HBASE-7156
>             Project: HBase
>          Issue Type: Improvement
>          Components: test
>            Reporter: Matteo Bertozzi
>            Assignee: Matteo Bertozzi
>            Priority: Minor
>             Fix For: 0.96.0
>
>         Attachments: HBASE-7156-v0.patch, HBASE-7156-v1.patch, HBASE-7156-v2.patch, HBASE-7156-v3.patch
>
>
> Add the ability to specify Data Block Encoding and other configuration options.
> --blockEncoding=TYPE
> -D <property=value>
> Example:
> hbase org.apache.hadoop.hbase.PerformanceEvaluation -D mapreduce.task.timeout=60000 --blockEncoding=DIFF sequentialWrite 1

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HBASE-7156) Add Data Block Encoding and -D opts to Performance Evaluation

Posted by "Matteo Bertozzi (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Matteo Bertozzi updated HBASE-7156:
-----------------------------------

    Status: Patch Available  (was: Open)
    
> Add Data Block Encoding and -D opts to Performance Evaluation
> -------------------------------------------------------------
>
>                 Key: HBASE-7156
>                 URL: https://issues.apache.org/jira/browse/HBASE-7156
>             Project: HBase
>          Issue Type: Improvement
>          Components: test
>            Reporter: Matteo Bertozzi
>            Assignee: Matteo Bertozzi
>            Priority: Minor
>         Attachments: HBASE-7156-v0.patch
>
>
> Add the ability to specify Data Block Encoding and other configuration options.
> --blockEncoding=TYPE
> -D <property=value>
> Example:
> hbase org.apache.hadoop.hbase.PerformanceEvaluation -D mapreduce.task.timeout=60000 --blockEncoding=DIFF sequentialWrite 1

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HBASE-7156) Add Data Block Encoding and -D opts to Performance Evaluation

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13496091#comment-13496091 ] 

Hadoop QA commented on HBASE-7156:
----------------------------------

{color:red}-1 overall{color}.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12553292/HBASE-7156-v0.patch
  against trunk revision .

    {color:green}+1 @author{color}.  The patch does not contain any @author tags.

    {color:green}+1 tests included{color}.  The patch appears to include 3 new or modified tests.

    {color:green}+1 hadoop2.0{color}.  The patch compiles against the hadoop 2.0 profile.

    {color:red}-1 javadoc{color}.  The javadoc tool appears to have generated 93 warning messages.

    {color:green}+1 javac{color}.  The applied patch does not increase the total number of javac compiler warnings.

    {color:red}-1 findbugs{color}.  The patch appears to introduce 17 new Findbugs (version 1.3.9) warnings.

    {color:green}+1 release audit{color}.  The applied patch does not increase the total number of release audit warnings.

     {color:red}-1 core tests{color}.  The patch failed these unit tests:
                       org.apache.hadoop.hbase.client.TestMultiParallel
                  org.apache.hadoop.hbase.client.TestShell
                  org.apache.hadoop.hbase.io.hfile.TestForceCacheImportantBlocks
                  org.apache.hadoop.hbase.TestDrainingServer

Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/3325//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/3325//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/3325//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-examples.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/3325//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop1-compat.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/3325//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/3325//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/3325//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/3325//console

This message is automatically generated.
                
> Add Data Block Encoding and -D opts to Performance Evaluation
> -------------------------------------------------------------
>
>                 Key: HBASE-7156
>                 URL: https://issues.apache.org/jira/browse/HBASE-7156
>             Project: HBase
>          Issue Type: Improvement
>          Components: test
>            Reporter: Matteo Bertozzi
>            Assignee: Matteo Bertozzi
>            Priority: Minor
>         Attachments: HBASE-7156-v0.patch
>
>
> Add the ability to specify Data Block Encoding and other configuration options.
> --blockEncoding=TYPE
> -D <property=value>
> Example:
> hbase org.apache.hadoop.hbase.PerformanceEvaluation -D mapreduce.task.timeout=60000 --blockEncoding=DIFF sequentialWrite 1

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HBASE-7156) Add Data Block Encoding and -D opts to Performance Evaluation

Posted by "Matteo Bertozzi (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13496571#comment-13496571 ] 

Matteo Bertozzi commented on HBASE-7156:
----------------------------------------

{quote}The space after '-D' should be removed, right?{quote}

both syntax are valid... -D property=value or -Dproperty=value
if you look at the Export tool the help is mixed with space and not.
I find the space one much cleaner to read, but if we go for the non space one as default I'm ok with it.
                
> Add Data Block Encoding and -D opts to Performance Evaluation
> -------------------------------------------------------------
>
>                 Key: HBASE-7156
>                 URL: https://issues.apache.org/jira/browse/HBASE-7156
>             Project: HBase
>          Issue Type: Improvement
>          Components: test
>            Reporter: Matteo Bertozzi
>            Assignee: Matteo Bertozzi
>            Priority: Minor
>         Attachments: HBASE-7156-v0.patch, HBASE-7156-v1.patch, HBASE-7156-v2.patch, HBASE-7156-v3.patch
>
>
> Add the ability to specify Data Block Encoding and other configuration options.
> --blockEncoding=TYPE
> -D <property=value>
> Example:
> hbase org.apache.hadoop.hbase.PerformanceEvaluation -D mapreduce.task.timeout=60000 --blockEncoding=DIFF sequentialWrite 1

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HBASE-7156) Add Data Block Encoding and -D opts to Performance Evaluation

Posted by "Ted Yu (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13496323#comment-13496323 ] 

Ted Yu commented on HBASE-7156:
-------------------------------

{code}
+        if (cmd.equals("-D")) {
+          String[] keyval = args[++i].split("=", 2);
{code}
Consider checking that keyval.length is 2.

Otherwise patch looks good.
                
> Add Data Block Encoding and -D opts to Performance Evaluation
> -------------------------------------------------------------
>
>                 Key: HBASE-7156
>                 URL: https://issues.apache.org/jira/browse/HBASE-7156
>             Project: HBase
>          Issue Type: Improvement
>          Components: test
>            Reporter: Matteo Bertozzi
>            Assignee: Matteo Bertozzi
>            Priority: Minor
>         Attachments: HBASE-7156-v0.patch
>
>
> Add the ability to specify Data Block Encoding and other configuration options.
> --blockEncoding=TYPE
> -D <property=value>
> Example:
> hbase org.apache.hadoop.hbase.PerformanceEvaluation -D mapreduce.task.timeout=60000 --blockEncoding=DIFF sequentialWrite 1

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HBASE-7156) Add Data Block Encoding and -D opts to Performance Evaluation

Posted by "Himanshu Vashishtha (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13496442#comment-13496442 ] 

Himanshu Vashishtha commented on HBASE-7156:
--------------------------------------------

nit: -D option usually is prefixed with the option key, for example:  -Dhbase.client.scanner.caching=100, etc. Why not be consistent here too. Otherwise looks good to me.
                
> Add Data Block Encoding and -D opts to Performance Evaluation
> -------------------------------------------------------------
>
>                 Key: HBASE-7156
>                 URL: https://issues.apache.org/jira/browse/HBASE-7156
>             Project: HBase
>          Issue Type: Improvement
>          Components: test
>            Reporter: Matteo Bertozzi
>            Assignee: Matteo Bertozzi
>            Priority: Minor
>         Attachments: HBASE-7156-v0.patch, HBASE-7156-v1.patch
>
>
> Add the ability to specify Data Block Encoding and other configuration options.
> --blockEncoding=TYPE
> -D <property=value>
> Example:
> hbase org.apache.hadoop.hbase.PerformanceEvaluation -D mapreduce.task.timeout=60000 --blockEncoding=DIFF sequentialWrite 1

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HBASE-7156) Add Data Block Encoding and -D opts to Performance Evaluation

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13496847#comment-13496847 ] 

Hudson commented on HBASE-7156:
-------------------------------

Integrated in HBase-TRUNK-on-Hadoop-2.0.0 #259 (See [https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/259/])
    HBASE-7156 Add Data Block Encoding and -D opts to Performance Evaluation (Revision 1408986)

     Result = FAILURE
stack : 
Files : 
* /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/PerformanceEvaluation.java

                
> Add Data Block Encoding and -D opts to Performance Evaluation
> -------------------------------------------------------------
>
>                 Key: HBASE-7156
>                 URL: https://issues.apache.org/jira/browse/HBASE-7156
>             Project: HBase
>          Issue Type: Improvement
>          Components: test
>            Reporter: Matteo Bertozzi
>            Assignee: Matteo Bertozzi
>            Priority: Minor
>             Fix For: 0.96.0
>
>         Attachments: HBASE-7156-v0.patch, HBASE-7156-v1.patch, HBASE-7156-v2.patch, HBASE-7156-v3.patch
>
>
> Add the ability to specify Data Block Encoding and other configuration options.
> --blockEncoding=TYPE
> -D <property=value>
> Example:
> hbase org.apache.hadoop.hbase.PerformanceEvaluation -D mapreduce.task.timeout=60000 --blockEncoding=DIFF sequentialWrite 1

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira