You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "HBase QA (JIRA)" <ji...@apache.org> on 2019/07/25 19:23:00 UTC
[jira] [Commented] (HBASE-21773) rowcounter utility should respond
to pleas for help
[ https://issues.apache.org/jira/browse/HBASE-21773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16893080#comment-16893080 ]
HBase QA commented on HBASE-21773:
----------------------------------
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 1m 4s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green} 0m 0s{color} | {color:green} Patch does not have any anti-patterns. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m 0s{color} | {color:green} The patch appears to include 1 new or modified test files. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 39s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 6m 23s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 57s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 53s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 5m 37s{color} | {color:green} branch has no errors when building our shaded downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 1m 41s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 43s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 20s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 6m 13s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 55s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m 55s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m 22s{color} | {color:red} hbase-mapreduce: The patch generated 1 new + 43 unchanged - 1 fixed = 44 total (was 44) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 5m 39s{color} | {color:green} patch has no errors when building our shaded downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green} 19m 5s{color} | {color:green} Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 1m 58s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 42s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 3m 23s{color} | {color:green} hbase-common in the patch passed. {color} |
| {color:red}-1{color} | {color:red} unit {color} | {color:red} 23m 52s{color} | {color:red} hbase-mapreduce in the patch failed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 45s{color} | {color:green} The patch does not generate ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 88m 47s{color} | {color:black} {color} |
\\
\\
|| Reason || Tests ||
| Failed junit tests | hadoop.hbase.snapshot.TestMobSecureExportSnapshot |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=19.03.0 Server=19.03.0 base: https://builds.apache.org/job/PreCommit-HBASE-Build/670/artifact/patchprocess/Dockerfile |
| JIRA Issue | HBASE-21773 |
| JIRA Patch URL | https://issues.apache.org/jira/secure/attachment/12957012/HBASE-21773.master.004.patch |
| Optional Tests | dupname asflicense javac javadoc unit findbugs shadedjars hadoopcheck hbaseanti checkstyle compile |
| uname | Linux 1100b310c01f 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | dev-support/hbase-personality.sh |
| git revision | master / de98fee288 |
| maven | version: Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z) |
| Default Java | 1.8.0_181 |
| findbugs | v3.1.11 |
| checkstyle | https://builds.apache.org/job/PreCommit-HBASE-Build/670/artifact/patchprocess/diff-checkstyle-hbase-mapreduce.txt |
| unit | https://builds.apache.org/job/PreCommit-HBASE-Build/670/artifact/patchprocess/patch-unit-hbase-mapreduce.txt |
| Test Results | https://builds.apache.org/job/PreCommit-HBASE-Build/670/testReport/ |
| Max. process+thread count | 5513 (vs. ulimit of 10000) |
| modules | C: hbase-common hbase-mapreduce U: . |
| Console output | https://builds.apache.org/job/PreCommit-HBASE-Build/670/console |
| Powered by | Apache Yetus 0.9.0 http://yetus.apache.org |
This message was automatically generated.
> rowcounter utility should respond to pleas for help
> ---------------------------------------------------
>
> Key: HBASE-21773
> URL: https://issues.apache.org/jira/browse/HBASE-21773
> Project: HBase
> Issue Type: Bug
> Components: tooling
> Affects Versions: 2.1.0
> Reporter: Sean Busbey
> Assignee: Wellington Chevreuil
> Priority: Critical
> Attachments: HBASE-21773.master.001.patch, HBASE-21773.master.002.patch, HBASE-21773.master.003.patch, HBASE-21773.master.004.patch
>
>
> {{hbase rowcounter}} does not respond to reasonable requests for help, i.e. {{--help}}, {{-h}}, or {{-?}}
> {code}
> [systest@busbey-training-1 root]$ hbase rowcounter -?
> OpenJDK 64-Bit Server VM warning: Using incremental CMS is deprecated and will likely be removed in a future release
> 19/01/24 12:30:00 INFO client.RMProxy: Connecting to ResourceManager at busbey-training-1.gce.cloudera.com/172.31.116.31:8032
> 19/01/24 12:30:01 INFO hdfs.DFSClient: Created token for systest: HDFS_DELEGATION_TOKEN owner=systest@GCE.CLOUDERA.COM, renewer=yarn, realUser=, issueDate=1548361801519, maxDate=1548966601519, sequenceNumber=3, masterKeyId=8 on 172.31.116.31:8020
> 19/01/24 12:30:01 INFO kms.KMSClientProvider: Getting new token from https://busbey-training-3.gce.cloudera.com:16000/kms/v1/, renewer:yarn/busbey-training-1.gce.cloudera.com@GCE.CLOUDERA.COM
> 19/01/24 12:30:02 INFO kms.KMSClientProvider: New token received: (Kind: kms-dt, Service: 172.31.116.52:16000, Ident: (kms-dt owner=systest, renewer=yarn, realUser=, issueDate=1548361801965, maxDate=1548966601965, sequenceNumber=5, masterKeyId=17))
> 19/01/24 12:30:02 INFO security.TokenCache: Got dt for hdfs://busbey-training-1.gce.cloudera.com:8020; Kind: HDFS_DELEGATION_TOKEN, Service: 172.31.116.31:8020, Ident: (token for systest: HDFS_DELEGATION_TOKEN owner=systest@GCE.CLOUDERA.COM, renewer=yarn, realUser=, issueDate=1548361801519, maxDate=1548966601519, sequenceNumber=3, masterKeyId=8)
> 19/01/24 12:30:02 INFO security.TokenCache: Got dt for hdfs://busbey-training-1.gce.cloudera.com:8020; Kind: kms-dt, Service: 172.31.116.52:16000, Ident: (kms-dt owner=systest, renewer=yarn, realUser=, issueDate=1548361801965, maxDate=1548966601965, sequenceNumber=5, masterKeyId=17)
> 19/01/24 12:30:02 INFO kms.KMSClientProvider: Getting new token from https://busbey-training-4.gce.cloudera.com:16000/kms/v1/, renewer:yarn/busbey-training-1.gce.cloudera.com@GCE.CLOUDERA.COM
> 19/01/24 12:30:02 INFO kms.KMSClientProvider: New token received: (Kind: kms-dt, Service: 172.31.116.50:16000, Ident: (kms-dt owner=systest, renewer=yarn, realUser=, issueDate=1548361802363, maxDate=1548966602363, sequenceNumber=6, masterKeyId=18))
> 19/01/24 12:30:02 INFO security.TokenCache: Got dt for hdfs://busbey-training-1.gce.cloudera.com:8020; Kind: kms-dt, Service: 172.31.116.50:16000, Ident: (kms-dt owner=systest, renewer=yarn, realUser=, issueDate=1548361802363, maxDate=1548966602363, sequenceNumber=6, masterKeyId=18)
> 19/01/24 12:30:02 INFO mapreduce.JobResourceUploader: Disabling Erasure Coding for path: /user/systest/.staging/job_1548349234632_0003
> 19/01/24 12:30:03 INFO mapreduce.JobSubmitter: Cleaning up the staging area /user/systest/.staging/job_1548349234632_0003
> Exception in thread "main" java.lang.IllegalArgumentException: Illegal first character <45> at 0. User-space table qualifiers can only start with 'alphanumeric characters' from any language: -?
> at org.apache.hadoop.hbase.TableName.isLegalTableQualifierName(TableName.java:193)
> at org.apache.hadoop.hbase.TableName.isLegalTableQualifierName(TableName.java:156)
> at org.apache.hadoop.hbase.TableName.<init>(TableName.java:346)
> at org.apache.hadoop.hbase.TableName.createTableNameIfNecessary(TableName.java:382)
> at org.apache.hadoop.hbase.TableName.valueOf(TableName.java:469)
> at org.apache.hadoop.hbase.mapreduce.TableInputFormat.initialize(TableInputFormat.java:198)
> at org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.getSplits(TableInputFormatBase.java:243)
> at org.apache.hadoop.hbase.mapreduce.TableInputFormat.getSplits(TableInputFormat.java:254)
> at org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:310)
> at org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:327)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:200)
> at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1570)
> at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1567)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1875)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1567)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1588)
> at org.apache.hadoop.hbase.mapreduce.RowCounter.run(RowCounter.java:242)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
> at org.apache.hadoop.hbase.mapreduce.RowCounter.main(RowCounter.java:261)
> [systest@busbey-training-1 root]$ hbase rowcounter
> OpenJDK 64-Bit Server VM warning: Using incremental CMS is deprecated and will likely be removed in a future release
> ERROR: Wrong number of parameters: 0
> Usage: hbase rowcounter [options] <tablename> [--starttime=<start> --endtime=<end>] [--range=[startKey],[endKey][;[startKey],[endKey]...]] [<column1> <column2>...]
> For performance consider the following options:
> -Dhbase.client.scanner.caching=100
> -Dmapreduce.map.speculative=false
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)