You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Xu Cang (JIRA)" <ji...@apache.org> on 2018/07/28 00:16:00 UTC

[jira] [Commented] (HBASE-20925) Canary test to expose table availability rate

    [ https://issues.apache.org/jira/browse/HBASE-20925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16560510#comment-16560510 ] 

Xu Cang commented on HBASE-20925:
---------------------------------

Example output:

username@username-wsl:~/Downloads/hbase-master-github/hbase$ bin/hbase org.apache.hadoop.hbase.tool.Canary -regionMode -tableAvailabilitySummary
2018-07-27 17:11:04,644 INFO [main] tool.Canary: Number of execution threads 16
2018-07-27 17:11:04,673 WARN [main] util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2018-07-27 17:11:04,912 INFO [main] zookeeper.ReadOnlyZKClient: Connect 0x1e730495 to localhost:2181 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms
2018-07-27 17:11:04,920 INFO [ReadOnlyZKClient-localhost:2181@0x1e730495] zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.10-39d3a4f269333c922ed3db283be479f9deacaa0f, built on 03/23/2017 10:13 GMT
2018-07-27 17:11:04,920 INFO [ReadOnlyZKClient-localhost:2181@0x1e730495] zookeeper.ZooKeeper: Client environment:host.name=username-wsl
2018-07-27 17:11:04,920 INFO [ReadOnlyZKClient-localhost:2181@0x1e730495] zookeeper.ZooKeeper: Client environment:java.version=1.8.0_171
2018-07-27 17:11:04,920 INFO [ReadOnlyZKClient-localhost:2181@0x1e730495] zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation
2018-07-27 17:11:04,920 INFO [ReadOnlyZKClient-localhost:2181@0x1e730495] zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-8-openjdk-amd64/jre
2018-07-27 17:11:04,920 INFO [ReadOnlyZKClient-localhost:2181@0x1e730495] zookeeper.ZooKeeper: ion-api-1.1.0.Final.jar:/home/username/Downloads/hbase-master-github/hbase/hbase-examples/target/hbase-examples-3.0.0-SNAPSHOT.jar:/home/username/Downloads/hbase-master-github/hbase/hbase-endpoint/target/hbase-endpoint-3.0.0-SNAPSHOT.jar:/home/username/.m2/repository/org/apache/curator/curator-framework/4.0.0/curator-framework-4.0.0.jar:/home/username/.m2/repository/org/apache/curator/curator-client/4.0.0/curator-client-4.0.0.jar:/home/username/.m2/repository/org/apache/curator/curator-recipes/4.0.0/curator-recipes-4.0.0.jar:/home/username/Downloads/hbase-master-github/hbase/hbase-zookeeper/target/hbase-zookeeper-3.0.0-SNAPSHOT.jar:/home/username/Downloads/hbase-master-github/hbase/hbase-rsgroup/target/hbase-rsgroup-3.0.0-SNAPSHOT.jar:/home/username/Downloads/hbase-master-github/hbase/hbase-annotations/target/hbase-annotations-3.0.0-SNAPSHOT-tests.jar:/home/username/.m2/repository/org/apache/yetus/audience-annotations/0.5.0/audience-annotations-0.5.0.jar:/home/username/.m2/repository/junit/junit/4.12/junit-4.12.jar
2018-07-27 17:11:04,920 INFO [ReadOnlyZKClient-localhost:2181@0x1e730495] zookeeper.ZooKeeper: Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib/x86_64-linux-gnu/jni:/lib/x86_64-linux-gnu:/usr/lib/x86_64-linux-gnu:/usr/lib/jni:/lib:/usr/lib
2018-07-27 17:11:04,920 INFO [ReadOnlyZKClient-localhost:2181@0x1e730495] zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp
2018-07-27 17:11:04,920 INFO [ReadOnlyZKClient-localhost:2181@0x1e730495] zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
2018-07-27 17:11:04,920 INFO [ReadOnlyZKClient-localhost:2181@0x1e730495] zookeeper.ZooKeeper: Client environment:os.name=Linux
2018-07-27 17:11:04,920 INFO [ReadOnlyZKClient-localhost:2181@0x1e730495] zookeeper.ZooKeeper: Client environment:os.arch=amd64
2018-07-27 17:11:04,921 INFO [ReadOnlyZKClient-localhost:2181@0x1e730495] zookeeper.ZooKeeper: Client environment:os.version=4.4.0-127-generic
2018-07-27 17:11:04,921 INFO [ReadOnlyZKClient-localhost:2181@0x1e730495] zookeeper.ZooKeeper: Client environment:user.name=username
2018-07-27 17:11:04,921 INFO [ReadOnlyZKClient-localhost:2181@0x1e730495] zookeeper.ZooKeeper: Client environment:user.home=/home/username
2018-07-27 17:11:04,921 INFO [ReadOnlyZKClient-localhost:2181@0x1e730495] zookeeper.ZooKeeper: Client environment:user.dir=/home/username/Downloads/hbase-master-github/hbase
2018-07-27 17:11:04,922 INFO [ReadOnlyZKClient-localhost:2181@0x1e730495] zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$12/1936622116@521189fe
2018-07-27 17:11:04,933 INFO [ReadOnlyZKClient-localhost:2181@0x1e730495-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2018-07-27 17:11:04,940 INFO [ReadOnlyZKClient-localhost:2181@0x1e730495-SendThread(localhost:2181)] zookeeper.ClientCnxn: Socket connection established to localhost/127.0.0.1:2181, initiating session
2018-07-27 17:11:04,955 INFO [ReadOnlyZKClient-localhost:2181@0x1e730495-SendThread(localhost:2181)] zookeeper.ClientCnxn: Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x164de393d4b0005, negotiated timeout = 40000
2018-07-27 17:11:06,779 INFO [pool-1-thread-1] tool.Canary: read from region MyTable,,1528403477779.51976dd0591633aa67528ec8c6f52ce3. on regionserver username-wsl,16020,1532736652050 column family mycf in 25ms
2018-07-27 17:11:06,795 INFO [pool-1-thread-1] tool.Canary: read from region mytable2,,1532728475497.72b99c8f6d90782835dd8ab95e50cb3b. on regionserver username-wsl,16020,1532736652050 column family mycf1 in 2ms
2018-07-27 17:11:06,808 INFO [pool-1-thread-2] tool.Canary: read from region mytable3,,1532728486429.30d24f969c65c00d460fca25a1598116. on regionserver username-wsl,16020,1532736652050 column family mycf2, mycf3 in 2ms
2018-07-27 17:11:06,821 INFO [pool-1-thread-1] tool.Canary: read from region mytable4,,1532728536550.9662b1ecc70b29a0c548274e3b6e3432. on regionserver username-wsl,16020,1532736652050 column family mycf2 in 2ms
2018-07-27 17:11:06,823 INFO [pool-1-thread-1] tool.Canary: read from region mytable4,,1532728536550.9662b1ecc70b29a0c548274e3b6e3432. on regionserver username-wsl,16020,1532736652050 column family mycf3 in 1ms
*2018-07-27 17:11:06,823 INFO [CanaryMonitor-1532736665083] tool.Canary: ========================================*
*2018-07-27 17:11:06,824 INFO [CanaryMonitor-1532736665083] tool.Canary: =============== Summary: ===============*
*2018-07-27 17:11:06,824 INFO [CanaryMonitor-1532736665083] tool.Canary: Read success rate for table : MyTable is: 1.0*
*2018-07-27 17:11:06,824 INFO [CanaryMonitor-1532736665083] tool.Canary: Read success rate for table : mytable3 is: 1.0*
*2018-07-27 17:11:06,824 INFO [CanaryMonitor-1532736665083] tool.Canary: Read success rate for table : mytable2 is: 1.0*
*2018-07-27 17:11:06,824 INFO [CanaryMonitor-1532736665083] tool.Canary: Read success rate for table : mytable4 is: 1.0*
*2018-07-27 17:11:06,824 INFO [CanaryMonitor-1532736665083] tool.Canary: ===============END======================*
2018-07-27 17:11:07,084 INFO [main] client.ConnectionImplementation: Closing master protocol: MasterService
2018-07-27 17:11:07,085 INFO [main] zookeeper.ReadOnlyZKClient: Close zookeeper connection 0x1e730495 to localhost:2181

 

> Canary test to expose table availability rate 
> ----------------------------------------------
>
>                 Key: HBASE-20925
>                 URL: https://issues.apache.org/jira/browse/HBASE-20925
>             Project: HBase
>          Issue Type: Improvement
>          Components: canary
>            Reporter: Xu Cang
>            Assignee: Xu Cang
>            Priority: Major
>         Attachments: HBASE-20925.master.001.patch
>
>
> Canary test to expose table availability rate.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)