You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Oliver Buckley-Salmon <ol...@db.com> on 2016/11/07 14:49:01 UTC

Can connect to HBase via Java API but can't create table

Hi

I am trying to create a table in HBase using the Java API, I can connect to Zookeeper

2016-11-06 15:18:36 INFO  RecoverableZooKeeper:120 - Process identifier=hconnection-0x382db087 connecting to ZooKeeper ensemble=138.68.147.208:2181
2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT
2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client environment:host.name=olivers-air.default
2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client environment:java.version=1.8.0_45
2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client environment:java.vendor=Oracle Corporation
2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client environment:java.home=/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre
2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client environment:java.class.path=/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/charsets.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/deploy.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/ext/cldrdata.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/ext/dnsns.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/ext/jfxrt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/ext/localedata.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/ext/nashorn.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/ext/sunec.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/ext/sunjce_provider.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/ext/sunpkcs11.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/ext/zipfs.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/javaws.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/jce.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/jfr.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/jfxswt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/jsse.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/management-agent.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/plugin.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/resources.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/rt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/ant-javafx.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/dt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/javafx-mx.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/jconsole.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/packager.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/sa-jdi.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/tools.jar:/Users/oliverbuckley-salmon/IdeaProjects/sandpit/database/target/classes:/Users/oliverbuckley-salmon/IdeaProjects/sandpit/domain/target/classes:/Users/oliverbuckley-salmon/.m2/repository/com/google/code/gson/gson/2.6.2/gson-2.6.2.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/hbase/hbase-client/1.2.3/hbase-client-1.2.3.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/hbase/hbase-annotations/1.2.3/hbase-annotations-1.2.3.jar:/Users/oliverbuckley-salmon/.m2/repository/com/github/stephenc/findbugs/findbugs-annotations/1.3.9-1/findbugs-annotations-1.3.9-1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/hbase/hbase-common/1.2.3/hbase-common-1.2.3.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar:/Users/oliverbuckley-salmon/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/hbase/hbase-protocol/1.2.3/hbase-protocol-1.2.3.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-codec/commons-codec/1.9/commons-codec-1.9.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-logging/commons-logging/1.2/commons-logging-1.2.jar:/Users/oliverbuckley-salmon/.m2/repository/com/google/guava/guava/12.0.1/guava-12.0.1.jar:/Users/oliverbuckley-salmon/.m2/repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar:/Users/oliverbuckley-salmon/.m2/repository/io/netty/netty-all/4.0.23.Final/netty-all-4.0.23.Final.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/zookeeper/zookeeper/3.4.6/zookeeper-3.4.6.jar:/Users/oliverbuckley-salmon/.m2/repository/org/slf4j/slf4j-api/1.6.1/slf4j-api-1.6.1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/slf4j/slf4j-log4j12/1.6.1/slf4j-log4j12-1.6.1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/htrace/htrace-core/3.1.0-incubating/htrace-core-3.1.0-incubating.jar:/Users/oliverbuckley-salmon/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.13.jar:/Users/oliverbuckley-salmon/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar:/Users/oliverbuckley-salmon/.m2/repository/org/jruby/jcodings/jcodings/1.0.8/jcodings-1.0.8.jar:/Users/oliverbuckley-salmon/.m2/repository/org/jruby/joni/joni/2.1.2/joni-2.1.2.jar:/Users/oliverbuckley-salmon/.m2/repository/com/yammer/metrics/metrics-core/2.2.0/metrics-core-2.2.0.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/hadoop/hadoop-auth/2.5.1/hadoop-auth-2.5.1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/httpcomponents/httpclient/4.2.5/httpclient-4.2.5.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/httpcomponents/httpcore/4.2.4/httpcore-4.2.4.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/directory/server/apacheds-kerberos-codec/2.0.0-M15/apacheds-kerberos-codec-2.0.0-M15.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/directory/server/apacheds-i18n/2.0.0-M15/apacheds-i18n-2.0.0-M15.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/directory/api/api-asn1-api/1.0.0-M20/api-asn1-api-1.0.0-M20.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/directory/api/api-util/1.0.0-M20/api-util-1.0.0-M20.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/hadoop/hadoop-common/2.5.1/hadoop-common-2.5.1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/hadoop/hadoop-annotations/2.5.1/hadoop-annotations-2.5.1.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/commons/commons-math3/3.1.1/commons-math3-3.1.1.jar:/Users/oliverbuckley-salmon/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-net/commons-net/3.1/commons-net-3.1.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-el/commons-el/1.0/commons-el-1.0.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-beanutils/commons-beanutils-core/1.8.0/commons-beanutils-core-1.8.0.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/avro/avro/1.7.4/avro-1.7.4.jar:/Users/oliverbuckley-salmon/.m2/repository/com/thoughtworks/paranamer/paranamer/2.3/paranamer-2.3.jar:/Users/oliverbuckley-salmon/.m2/repository/org/xerial/snappy/snappy-java/1.0.4.1/snappy-java-1.0.4.1.jar:/Users/oliverbuckley-salmon/.m2/repository/com/jcraft/jsch/0.1.42/jsch-0.1.42.jar:/Users/oliverbuckley-salmon/.m2/repository/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/commons/commons-compress/1.4.1/commons-compress-1.4.1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/tukaani/xz/1.0/xz-1.0.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.5.1/hadoop-mapreduce-client-core-2.5.1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/hadoop/hadoop-yarn-common/2.5.1/hadoop-yarn-common-2.5.1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/hadoop/hadoop-yarn-api/2.5.1/hadoop-yarn-api-2.5.1.jar:/Users/oliverbuckley-salmon/.m2/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar:/Users/oliverbuckley-salmon/.m2/repository/javax/xml/stream/stax-api/1.0-2/stax-api-1.0-2.jar:/Users/oliverbuckley-salmon/.m2/repository/javax/activation/activation/1.1/activation-1.1.jar:/Users/oliverbuckley-salmon/.m2/repository/io/netty/netty/3.6.2.Final/netty-3.6.2.Final.jar:/Users/oliverbuckley-salmon/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar:/Users/oliverbuckley-salmon/.m2/repository/com/hazelcast/hazelcast-all/3.7.2/hazelcast-all-3.7.2.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/curator/curator-framework/2.10.0/curator-framework-2.10.0.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/curator/curator-client/2.10.0/curator-client-2.10.0.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/curator/curator-x-discovery/2.10.0/curator-x-discovery-2.10.0.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/curator/curator-recipes/2.10.0/curator-recipes-2.10.0.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/curator/curator-test/2.10.0/curator-test-2.10.0.jar:/Users/oliverbuckley-salmon/.m2/repository/org/javassist/javassist/3.18.1-GA/javassist-3.18.1-GA.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/commons/commons-math/2.2/commons-math-2.2.jar:/Users/oliverbuckley-salmon/.m2/repository/com/hazelcast/hazelcast-zookeeper/3.6.1/hazelcast-zookeeper-3.6.1.jar:/Users/oliverbuckley-salmon/.m2/repository/joda-time/joda-time/2.9.4/joda-time-2.9.4.jar:/Applications/IntelliJ IDEA.app/Contents/lib/idea_rt.jar
2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client environment:java.library.path=/Users/oliverbuckley-salmon/Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java:.
2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client environment:java.io.tmpdir=/var/folders/sx/g9vbcw9d3j54gtj89n57g1fw0000gn/T/
2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client environment:java.compiler=<NA>
2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client environment:os.name=Mac OS X
2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client environment:os.arch=x86_64
2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client environment:os.version=10.11.6
2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client environment:user.name=oliverbuckley-salmon
2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client environment:user.home=/Users/oliverbuckley-salmon
2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client environment:user.dir=/Users/oliverbuckley-salmon/IdeaProjects/sandpit
2016-11-06 15:18:36 INFO  ZooKeeper:438 - Initiating client connection, connectString=138.68.147.208:2181 sessionTimeout=90000 watcher=hconnection-0x382db0870x0, quorum=138.68.147.208:2181, baseZNode=/hbase
2016-11-06 15:18:37 INFO  ClientCnxn:975 - Opening socket connection to server 138.68.147.208/138.68.147.208:2181. Will not attempt to authenticate using SASL (unknown error)
2016-11-06 15:18:37 INFO  ClientCnxn:852 - Socket connection established to 138.68.147.208/138.68.147.208:2181, initiating session
2016-11-06 15:18:37 INFO  ClientCnxn:1235 - Session establishment complete on server 138.68.147.208/138.68.147.208:2181, sessionid = 0x158273e5275001d, negotiated timeout = 90000

I can connect to HBase as I can see it in the debugger, but when I try to create a table it fails after 35 retries with
org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException

I can connect to HBase with the UI and can see the Master and Region servers.

My code looks like this
Configuration hBaseConfig =  HBaseConfiguration.create();
            hBaseConfig.setInt("timeout", 120000);
            hBaseConfig.set("hbase.master", hbaseHost + ":60000");
            hBaseConfig.set("hbase.zookeeper.quorum",zookeeperHost);
            hBaseConfig.set("hbase.zookeeper.property.clientPort", "2181");

            logger.info("Trying to connect to HBase");
            Connection connection = ConnectionFactory.createConnection(hBaseConfig);
            Admin admin = connection.getAdmin();
            logger.info("Connected to HBase");

            logger.info("Trying to create tables");
            createSchemaTables(admin);
            logger.info("Tables created");

CreateSchemaTables looks like this and the code fails and retries at admin.createTable(table);
public static void createSchemaTables(Admin admin) throws IOException {



        HTableDescriptor table = new HTableDescriptor(TableName.valueOf(tableName));
        HColumnDescriptor cf = new HColumnDescriptor(columnFamily).setCompressionType(Algorithm.NONE);

        table.addFamily(cf);

        System.out.print("Creating table. ");
        admin.createTable(table);
        System.out.println(" Done.");

The client is running on my Mac Air and Hbase is running in a Docker container (nerdammer/hbase) Digital Ocean.

Does anyone have any idea why I can connect to HBase but not create tables?

Thanks in advance for your help, Oliver




---
This e-mail may contain confidential and/or privileged information. If you are not the intended recipient (or have received this e-mail in error) please notify the sender immediately and delete this e-mail. Any unauthorized copying, disclosure or distribution of the material in this e-mail is strictly forbidden.

Please refer to https://www.db.com/disclosures for additional EU corporate and regulatory disclosures and to http://www.db.com/unitedkingdom/content/privacy.htm for information about privacy.

Re: Can connect to HBase via Java API but can't create table

Posted by Stack <st...@duboce.net>.
On Tue, Nov 15, 2016 at 12:53 PM, Oliver Buckley-Salmon <
oliver.buckley-salmon@db.com> wrote:

> Thanks, the HBase region server was returning its docker container Id.
> Mapped that to the server IP in my hosts file and all working now.
> Something to watch out for if you've got HBase running in docker
> containers.
>
>
Thanks for updating the list.
S




>
>
> -----Original Message-----
> From: Stack [stack@duboce.net<ma...@duboce.net>]
> Sent: Friday, November 11, 2016 01:37 AM W. Europe Standard Time
> To: Hbase-User
> Subject: Re: Can connect to HBase via Java API but can't create table
>
>
> Please fix unknown host. The hbase client doesn't know how to get to the
> server.
> St.Ack
>
> On Tue, Nov 8, 2016 at 12:26 AM, Oliver Buckley-Salmon <
> oliver.buckley-salmon@db.com> wrote:
>
> > Hi,
> > Here's a better exception
> >
> > Exception in thread "main" org.apache.hadoop.hbase.client.
> RetriesExhaustedException:
> > Failed after attempts=36, exceptions:
> > Tue Nov 08 07:06:48 GMT 2016, null, java.net.SocketTimeoutException:
> > callTimeout=60000, callDuration=69291: row 'INSTRUMENT,,' on table
> > 'hbase:meta' at region=hbase:meta,,1.1588230740,
> > hostname=e5611ffad72e,60020,1478588595835, seqNum=0
> >
> >                 at org.apache.hadoop.hbase.client
> > .RpcRetryingCallerWithReadReplicas.throwEnrichedException(Rp
> > cRetryingCallerWithReadReplicas.java:276)
> >                 at org.apache.hadoop.hbase.client
> > .ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:210)
> >                 at org.apache.hadoop.hbase.client
> > .ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:60)
> >                 at org.apache.hadoop.hbase.client
> > .RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:210)
> >                 at org.apache.hadoop.hbase.client
> > .ClientScanner.call(ClientScanner.java:326)
> >                 at org.apache.hadoop.hbase.client
> > .ClientScanner.nextScanner(ClientScanner.java:301)
> >                 at org.apache.hadoop.hbase.client
> > .ClientScanner.initializeScannerInConstruction(ClientScanner.java:166)
> >                 at org.apache.hadoop.hbase.client
> > .ClientScanner.<init>(ClientScanner.java:161)
> >                 at org.apache.hadoop.hbase.client
> > .HTable.getScanner(HTable.java:797)
> >                 at org.apache.hadoop.hbase.MetaTa
> > bleAccessor.fullScan(MetaTableAccessor.java:602)
> >                 at org.apache.hadoop.hbase.MetaTa
> > bleAccessor.tableExists(MetaTableAccessor.java:366)
> >                 at org.apache.hadoop.hbase.client
> > .HBaseAdmin.tableExists(HBaseAdmin.java:406)
> >                 at com.example.projects.database.
> > schema.SchemaBuilder.createOrOverwrite(SchemaBuilder.java:31)
> >                 at com.example.projects.database.
> > schema.SchemaBuilder.createSchemaTables(SchemaBuilder.java:52)
> >                 at com.example.projects.database.
> > schema.SchemaBuilder.main(SchemaBuilder.java:94)
> >                 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> > Method)
> >                 at sun.reflect.NativeMethodAccess
> > orImpl.invoke(NativeMethodAccessorImpl.java:62)
> >                 at sun.reflect.DelegatingMethodAc
> > cessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >                 at java.lang.reflect.Method.invoke(Method.java:497)
> >                 at com.intellij.rt.execution.appl
> > ication.AppMain.main(AppMain.java:147)
> > Caused by: java.net.SocketTimeoutException: callTimeout=60000,
> > callDuration=69291: row 'INSTRUMENT,,' on table 'hbase:meta' at
> > region=hbase:meta,,1.1588230740, hostname=e5611ffad72e,60020,
> 1478588595835,
> > seqNum=0
> >                 at org.apache.hadoop.hbase.client
> > .RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:169)
> >                 at org.apache.hadoop.hbase.client
> > .ResultBoundedCompletionService$QueueingFuture.run(ResultBou
> > ndedCompletionService.java:65)
> >                 at java.util.concurrent.ThreadPoo
> > lExecutor.runWorker(ThreadPoolExecutor.java:1142)
> >                 at java.util.concurrent.ThreadPoo
> > lExecutor$Worker.run(ThreadPoolExecutor.java:617)
> >                 at java.lang.Thread.run(Thread.java:745)
> > Caused by: java.net.UnknownHostException: e5611ffad72e
> >                 at org.apache.hadoop.hbase.ipc.Ab
> > stractRpcClient$BlockingRpcChannelImplementation.<init>(
> > AbstractRpcClient.java:315)
> >                 at org.apache.hadoop.hbase.ipc.Ab
> > stractRpcClient.createBlockingRpcChannel(AbstractRpcClient.java:267)
> >                 at org.apache.hadoop.hbase.client
> > .ConnectionManager$HConnectionImplementation.getClient(
> > ConnectionManager.java:1639)
> >                 at org.apache.hadoop.hbase.client.ScannerCallable.
> prepare(
> > ScannerCallable.java:162)
> >                 at org.apache.hadoop.hbase.client
> > .ScannerCallableWithReplicas$RetryingRPC.prepare(ScannerCall
> > ableWithReplicas.java:376)
> >                 at org.apache.hadoop.hbase.client
> > .RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:134)
> >                 ... 4 more
> > Thanks again for your help,
> > Oliver
> >
> > -----Original Message-----
> > From: Oliver Buckley-Salmon [mailto:oliver.buckley-salmon+
> external@db.com]
> > Sent: 07 November 2016 15:47
> > To: user@hbase.apache.org
> > Subject: RE: Can connect to HBase via Java API but can't create table
> >
> > Hi,
> > Here's the log on Debug
> > 2016-11-07 15:32:01 INFO  InstrumentLoader:61 - Trying to connect to
> HBase
> > 2016-11-07 15:32:01 DEBUG Groups:238 -  Creating new Groups object
> > 2016-11-07 15:32:01 DEBUG NativeCodeLoader:46 - Trying to load the
> > custom-built native-hadoop library...
> > 2016-11-07 15:32:01 DEBUG NativeCodeLoader:55 - Failed to load
> > native-hadoop with error: java.lang.UnsatisfiedLinkError: no hadoop in
> > java.library.path
> > 2016-11-07 15:32:01 DEBUG NativeCodeLoader:56 -
> > java.library.path=/Users/oliverbuckley-salmon/Library/Java/
> > Extensions:/Library/Java/Extensions:/Network/Library/Java/
> > Extensions:/System/Library/Java/Extensions:/usr/lib/java:.
> > 2016-11-07 15:32:01 WARN  NativeCodeLoader:62 - Unable to load
> > native-hadoop library for your platform... using builtin-java classes
> where
> > applicable
> > 2016-11-07 15:32:01 DEBUG JniBasedUnixGroupsMappingWithFallback:40 -
> > Falling back to shell based
> > 2016-11-07 15:32:01 DEBUG JniBasedUnixGroupsMappingWithFallback:44 -
> > Group mapping impl=org.apache.hadoop.security.
> ShellBasedUnixGroupsMapping
> > 2016-11-07 15:32:01 DEBUG Shell:320 - Failed to detect a valid hadoop
> home
> > directory
> > java.io.IOException: HADOOP_HOME or hadoop.home.dir are not set.
> >                 at org.apache.hadoop.util.Shell.c
> > heckHadoopHome(Shell.java:302)
> >                 at org.apache.hadoop.util.Shell.<clinit>(Shell.java:327)
> >                 at org.apache.hadoop.util.StringU
> > tils.<clinit>(StringUtils.java:78)
> >                 at org.apache.hadoop.security.Gro
> > ups.parseStaticMapping(Groups.java:93)
> >                 at org.apache.hadoop.security.Gro
> > ups.<init>(Groups.java:77)
> >                 at org.apache.hadoop.security.Gro
> > ups.getUserToGroupsMappingService(Groups.java:240)
> >                 at org.apache.hadoop.security.Gro
> > ups.getUserToGroupsMappingService(Groups.java:225)
> >                 at org.apache.hadoop.hbase.
> security.UserProvider.<clinit>(
> > UserProvider.java:56)
> >                 at org.apache.hadoop.hbase.client
> > .ConnectionFactory.createConnection(ConnectionFactory.java:214)
> >                 at org.apache.hadoop.hbase.client
> > .ConnectionFactory.createConnection(ConnectionFactory.java:119)
> >                 at com.example.projects.database.
> > loaders.InstrumentLoader.main(InstrumentLoader.java:62)
> >                 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> > Method)
> >                 at sun.reflect.NativeMethodAccess
> > orImpl.invoke(NativeMethodAccessorImpl.java:62)
> >                 at sun.reflect.DelegatingMethodAc
> > cessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >                 at java.lang.reflect.Method.invoke(Method.java:497)
> >                 at com.intellij.rt.execution.appl
> > ication.AppMain.main(AppMain.java:147)
> > 2016-11-07 15:32:01 DEBUG Shell:392 - setsid is not available on this
> > machine. So not using it.
> > 2016-11-07 15:32:01 DEBUG Shell:396 - setsid exited with exit code 0
> > 2016-11-07 15:32:01 DEBUG Groups:80 - Group mapping
> > impl=org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback;
> > cacheTimeout=300000; warningDeltaMs=5000
> > 2016-11-07 15:32:02 DEBUG MutableMetricsFactory:42 - field
> > org.apache.hadoop.metrics2.lib.MutableRate
> org.apache.hadoop.security.Use
> > rGroupInformation$UgiMetrics.loginSuccess with annotation @
> > org.apache.hadoop.metrics2.annotation.Metric(always=false, about=,
> > sampleName=Ops, type=DEFAULT, value=[Rate of successful kerberos logins
> and
> > latency (milliseconds)], valueName=Time)
> > 2016-11-07 15:32:02 DEBUG MutableMetricsFactory:42 - field
> > org.apache.hadoop.metrics2.lib.MutableRate
> org.apache.hadoop.security.Use
> > rGroupInformation$UgiMetrics.loginFailure with annotation @
> > org.apache.hadoop.metrics2.annotation.Metric(always=false, about=,
> > sampleName=Ops, type=DEFAULT, value=[Rate of failed kerberos logins and
> > latency (milliseconds)], valueName=Time)
> > 2016-11-07 15:32:02 DEBUG MutableMetricsFactory:42 - field
> > org.apache.hadoop.metrics2.lib.MutableRate
> org.apache.hadoop.security.Use
> > rGroupInformation$UgiMetrics.getGroups with annotation @
> > org.apache.hadoop.metrics2.annotation.Metric(always=false, about=,
> > sampleName=Ops, type=DEFAULT, value=[GetGroups], valueName=Time)
> > 2016-11-07 15:32:02 DEBUG MetricsSystemImpl:221 - UgiMetrics, User and
> > group related metrics
> > 2016-11-07 15:32:02 DEBUG KerberosName:88 - Kerberos krb5 configuration
> > not found, setting default realm to empty
> > 2016-11-07 15:32:02 DEBUG UserGroupInformation:195 - hadoop login
> > 2016-11-07 15:32:02 DEBUG UserGroupInformation:144 - hadoop login commit
> > 2016-11-07 15:32:02 DEBUG UserGroupInformation:174 - using local
> > user:UnixPrincipal: oliverbuckley-salmon
> > 2016-11-07 15:32:02 DEBUG UserGroupInformation:785 - UGI
> > loginUser:oliverbuckley-salmon (auth:SIMPLE)
> > 2016-11-07 15:32:02 INFO  RecoverableZooKeeper:120 - Process
> > identifier=hconnection-0x43d7741f connecting to ZooKeeper ensemble=
> > 138.68.147.208:2181
> > 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> > environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09
> GMT
> > 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:host.name
> > =172.20.10.3
> > 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> > environment:java.version=1.8.0_45
> > 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> > environment:java.vendor=Oracle Corporation
> > 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> > environment:java.home=/Library/Java/JavaVirtualMachines/
> > jdk1.8.0_45.jdk/Contents/Home/jre
> > 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> > environment:java.class.path=/Library/Java/JavaVirtualMachine
> > s/jdk1.8.0_45.jdk/Contents/Home/jre/lib/charsets.jar:/
> > Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/
> > Home/jre/lib/deploy.jar:/Library/Java/JavaVirtualMachin
> > es/jdk1.8.0_45.jdk/Contents/Home/jre/lib/ext/cldrdata.jar:/Library/Java/
> > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> > ext/dnsns.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > 45.jdk/Contents/Home/jre/lib/ext/jfxrt.jar:/Library/Java/
> > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> > ext/localedata.jar:/Library/Java/JavaVirtualMachines/jdk1.
> > 8.0_45.jdk/Contents/Home/jre/lib/ext/nashorn.jar:/Library/
> > Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/
> > lib/ext/sunec.jar:/Library/Java/JavaVirtualMachines/jdk1.
> > 8.0_45.jdk/Contents/Home/jre/lib/ext/sunjce_provider.jar:/L
> > ibrary/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/
> > Home/jre/lib/ext/sunpkcs11.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_
> > 45.jdk/Contents/Home/jre/lib/ext/zipfs.jar:/Library/Java/
> > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> > javaws.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.
> > jdk/Contents/Home/jre/lib/jce.jar:/Library/Java/JavaVirtualM
> > achines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/jfr.jar:
> > /Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/
> > Home/jre/lib/jfxswt.jar:/Library/Java/JavaVirtualMachin
> > es/jdk1.8.0_45.jdk/Contents/Home/jre/lib/jsse.jar:/
> > Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/
> > Home/jre/lib/management-agent.jar:/Library/Java/
> > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> > plugin.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.
> > jdk/Contents/Home/jre/lib/resources.jar:/Library/Java/JavaVi
> > rtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/rt.jar:/
> > Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/
> > Home/lib/ant-javafx.jar:/Library/Java/JavaVirtualMachin
> > es/jdk1.8.0_45.jdk/Contents/Home/lib/dt.jar:/Library/Java/
> > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/javafx
> > -mx.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/
> > Contents/Home/lib/jconsole.jar:/Library/Java/JavaVirtualM
> > achines/jdk1.8.0_45.jdk/Contents/Home/lib/packager.
> > jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/
> > Contents/Home/lib/sa-jdi.jar:/Library/Java/JavaVirtualMachin
> > es/jdk1.8.0_45.jdk/Contents/Home/lib/tools.jar:/Users/oliv
> > erbuckley-salmon/IdeaProjects/sandpit/database/target/
> > classes:/Users/oliverbuckley-salmon/IdeaProjects/sandpit/
> > domain/target/classes:/Users/oliverbuckley-salmon/.m2/reposi
> > tory/com/google/code/gson/gson/2.6.2/gson-2.6.2.jar:/
> > Users/oliverbuckley-salmon/.m2/repository/org/apache/
> > hbase/hbase-client/1.2.3/hbase-client-1.2.3.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/org/apache/hbase/
> > hbase-annotations/1.2.3/hbase-annotations-1.2.3.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/com/github/stephenc
> > /findbugs/findbugs-annotations/1.3.9-1/findbugs-annotations-
> > 1.3.9-1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/hbase/
> > hbase-common/1.2.3/hbase-common-1.2.3.jar:/Users/oliver
> > buckley-salmon/.m2/repository/commons-collections/commons-co
> > llections/3.2.2/commons-collections-3.2.2.jar:/Users/oliverb
> > uckley-salmon/.m2/repository/org/mortbay/jetty/jetty-util/
> > 6.1.26/jetty-util-6.1.26.jar:/Users/oliverbuckley-salmon/.
> > m2/repository/org/apache/hbase/hbase-protocol/1.2.3/
> > hbase-protocol-1.2.3.jar:/Users/oliverbuckley-salmon/.
> > m2/repository/commons-codec/commons-codec/1.9/commons-codec-
> > 1.9.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-
> > io/commons-io/2.4/commons-io-2.4.jar:/Users/oliverbuckley-
> > salmon/.m2/repository/commons-lang/commons-lang/2.6/commons-
> > lang-2.6.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-logging/
> > commons-logging/1.2/commons-logging-1.2.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/com/google/guava/
> > guava/12.0.1/guava-12.0.1.jar:/Users/oliverbuckley-salmon/.
> > m2/repository/com/google/protobuf/protobuf-java/2.5.0/
> > protobuf-java-2.5.0.jar:/Users/oliverbuckley-salmon/.m2
> > /repository/io/netty/netty-all/4.0.23.Final/netty-all-4.0.
> > 23.Final.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> > apache/zookeeper/zookeeper/3.4.6/zookeeper-3.4.6.jar:/
> > Users/oliverbuckley-salmon/.m2/repository/org/slf4j/slf4j-
> > api/1.6.1/slf4j-api-1.6.1.jar:/Users/oliverbuckley-salmon/.m
> > 2/repository/org/slf4j/slf4j-log4j12/1.6.1/slf4j-log4j12-1.6
> > .1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache
> > /htrace/htrace-core/3.1.0-incubating/htrace-core-3.1.0-
> > incubating.jar:/Users/oliverbuckley-salmon/.m2/repository/
> > org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-
> > mapper-asl-1.9.13.jar:/Users/oliverbuckley-salmon/.m2/
> > repository/org/codehaus/jackson/jackson-core-asl/1.9.
> > 13/jackson-core-asl-1.9.13.jar:/Users/oliverbuckley-salmo
> > n/.m2/repository/org/jruby/jcodings/jcodings/1.0.8/jcodin
> > gs-1.0.8.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> > jruby/joni/joni/2.1.2/joni-2.1.2.jar:/Users/oliverbuckley-
> > salmon/.m2/repository/com/yammer/metrics/metrics-core/2.
> > 2.0/metrics-core-2.2.0.jar:/Users/oliverbuckley-salmon/.
> > m2/repository/org/apache/hadoop/hadoop-auth/2.5.1/
> > hadoop-auth-2.5.1.jar:/Users/oliverbuckley-salmon/.m2/reposi
> > tory/org/apache/httpcomponents/httpclient/4.2.5/httpclient-
> > 4.2.5.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> > apache/httpcomponents/httpcore/4.2.4/httpcore-4.2.4.
> > jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> > apache/directory/server/apacheds-kerberos-codec/2.0.0-
> > M15/apacheds-kerberos-codec-2.0.0-M15.jar:/Users/
> oliverbuckley-salmon/.m2/
> > repository/org/apache/directory/server/apacheds-
> > i18n/2.0.0-M15/apacheds-i18n-2.0.0-M15.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/org/apache/director
> > y/api/api-asn1-api/1.0.0-M20/api-asn1-api-1.0.0-M20.jar:/
> > Users/oliverbuckley-salmon/.m2/repository/org/apache/
> > directory/api/api-util/1.0.0-M20/api-util-1.0.0-M20.jar:/
> > Users/oliverbuckley-salmon/.m2/repository/org/apache/
> > hadoop/hadoop-common/2.5.1/hadoop-common-2.5.1.jar:/Users
> > /oliverbuckley-salmon/.m2/repository/org/apache/hadoop/
> > hadoop-annotations/2.5.1/hadoop-annotations-2.5.1.jar:/
> > Users/oliverbuckley-salmon/.m2/repository/commons-cli/
> > commons-cli/1.2/commons-cli-1.2.jar:/Users/oliverbuckley-
> > salmon/.m2/repository/org/apache/commons/commons-math3/
> > 3.1.1/commons-math3-3.1.1.jar:/Users/oliverbuckley-salmon/.
> > m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/Users/oliv
> > erbuckley-salmon/.m2/repository/commons-httpclient/commons-
> > httpclient/3.1/commons-httpclient-3.1.jar:/Users/
> oliverbuckley-salmon/.m2/
> > repository/commons-net/commons-net/3.1/commons-net-3.1.jar:/
> > Users/oliverbuckley-salmon/.m2/repository/commons-el/
> > commons-el/1.0/commons-el-1.0.jar:/Users/oliverbuckley-salmo
> > n/.m2/repository/commons-configuration/commons-configuration
> > /1.6/commons-configuration-1.6.jar:/Users/oliverbuckley-
> > salmon/.m2/repository/commons-digester/commons-digester/1.8/
> > commons-digester-1.8.jar:/Users/oliverbuckley-salmon/.
> > m2/repository/commons-beanutils/commons-beanutils/1.
> > 7.0/commons-beanutils-1.7.0.jar:/Users/oliverbuckley-
> > salmon/.m2/repository/commons-beanutils/commons-beanutils-co
> > re/1.8.0/commons-beanutils-core-1.8.0.jar:/Users/oliverbuckl
> > ey-salmon/.m2/repository/org/apache/avro/avro/1.7.4/avro-1.
> > 7.4.jar:/Users/oliverbuckley-salmon/.m2/repository/com/thou
> > ghtworks/paranamer/paranamer/2.3/paranamer-2.3.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/org/xerial/snappy/snappy-java/
> > 1.0.4.1/snappy-java-1.0.4.1.jar:/Users/oliverbuckley-salmon/.m2/
> > repository/com/jcraft/jsch/0.1.42/jsch-0.1.42.jar:/Users/ol
> > iverbuckley-salmon/.m2/repository/com/google/code/findbugs/
> > jsr305/1.3.9/jsr305-1.3.9.jar:/Users/oliverbuckley-salmon/.
> > m2/repository/org/apache/commons/commons-compress/1.4.
> > 1/commons-compress-1.4.1.jar:/Users/oliverbuckley-salmon/.m2
> > /repository/org/tukaani/xz/1.0/xz-1.0.jar:/Users/oliverbuck
> > ley-salmon/.m2/repository/org/apache/hadoop/hadoop-
> > mapreduce-client-core/2.5.1/hadoop-mapreduce-client-core-
> > 2.5.1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> > apache/hadoop/hadoop-yarn-common/2.5.1/hadoop-yarn-
> > common-2.5.1.jar:/Users/oliverbuckley-salmon/.m2/
> > repository/org/apache/hadoop/hadoop-yarn-api/2.5.1/hadoop-
> > yarn-api-2.5.1.jar:/Users/oliverbuckley-salmon/.m2/
> > repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar:
> > /Users/oliverbuckley-salmon/.m2/repository/javax/xml/
> > stream/stax-api/1.0-2/stax-api-1.0-2.jar:/Users/oliverbuc
> > kley-salmon/.m2/repository/javax/activation/activation/1.
> > 1/activation-1.1.jar:/Users/oliverbuckley-salmon/.m2/
> > repository/io/netty/netty/3.6.2.Final/netty-3.6.2.Final.jar:
> > /Users/oliverbuckley-salmon/.m2/repository/log4j/log4j/1.2.
> > 17/log4j-1.2.17.jar:/Users/oliverbuckley-salmon/.m2/reposito
> > ry/com/hazelcast/hazelcast-all/3.7.2/hazelcast-all-3.7.2.
> > jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> apache/curator/curator-
> > framework/2.10.0/curator-framework-2.10.0.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/org/apache/curator/
> > curator-client/2.10.0/curator-client-2.10.0.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/org/apache/curator/
> > curator-x-discovery/2.10.0/curator-x-discovery-2.10.0.
> > jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/
> > curator/curator-recipes/2.10.0/curator-recipes-2.10.0.jar:/
> > Users/oliverbuckley-salmon/.m2/repository/org/apache/
> > curator/curator-test/2.10.0/curator-test-2.10.0.jar:/
> > Users/oliverbuckley-salmon/.m2/repository/org/javassist/ja
> > vassist/3.18.1-GA/javassist-3.18.1-GA.jar:/Users/oliverbuckl
> > ey-salmon/.m2/repository/org/apache/commons/commons-math/2.
> > 2/commons-math-2.2.jar:/Users/oliverbuckley-salmon/.m2/
> > repository/com/hazelcast/hazelcast-zookeeper/3.6.1/
> > hazelcast-zookeeper-3.6.1.jar:/Users/oliverbuckley-salmon/.
> > m2/repository/joda-time/joda-time/2.9.4/joda-time-2.9.4.
> > jar:/Applications/IntelliJ IDEA.app/Contents/lib/idea_rt.jar
> > 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> > environment:java.library.path=/Users/oliverbuckley-salmon/Li
> > brary/Java/Extensions:/Library/Java/Extensions:/Network/
> > Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java:.
> > 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> > environment:java.io.tmpdir=/var/folders/sx/g9vbcw9d3j54gtj89
> > n57g1fw0000gn/T/
> > 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> > environment:java.compiler=<NA>
> > 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:os.name=Mac
> > OS X
> > 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> environment:os.arch=x86_64
> > 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> > environment:os.version=10.11.6
> > 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:user.name
> > =oliverbuckley-salmon
> > 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> > environment:user.home=/Users/oliverbuckley-salmon
> > 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> > environment:user.dir=/Users/oliverbuckley-salmon/IdeaProjects/sandpit
> > 2016-11-07 15:32:02 INFO  ZooKeeper:438 - Initiating client connection,
> > connectString=138.68.147.208:2181 sessionTimeout=90000
> > watcher=hconnection-0x43d7741f0x0, quorum=138.68.147.208:2181,
> > baseZNode=/hbase
> > 2016-11-07 15:32:02 DEBUG ClientCnxn:102 - zookeeper.
> disableAutoWatchReset
> > is false
> > 2016-11-07 15:32:02 INFO  ClientCnxn:975 - Opening socket connection to
> > server 138.68.147.208/138.68.147.208:2181. Will not attempt to
> > authenticate using SASL (unknown error)
> > 2016-11-07 15:32:02 INFO  ClientCnxn:852 - Socket connection established
> > to 138.68.147.208/138.68.147.208:2181, initiating session
> > 2016-11-07 15:32:02 DEBUG ClientCnxn:892 - Session establishment request
> > sent on 138.68.147.208/138.68.147.208:2181
> > 2016-11-07 <http://138.68.147.208/138.68.147.208:21812016-11-07>
> 15:32:03
> > INFO  ClientCnxn:1235 - Session establishment complete on server
> > 138.68.147.208/138.68.147.208:2181, sessionid = 0x1583b2a4dbb000b,
> > negotiated timeout = 90000
> > 2016-11-07 15:32:03 DEBUG ZooKeeperWatcher:602 -
> > hconnection-0x43d7741f0x0, quorum=138.68.147.208:2181, baseZNode=/hbase
> > Received ZooKeeper Event, type=None, state=SyncConnected, path=null
> > 2016-11-07 15:32:03 DEBUG ZooKeeperWatcher:686 -
> > hconnection-0x43d7741f-0x1583b2a4dbb000b connected
> > 2016-11-07 15:32:03 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 1,3  replyHeader:: 1,182,0  request::
> > '/hbase/hbaseid,F  response:: s{17,132,1478127149340,1478461
> > 382903,1,0,0,0,67,0,17}
> > 2016-11-07 15:32:03 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 2,4  replyHeader:: 2,182,0  request::
> > '/hbase/hbaseid,F  response:: #ffffffff000146d61737465723a36
> > 3030303040ffffffd533ffffffc7ffffffa430fffffffafffffff5504255
> > 46a2439353634626535382d616531632d343734352d393638352d3465643
> > 43830343638636232,s{17,132,1478127149340,1478461382903,1,0,0,0,67,0,17}
> > 2016-11-07 15:32:03 DEBUG AbstractRpcClient:116 -
> > Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f3f4916,
> > compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000,
> > readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0,
> > fallbackAllowed=false, bind address=null
> > 2016-11-07 15:32:03 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 3,4  replyHeader:: 3,182,0  request::
> > '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> > 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> > 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> > ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> > 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> > 2016-11-07 15:32:03 INFO  InstrumentLoader:64 - Master Info Port: 60010
> > 2016-11-07 15:32:03 INFO  InstrumentLoader:65 - Connected to HBase
> > 2016-11-07 15:32:03 INFO  InstrumentLoader:67 - Trying to create tables
> > Creating table. 2016-11-07 15:32:03 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 4,3  replyHeader:: 4,182,0  request:: '/hbase,F
> > response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> > 2016-11-07 15:32:03 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 5,4  replyHeader:: 5,182,0  request::
> > '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> > 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> > 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> > ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> > 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> > 2016-11-07 15:32:04 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 6,3  replyHeader:: 6,182,0  request:: '/hbase,F
> > response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> > 2016-11-07 15:32:04 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 7,4  replyHeader:: 7,182,0  request::
> > '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> > 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> > 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> > ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> > 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> > 2016-11-07 15:32:04 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 8,3  replyHeader:: 8,182,0  request:: '/hbase,F
> > response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> > 2016-11-07 15:32:04 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 9,4  replyHeader:: 9,182,0  request::
> > '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> > 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> > 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> > ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> > 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> > 2016-11-07 15:32:05 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 10,3  replyHeader:: 10,182,0  request:: '/hbase,F
> > response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> > 2016-11-07 15:32:05 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 11,4  replyHeader:: 11,182,0  request::
> > '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> > 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> > 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> > ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> > 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> > 2016-11-07 15:32:05 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 12,3  replyHeader:: 12,182,0  request:: '/hbase,F
> > response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> > 2016-11-07 15:32:05 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 13,4  replyHeader:: 13,182,0  request::
> > '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> > 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> > 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> > ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> > 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> > 2016-11-07 15:32:06 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 14,3  replyHeader:: 14,182,0  request:: '/hbase,F
> > response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> > 2016-11-07 15:32:06 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 15,4  replyHeader:: 15,182,0  request::
> > '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> > 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> > 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> > ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> > 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> > 2016-11-07 15:32:09 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 16,3  replyHeader:: 16,182,0  request:: '/hbase,F
> > response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> > 2016-11-07 15:32:09 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 17,4  replyHeader:: 17,182,0  request::
> > '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> > 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> > 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> > ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> > 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> > 2016-11-07 15:32:13 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 18,3  replyHeader:: 18,182,0  request:: '/hbase,F
> > response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> > 2016-11-07 15:32:13 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 19,4  replyHeader:: 19,182,0  request::
> > '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> > 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> > 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> > ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> > 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> > 2016-11-07 15:32:23 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 20,3  replyHeader:: 20,182,0  request:: '/hbase,F
> > response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> > 2016-11-07 15:32:23 DEBUG ClientCnxn:717 - Got ping response for
> > sessionid: 0x1583b2a4dbb000b after 280ms
> > 2016-11-07 15:32:23 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 21,4  replyHeader:: 21,182,0  request::
> > '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> > 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> > 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> > ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> > 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> > 2016-11-07 15:32:33 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 22,3  replyHeader:: 22,182,0  request:: '/hbase,F
> > response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> > 2016-11-07 15:32:33 DEBUG ClientCnxn:717 - Got ping response for
> > sessionid: 0x1583b2a4dbb000b after 254ms
> > 2016-11-07 15:32:33 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 23,4  replyHeader:: 23,182,0  request::
> > '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> > 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> > 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> > ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> > 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> > 2016-11-07 15:32:44 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 24,3  replyHeader:: 24,182,0  request:: '/hbase,F
> > response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> > 2016-11-07 15:32:44 DEBUG ClientCnxn:717 - Got ping response for
> > sessionid: 0x1583b2a4dbb000b after 261ms
> > 2016-11-07 15:32:44 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 25,4  replyHeader:: 25,182,0  request::
> > '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> > 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> > 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> > ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> > 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> > 2016-11-07 15:32:44 INFO  RpcRetryingCaller:142 - Call exception,
> > tries=10, retries=35, started=40432 ms ago, cancelled=false, msg=
> > 2016-11-07 15:32:54 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 26,3  replyHeader:: 26,182,0  request:: '/hbase,F
> > response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> > 2016-11-07 15:32:54 DEBUG ClientCnxn:717 - Got ping response for
> > sessionid: 0x1583b2a4dbb000b after 121ms
> > 2016-11-07 15:32:54 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 27,4  replyHeader:: 27,182,0  request::
> > '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> > 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> > 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> > ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> > 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> > 2016-11-07 15:32:54 INFO  RpcRetryingCaller:142 - Call exception,
> > tries=11, retries=35, started=50639 ms ago, cancelled=false, msg=
> > 2016-11-07 15:33:14 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 28,3  replyHeader:: 28,182,0  request:: '/hbase,F
> > response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> > 2016-11-07 15:33:14 DEBUG ClientCnxn:717 - Got ping response for
> > sessionid: 0x1583b2a4dbb000b after 82ms
> > 2016-11-07 15:33:14 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 29,4  replyHeader:: 29,182,0  request::
> > '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> > 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> > 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> > ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> > 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> > 2016-11-07 15:33:14 INFO  RpcRetryingCaller:142 - Call exception,
> > tries=12, retries=35, started=70917 ms ago, cancelled=false, msg=
> > 2016-11-07 15:33:34 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 30,3  replyHeader:: 30,182,0  request:: '/hbase,F
> > response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> > 2016-11-07 15:33:34 DEBUG ClientCnxn:717 - Got ping response for
> > sessionid: 0x1583b2a4dbb000b after 100ms
> > 2016-11-07 15:33:35 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 31,4  replyHeader:: 31,182,0  request::
> > '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> > 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> > 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> > ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> > 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> > 2016-11-07 15:33:35 INFO  RpcRetryingCaller:142 - Call exception,
> > tries=13, retries=35, started=91231 ms ago, cancelled=false, msg=
> > 2016-11-07 15:33:55 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 32,3  replyHeader:: 32,182,0  request:: '/hbase,F
> > response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> > 2016-11-07 15:33:55 DEBUG ClientCnxn:717 - Got ping response for
> > sessionid: 0x1583b2a4dbb000b after 49ms
> > 2016-11-07 15:33:55 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 33,4  replyHeader:: 33,182,0  request::
> > '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> > 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> > 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> > ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> > 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> > 2016-11-07 15:33:55 INFO  RpcRetryingCaller:142 - Call exception,
> > tries=14, retries=35, started=111511 ms ago, cancelled=false, msg=
> > 2016-11-07 15:34:15 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 34,3  replyHeader:: 34,182,0  request:: '/hbase,F
> > response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> > 2016-11-07 15:34:15 DEBUG ClientCnxn:717 - Got ping response for
> > sessionid: 0x1583b2a4dbb000b after 62ms
> > 2016-11-07 15:34:15 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 35,4  replyHeader:: 35,182,0  request::
> > '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> > 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> > 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> > ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> > 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> > 2016-11-07 15:34:15 INFO  RpcRetryingCaller:142 - Call exception,
> > tries=15, retries=35, started=131746 ms ago, cancelled=false, msg=
> > 2016-11-07 15:34:35 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 36,3  replyHeader:: 36,182,0  request:: '/hbase,F
> > response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> > 2016-11-07 15:34:35 DEBUG ClientCnxn:717 - Got ping response for
> > sessionid: 0x1583b2a4dbb000b after 96ms
> > 2016-11-07 15:34:35 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 37,4  replyHeader:: 37,182,0  request::
> > '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> > 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> > 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> > ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> > 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> > 2016-11-07 15:34:35 INFO  RpcRetryingCaller:142 - Call exception,
> > tries=16, retries=35, started=152094 ms ago, cancelled=false, msg=
> > 2016-11-07 15:34:56 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 38,3  replyHeader:: 38,182,0  request:: '/hbase,F
> > response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> > 2016-11-07 15:34:56 DEBUG ClientCnxn:717 - Got ping response for
> > sessionid: 0x1583b2a4dbb000b after 77ms
> > 2016-11-07 15:34:56 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 39,4  replyHeader:: 39,182,0  request::
> > '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> > 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> > 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> > ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> > 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> > 2016-11-07 15:34:56 INFO  RpcRetryingCaller:142 - Call exception,
> > tries=17, retries=35, started=172334 ms ago, cancelled=false, msg=
> > 2016-11-07 15:35:16 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 40,3  replyHeader:: 40,182,0  request:: '/hbase,F
> > response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> > 2016-11-07 15:35:16 DEBUG ClientCnxn:717 - Got ping response for
> > sessionid: 0x1583b2a4dbb000b after 177ms
> > 2016-11-07 15:35:16 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 41,4  replyHeader:: 41,182,0  request::
> > '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> > 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> > 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> > ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> > 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> > 2016-11-07 15:35:16 INFO  RpcRetryingCaller:142 - Call exception,
> > tries=18, retries=35, started=192647 ms ago, cancelled=false, msg=
> > 2016-11-07 15:35:36 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 42,3  replyHeader:: 42,182,0  request:: '/hbase,F
> > response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> > 2016-11-07 15:35:36 DEBUG ClientCnxn:717 - Got ping response for
> > sessionid: 0x1583b2a4dbb000b after 45ms
> > 2016-11-07 15:35:36 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 43,4  replyHeader:: 43,182,0  request::
> > '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> > 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> > 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> > ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> > 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> > 2016-11-07 15:35:36 INFO  RpcRetryingCaller:142 - Call exception,
> > tries=19, retries=35, started=212887 ms ago, cancelled=false, msg=
> > 2016-11-07 15:35:56 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 44,3  replyHeader:: 44,182,0  request:: '/hbase,F
> > response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> > 2016-11-07 15:35:56 DEBUG ClientCnxn:717 - Got ping response for
> > sessionid: 0x1583b2a4dbb000b after 187ms
> > 2016-11-07 15:35:56 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 45,4  replyHeader:: 45,182,0  request::
> > '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> > 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> > 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> > ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> > 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> > 2016-11-07 15:35:56 INFO  RpcRetryingCaller:142 - Call exception,
> > tries=20, retries=35, started=233201 ms ago, cancelled=false, msg=
> > 2016-11-07 15:36:17 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 46,3  replyHeader:: 46,182,0  request:: '/hbase,F
> > response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> > 2016-11-07 15:36:17 DEBUG ClientCnxn:717 - Got ping response for
> > sessionid: 0x1583b2a4dbb000b after 115ms
> > 2016-11-07 15:36:17 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 47,4  replyHeader:: 47,182,0  request::
> > '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> > 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> > 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> > ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> > 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> > 2016-11-07 15:36:17 INFO  RpcRetryingCaller:142 - Call exception,
> > tries=21, retries=35, started=253524 ms ago, cancelled=false, msg=
> > 2016-11-07 15:36:37 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 48,3  replyHeader:: 48,182,0  request:: '/hbase,F
> > response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> > 2016-11-07 15:36:37 DEBUG ClientCnxn:717 - Got ping response for
> > sessionid: 0x1583b2a4dbb000b after 121ms
> > 2016-11-07 15:36:37 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 49,4  replyHeader:: 49,182,0  request::
> > '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> > 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> > 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> > ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> > 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> > 2016-11-07 15:36:37 INFO  RpcRetryingCaller:142 - Call exception,
> > tries=22, retries=35, started=273868 ms ago, cancelled=false, msg=
> > 2016-11-07 15:36:57 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 50,3  replyHeader:: 50,182,0  request:: '/hbase,F
> > response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> > 2016-11-07 15:36:57 DEBUG ClientCnxn:717 - Got ping response for
> > sessionid: 0x1583b2a4dbb000b after 67ms
> > 2016-11-07 15:36:57 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 51,4  replyHeader:: 51,182,0  request::
> > '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> > 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> > 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> > ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> > 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> > 2016-11-07 15:36:57 INFO  RpcRetryingCaller:142 - Call exception,
> > tries=23, retries=35, started=294029 ms ago, cancelled=false, msg=
> > 2016-11-07 15:37:18 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 52,3  replyHeader:: 52,182,0  request:: '/hbase,F
> > response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> > 2016-11-07 15:37:18 DEBUG ClientCnxn:717 - Got ping response for
> > sessionid: 0x1583b2a4dbb000b after 43ms
> > 2016-11-07 15:37:18 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 53,4  replyHeader:: 53,182,0  request::
> > '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> > 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> > 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> > ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> > 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> > 2016-11-07 15:37:18 INFO  RpcRetryingCaller:142 - Call exception,
> > tries=24, retries=35, started=314332 ms ago, cancelled=false, msg=
> > 2016-11-07 15:37:38 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 54,3  replyHeader:: 54,182,0  request:: '/hbase,F
> > response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> > 2016-11-07 15:37:38 DEBUG ClientCnxn:717 - Got ping response for
> > sessionid: 0x1583b2a4dbb000b after 79ms
> > 2016-11-07 15:37:38 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 55,4  replyHeader:: 55,182,0  request::
> > '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> > 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> > 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> > ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> > 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> > 2016-11-07 15:37:38 INFO  RpcRetryingCaller:142 - Call exception,
> > tries=25, retries=35, started=334581 ms ago, cancelled=false, msg=
> > 2016-11-07 15:37:58 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 56,3  replyHeader:: 56,182,0  request:: '/hbase,F
> > response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> > 2016-11-07 15:37:58 DEBUG ClientCnxn:717 - Got ping response for
> > sessionid: 0x1583b2a4dbb000b after 118ms
> > 2016-11-07 15:37:58 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 57,4  replyHeader:: 57,182,0  request::
> > '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> > 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> > 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> > ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> > 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> > 2016-11-07 15:37:58 INFO  RpcRetryingCaller:142 - Call exception,
> > tries=26, retries=35, started=354793 ms ago, cancelled=false, msg=
> > 2016-11-07 15:38:18 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 58,3  replyHeader:: 58,182,0  request:: '/hbase,F
> > response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> > 2016-11-07 15:38:18 DEBUG ClientCnxn:717 - Got ping response for
> > sessionid: 0x1583b2a4dbb000b after 180ms
> > 2016-11-07 15:38:18 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 59,4  replyHeader:: 59,182,0  request::
> > '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> > 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> > 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> > ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> > 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> > 2016-11-07 15:38:18 INFO  RpcRetryingCaller:142 - Call exception,
> > tries=27, retries=35, started=375092 ms ago, cancelled=false, msg=
> > 2016-11-07 15:38:39 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 60,3  replyHeader:: 60,182,0  request:: '/hbase,F
> > response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> > 2016-11-07 15:38:39 DEBUG ClientCnxn:717 - Got ping response for
> > sessionid: 0x1583b2a4dbb000b after 64ms
> > 2016-11-07 15:38:39 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 61,4  replyHeader:: 61,182,0  request::
> > '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> > 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> > 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> > ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> > 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> > 2016-11-07 15:38:39 INFO  RpcRetryingCaller:142 - Call exception,
> > tries=28, retries=35, started=395321 ms ago, cancelled=false, msg=
> > 2016-11-07 15:38:59 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 62,3  replyHeader:: 62,182,0  request:: '/hbase,F
> > response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> > 2016-11-07 15:38:59 DEBUG ClientCnxn:717 - Got ping response for
> > sessionid: 0x1583b2a4dbb000b after 63ms
> > 2016-11-07 15:38:59 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 63,4  replyHeader:: 63,182,0  request::
> > '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> > 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> > 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> > ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> > 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> > 2016-11-07 15:38:59 INFO  RpcRetryingCaller:142 - Call exception,
> > tries=29, retries=35, started=415488 ms ago, cancelled=false, msg=
> > 2016-11-07 15:39:19 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 64,3  replyHeader:: 64,182,0  request:: '/hbase,F
> > response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> > 2016-11-07 15:39:19 DEBUG ClientCnxn:717 - Got ping response for
> > sessionid: 0x1583b2a4dbb000b after 164ms
> > 2016-11-07 15:39:19 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 65,4  replyHeader:: 65,182,0  request::
> > '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> > 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> > 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> > ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> > 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> > 2016-11-07 15:39:19 INFO  RpcRetryingCaller:142 - Call exception,
> > tries=30, retries=35, started=435727 ms ago, cancelled=false, msg=
> > 2016-11-07 15:39:39 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 66,3  replyHeader:: 66,182,0  request:: '/hbase,F
> > response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> > 2016-11-07 15:39:39 DEBUG ClientCnxn:717 - Got ping response for
> > sessionid: 0x1583b2a4dbb000b after 63ms
> > 2016-11-07 15:39:40 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 67,4  replyHeader:: 67,182,0  request::
> > '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> > 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> > 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> > ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> > 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> > 2016-11-07 15:39:40 INFO  RpcRetryingCaller:142 - Call exception,
> > tries=31, retries=35, started=456258 ms ago, cancelled=false, msg=
> > 2016-11-07 15:40:00 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 68,3  replyHeader:: 68,182,0  request:: '/hbase,F
> > response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> > 2016-11-07 15:40:00 DEBUG ClientCnxn:717 - Got ping response for
> > sessionid: 0x1583b2a4dbb000b after 186ms
> > 2016-11-07 15:40:00 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 69,4  replyHeader:: 69,182,0  request::
> > '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> > 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> > 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> > ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> > 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> > 2016-11-07 15:40:00 INFO  RpcRetryingCaller:142 - Call exception,
> > tries=32, retries=35, started=476964 ms ago, cancelled=false, msg=
> > 2016-11-07 15:40:20 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 70,3  replyHeader:: 70,182,0  request:: '/hbase,F
> > response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> > 2016-11-07 15:40:20 DEBUG ClientCnxn:717 - Got ping response for
> > sessionid: 0x1583b2a4dbb000b after 38ms
> > 2016-11-07 15:40:21 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 71,4  replyHeader:: 71,182,0  request::
> > '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> > 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> > 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> > ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> > 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> > 2016-11-07 15:40:21 INFO  RpcRetryingCaller:142 - Call exception,
> > tries=33, retries=35, started=497229 ms ago, cancelled=false, msg=
> > 2016-11-07 15:40:41 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 72,3  replyHeader:: 72,182,0  request:: '/hbase,F
> > response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> > 2016-11-07 15:40:41 DEBUG ClientCnxn:717 - Got ping response for
> > sessionid: 0x1583b2a4dbb000b after 51ms
> > 2016-11-07 15:40:41 DEBUG ClientCnxn:818 - Reading reply
> > sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> > finished:false header:: 73,4  replyHeader:: 73,182,0  request::
> > '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> > 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> > 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> > ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> > 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> > 2016-11-07 15:40:41 INFO  RpcRetryingCaller:142 - Call exception,
> > tries=34, retries=35, started=517438 ms ago, cancelled=false, msg=
> > 2016-11-07 15:40:41 ERROR InstrumentLoader:114 - Error connecting to
> HBase
> > Serverorg.apache.hadoop.hbase.client.RetriesExhaustedException: Failed
> > after attempts=35, exceptions:
> > Mon Nov 07 15:32:04 GMT 2016, RpcRetryingCaller{
> globalStartTime=1478532723784,
> > pause=100, retries=35}, org.apache.hadoop.hbase.
> MasterNotRunningException:
> > java.net.UnknownHostException: a826d5422c4d
> > Mon Nov 07 15:32:04 GMT 2016, RpcRetryingCaller{
> globalStartTime=1478532723784,
> > pause=100, retries=35}, org.apache.hadoop.hbase.
> MasterNotRunningException:
> > java.net.UnknownHostException: a826d5422c4d
> > Mon Nov 07 15:32:04 GMT 2016, RpcRetryingCaller{
> globalStartTime=1478532723784,
> > pause=100, retries=35}, org.apache.hadoop.hbase.
> MasterNotRunningException:
> > java.net.UnknownHostException: a826d5422c4d
> > Mon Nov 07 15:32:05 GMT 2016, RpcRetryingCaller{
> globalStartTime=1478532723784,
> > pause=100, retries=35}, org.apache.hadoop.hbase.
> MasterNotRunningException:
> > java.net.UnknownHostException: a826d5422c4d
> > Mon Nov 07 15:32:05 GMT 2016, RpcRetryingCaller{
> globalStartTime=1478532723784,
> > pause=100, retries=35}, org.apache.hadoop.hbase.
> MasterNotRunningException:
> > java.net.UnknownHostException: a826d5422c4d
> > Mon Nov 07 15:32:06 GMT 2016, RpcRetryingCaller{
> globalStartTime=1478532723784,
> > pause=100, retries=35}, org.apache.hadoop.hbase.
> MasterNotRunningException:
> > java.net.UnknownHostException: a826d5422c4d
> > Mon Nov 07 15:32:09 GMT 2016, RpcRetryingCaller{
> globalStartTime=1478532723784,
> > pause=100, retries=35}, org.apache.hadoop.hbase.
> MasterNotRunningException:
> > java.net.UnknownHostException: a826d5422c4d
> > Mon Nov 07 15:32:13 GMT 2016, RpcRetryingCaller{
> globalStartTime=1478532723784,
> > pause=100, retries=35}, org.apache.hadoop.hbase.
> MasterNotRunningException:
> > java.net.UnknownHostException: a826d5422c4d
> > Mon Nov 07 15:32:23 GMT 2016, RpcRetryingCaller{
> globalStartTime=1478532723784,
> > pause=100, retries=35}, org.apache.hadoop.hbase.
> MasterNotRunningException:
> > java.net.UnknownHostException: a826d5422c4d
> > Mon Nov 07 15:32:33 GMT 2016, RpcRetryingCaller{
> globalStartTime=1478532723784,
> > pause=100, retries=35}, org.apache.hadoop.hbase.
> MasterNotRunningException:
> > java.net.UnknownHostException: a826d5422c4d
> > Mon Nov 07 15:32:44 GMT 2016, RpcRetryingCaller{
> globalStartTime=1478532723784,
> > pause=100, retries=35}, org.apache.hadoop.hbase.
> MasterNotRunningException:
> > java.net.UnknownHostException: a826d5422c4d
> > Mon Nov 07 15:32:54 GMT 2016, RpcRetryingCaller{
> globalStartTime=1478532723784,
> > pause=100, retries=35}, org.apache.hadoop.hbase.
> MasterNotRunningException:
> > java.net.UnknownHostException: a826d5422c4d
> > Mon Nov 07 15:33:14 GMT 2016, RpcRetryingCaller{
> globalStartTime=1478532723784,
> > pause=100, retries=35}, org.apache.hadoop.hbase.
> MasterNotRunningException:
> > java.net.UnknownHostException: a826d5422c4d
> > Mon Nov 07 15:33:35 GMT 2016, RpcRetryingCaller{
> globalStartTime=1478532723784,
> > pause=100, retries=35}, org.apache.hadoop.hbase.
> MasterNotRunningException:
> > java.net.UnknownHostException: a826d5422c4d
> > Mon Nov 07 15:33:55 GMT 2016, RpcRetryingCaller{
> globalStartTime=1478532723784,
> > pause=100, retries=35}, org.apache.hadoop.hbase.
> MasterNotRunningException:
> > java.net.UnknownHostException: a826d5422c4d
> > Mon Nov 07 15:34:15 GMT 2016, RpcRetryingCaller{
> globalStartTime=1478532723784,
> > pause=100, retries=35}, org.apache.hadoop.hbase.
> MasterNotRunningException:
> > java.net.UnknownHostException: a826d5422c4d
> > Mon Nov 07 15:34:35 GMT 2016, RpcRetryingCaller{
> globalStartTime=1478532723784,
> > pause=100, retries=35}, org.apache.hadoop.hbase.
> MasterNotRunningException:
> > java.net.UnknownHostException: a826d5422c4d
> > Mon Nov 07 15:34:56 GMT 2016, RpcRetryingCaller{
> globalStartTime=1478532723784,
> > pause=100, retries=35}, org.apache.hadoop.hbase.
> MasterNotRunningException:
> > java.net.UnknownHostException: a826d5422c4d
> > Mon Nov 07 15:35:16 GMT 2016, RpcRetryingCaller{
> globalStartTime=1478532723784,
> > pause=100, retries=35}, org.apache.hadoop.hbase.
> MasterNotRunningException:
> > java.net.UnknownHostException: a826d5422c4d
> > Mon Nov 07 15:35:36 GMT 2016, RpcRetryingCaller{
> globalStartTime=1478532723784,
> > pause=100, retries=35}, org.apache.hadoop.hbase.
> MasterNotRunningException:
> > java.net.UnknownHostException: a826d5422c4d
> > Mon Nov 07 15:35:56 GMT 2016, RpcRetryingCaller{
> globalStartTime=1478532723784,
> > pause=100, retries=35}, org.apache.hadoop.hbase.
> MasterNotRunningException:
> > java.net.UnknownHostException: a826d5422c4d
> > Mon Nov 07 15:36:17 GMT 2016, RpcRetryingCaller{
> globalStartTime=1478532723784,
> > pause=100, retries=35}, org.apache.hadoop.hbase.
> MasterNotRunningException:
> > java.net.UnknownHostException: a826d5422c4d
> > Mon Nov 07 15:36:37 GMT 2016, RpcRetryingCaller{
> globalStartTime=1478532723784,
> > pause=100, retries=35}, org.apache.hadoop.hbase.
> MasterNotRunningException:
> > java.net.UnknownHostException: a826d5422c4d
> > Mon Nov 07 15:36:57 GMT 2016, RpcRetryingCaller{
> globalStartTime=1478532723784,
> > pause=100, retries=35}, org.apache.hadoop.hbase.
> MasterNotRunningException:
> > java.net.UnknownHostException: a826d5422c4d
> > Mon Nov 07 15:37:18 GMT 2016, RpcRetryingCaller{
> globalStartTime=1478532723784,
> > pause=100, retries=35}, org.apache.hadoop.hbase.
> MasterNotRunningException:
> > java.net.UnknownHostException: a826d5422c4d
> > Mon Nov 07 15:37:38 GMT 2016, RpcRetryingCaller{
> globalStartTime=1478532723784,
> > pause=100, retries=35}, org.apache.hadoop.hbase.
> MasterNotRunningException:
> > java.net.UnknownHostException: a826d5422c4d
> > Mon Nov 07 15:37:58 GMT 2016, RpcRetryingCaller{
> globalStartTime=1478532723784,
> > pause=100, retries=35}, org.apache.hadoop.hbase.
> MasterNotRunningException:
> > java.net.UnknownHostException: a826d5422c4d
> > Mon Nov 07 15:38:18 GMT 2016, RpcRetryingCaller{
> globalStartTime=1478532723784,
> > pause=100, retries=35}, org.apache.hadoop.hbase.
> MasterNotRunningException:
> > java.net.UnknownHostException: a826d5422c4d
> > Mon Nov 07 15:38:39 GMT 2016, RpcRetryingCaller{
> globalStartTime=1478532723784,
> > pause=100, retries=35}, org.apache.hadoop.hbase.
> MasterNotRunningException:
> > java.net.UnknownHostException: a826d5422c4d
> > Mon Nov 07 15:38:59 GMT 2016, RpcRetryingCaller{
> globalStartTime=1478532723784,
> > pause=100, retries=35}, org.apache.hadoop.hbase.
> MasterNotRunningException:
> > java.net.UnknownHostException: a826d5422c4d
> > Mon Nov 07 15:39:19 GMT 2016, RpcRetryingCaller{
> globalStartTime=1478532723784,
> > pause=100, retries=35}, org.apache.hadoop.hbase.
> MasterNotRunningException:
> > java.net.UnknownHostException: a826d5422c4d
> > Mon Nov 07 15:39:40 GMT 2016, RpcRetryingCaller{
> globalStartTime=1478532723784,
> > pause=100, retries=35}, org.apache.hadoop.hbase.
> MasterNotRunningException:
> > java.net.UnknownHostException: a826d5422c4d
> > Mon Nov 07 15:40:00 GMT 2016, RpcRetryingCaller{
> globalStartTime=1478532723784,
> > pause=100, retries=35}, org.apache.hadoop.hbase.
> MasterNotRunningException:
> > java.net.UnknownHostException: a826d5422c4d
> > Mon Nov 07 15:40:21 GMT 2016, RpcRetryingCaller{
> globalStartTime=1478532723784,
> > pause=100, retries=35}, org.apache.hadoop.hbase.
> MasterNotRunningException:
> > java.net.UnknownHostException: a826d5422c4d
> > Mon Nov 07 15:40:41 GMT 2016, RpcRetryingCaller{
> globalStartTime=1478532723784,
> > pause=100, retries=35}, org.apache.hadoop.hbase.
> MasterNotRunningException:
> > java.net.UnknownHostException: a826d5422c4d
> >
> >
> > Process finished with exit code 0
> >
> > The container is contactable as Zookeeper is running in the same
> container.
> > Thanks very much for your help.
> > Oliver
> >
> > -----Original Message-----
> > From: Ted Yu [mailto:yuzhihong@gmail.com]
> > Sent: 07 November 2016 15:05
> > To: user@hbase.apache.org
> > Subject: Re: Can connect to HBase via Java API but can't create table
> >
> > Can you show more of the UnknownHostException ?
> >
> > Could this be related to the firewall on the Docker container ?
> >
> > Cheers
> >
> > On Mon, Nov 7, 2016 at 6:49 AM, Oliver Buckley-Salmon <
> > oliver.buckley-salmon@db.com> wrote:
> >
> > > Hi
> > >
> > > I am trying to create a table in HBase using the Java API, I can
> > > connect to Zookeeper
> > >
> > > 2016-11-06 15:18:36 INFO  RecoverableZooKeeper:120 - Process
> > > identifier=hconnection-0x382db087 connecting to ZooKeeper ensemble=
> > > 138.68.147.208:2181
> > > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > > environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09
> > > GMT
> > > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client environment:host.name
> > > =olivers-air.default
> > > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > > environment:java.version=1.8.0_45
> > > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > > environment:java.vendor=Oracle Corporation
> > > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > > environment:java.home=/
> > > Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre
> > > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > > environment:java.class.path=/Library/Java/JavaVirtualMachines/jdk1.8.0
> > > _ 45.jdk/Contents/Home/jre/lib/charsets.jar:/Library/Java/
> > > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> > > deploy.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > > 45.jdk/Contents/Home/jre/lib/ext/cldrdata.jar:/Library/
> > > Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/
> > > lib/ext/dnsns.jar:/Library/Java/JavaVirtualMachines/jdk1.
> > > 8.0_45.jdk/Contents/Home/jre/lib/ext/jfxrt.jar:/Library/
> > > Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/
> > > lib/ext/localedata.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > > 45.jdk/Contents/Home/jre/lib/ext/nashorn.jar:/Library/Java/
> > > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> > > ext/sunec.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > > 45.jdk/Contents/Home/jre/lib/ext/sunjce_provider.jar:/Library/Java/
> > > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> > > ext/sunpkcs11.jar:/Library/Java/JavaVirtualMachines/jdk1.
> > > 8.0_45.jdk/Contents/Home/jre/lib/ext/zipfs.jar:/Library/
> > > Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/
> > > lib/javaws.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > > 45.jdk/Contents/Home/jre/lib/jce.jar:/Library/Java/
> > > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> > > jfr.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > > 45.jdk/Contents/Home/jre/lib/jfxswt.jar:/Library/Java/
> > > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> > > jsse.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > > 45.jdk/Contents/Home/jre/lib/management-agent.jar:/Library/
> > > Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/
> > > lib/plugin.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > > 45.jdk/Contents/Home/jre/lib/resources.jar:/Library/Java/
> > > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> > > rt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > > 45.jdk/Contents/Home/lib/ant-javafx.jar:/Library/Java/
> > > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/dt.
> > > jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/li
> > > b/ javafx-mx.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > > 45.jdk/Contents/Home/lib/jconsole.jar:/Library/Java/
> > > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/
> > > packager.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > > 45.jdk/Contents/Home/lib/sa-jdi.jar:/Library/Java/
> > > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/tools.jar:/Users
> > > /
> > > oliverbuckley-salmon/IdeaProjects/sandpit/database/target/classes:/Use
> > > rs/
> > > oliverbuckley-salmon/IdeaProjects/sandpit/domain/target/classes:/Users
> > > / oliverbuckley-salmon/.m2/repository/com/google/code/
> > > gson/gson/2.6.2/gson-2.6.2.jar:/Users/oliverbuckley-
> > > salmon/.m2/repository/org/apache/hbase/hbase-client/1.2.
> > > 3/hbase-client-1.2.3.jar:/Users/oliverbuckley-salmon/.
> > > m2/repository/org/apache/hbase/hbase-annotations/1.2.3/
> > > hbase-annotations-1.2.3.jar:/Users/oliverbuckley-salmon/.
> > > m2/repository/com/github/stephenc/findbugs/findbugs-
> > > annotations/1.3.9-1/findbugs-annotations-1.3.9-1.jar:/
> > > Users/oliverbuckley-salmon/.m2/repository/org/apache/
> > > hbase/hbase-common/1.2.3/hbase-common-1.2.3.jar:/Users/
> > > oliverbuckley-salmon/.m2/repository/commons-collections/commons-
> > > collections/3.2.2/commons-collections-3.2.2.jar:/Users/
> > > oliverbuckley-salmon/.m2/repository/org/mortbay/jetty/
> > > jetty-util/6.1.26/jetty-util-6.1.26.jar:/Users/oliverbuckley-salmon/.m
> > > 2/
> > > repository/org/apache/hbase/hbase-protocol/1.2.3/hbase-
> > > protocol-1.2.3.jar:/Users/oliverbuckley-salmon/.m2/
> > > repository/commons-codec/commons-codec/1.9/commons-codec-1.9.jar:/User
> > > s/
> > > oliverbuckley-salmon/.m2/repository/commons-io/commons-
> > > io/2.4/commons-io-2.4.jar:/Users/oliverbuckley-salmon/.
> > > m2/repository/commons-lang/commons-lang/2.6/commons-lang-
> > > 2.6.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-
> > > logging/commons-logging/1.2/commons-logging-1.2.jar:/
> > > Users/oliverbuckley-salmon/.m2/repository/com/google/
> > > guava/guava/12.0.1/guava-12.0.1.jar:/Users/oliverbuckley-
> > > salmon/.m2/repository/com/google/protobuf/protobuf-java/
> > > 2.5.0/protobuf-java-2.5.0.jar:/Users/oliverbuckley-salmon/.
> > > m2/repository/io/netty/netty-all/4.0.23.Final/netty-all-4.
> > > 0.23.Final.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/
> > > zookeeper/zookeeper/3.4.6/zookeeper-3.4.6.jar:/Users/
> > > oliverbuckley-salmon/.m2/repository/org/slf4j/slf4j-
> > > api/1.6.1/slf4j-api-1.6.1.jar:/Users/oliverbuckley-salmon/.
> > > m2/repository/org/slf4j/slf4j-log4j12/1.6.1/slf4j-log4j12-1.
> > > 6.1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> > > apache/htrace/htrace-core/3.1.0-incubating/htrace-core-3.1.
> > > 0-incubating.jar:/Users/oliverbuckley-salmon/.m2/repository/org/codeha
> > > us/ jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.
> > > 13.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> > > codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.
> > > 9.13.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> > > jruby/jcodings/jcodings/1.0.8/jcodings-1.0.8.jar:/Users/
> > > oliverbuckley-salmon/.m2/repository/org/jruby/joni/
> > > joni/2.1.2/joni-2.1.2.jar:/Users/oliverbuckley-salmon/.
> > > m2/repository/com/yammer/metrics/metrics-core/2.2.0/
> > > metrics-core-2.2.0.jar:/Users/oliverbuckley-salmon/.m2/
> > > repository/org/apache/hadoop/hadoop-auth/2.5.1/hadoop-auth-
> > > 2.5.1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/
> > > httpcomponents/httpclient/4.2.5/httpclient-4.2.5.jar:/Users/
> > > oliverbuckley-salmon/.m2/repository/org/apache/
> > > httpcomponents/httpcore/4.2.4/httpcore-4.2.4.jar:/Users/
> > > oliverbuckley-salmon/.m2/repository/org/apache/directory/server/apache
> > > ds-
> > > kerberos-codec/2.0.0-M15/apacheds-kerberos-codec-2.0.0-
> > > M15.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> > > apache/directory/server/apacheds-i18n/2.0.0-M15/
> > > apacheds-i18n-2.0.0-M15.jar:/Users/oliverbuckley-salmon/.
> > > m2/repository/org/apache/directory/api/api-asn1-api/1.
> > > 0.0-M20/api-asn1-api-1.0.0-M20.jar:/Users/oliverbuckley-
> > > salmon/.m2/repository/org/apache/directory/api/api-util/
> > > 1.0.0-M20/api-util-1.0.0-M20.jar:/Users/oliverbuckley-
> > > salmon/.m2/repository/org/apache/hadoop/hadoop-common/2.
> > > 5.1/hadoop-common-2.5.1.jar:/Users/oliverbuckley-salmon/.
> > > m2/repository/org/apache/hadoop/hadoop-annotations/2.5.
> > > 1/hadoop-annotations-2.5.1.jar:/Users/oliverbuckley-
> > > salmon/.m2/repository/commons-cli/commons-cli/1.2/commons-
> > > cli-1.2.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/comm
> > > ons/ commons-math3/3.1.1/commons-math3-3.1.1.jar:/Users/
> > > oliverbuckley-salmon/.m2/repository/xmlenc/xmlenc/0.52/
> > > xmlenc-0.52.jar:/Users/oliverbuckley-salmon/.m2/
> > > repository/commons-httpclient/commons-httpclient/3.1/
> > > commons-httpclient-3.1.jar:/Users/oliverbuckley-salmon/.
> > > m2/repository/commons-net/commons-net/3.1/commons-net-3.
> > > 1.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-
> > > el/commons-el/1.0/commons-el-1.0.jar:/Users/oliverbuckley-
> > > salmon/.m2/repository/commons-configuration/commons-
> > > configuration/1.6/commons-configuration-1.6.jar:/Users/
> > > oliverbuckley-salmon/.m2/repository/commons-digester/
> > > commons-digester/1.8/commons-digester-1.8.jar:/Users/
> > > oliverbuckley-salmon/.m2/repository/commons-beanutils/
> > > commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar:/
> > > Users/oliverbuckley-salmon/.m2/repository/commons-
> > > beanutils/commons-beanutils-core/1.8.0/commons-beanutils-
> > > core-1.8.0.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/a
> > > vro/
> > > avro/1.7.4/avro-1.7.4.jar:/Users/oliverbuckley-salmon/.m2/repository/c
> > > om/ thoughtworks/paranamer/paranamer/2.3/paranamer-2.3.
> > > jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> > > xerial/snappy/snappy-java/1.0.4.1/snappy-java-1.0.4.1.jar:/
> > > Users/oliverbuckley-salmon/.m2/repository/com/jcraft/jsch/
> > > 0.1.42/jsch-0.1.42.jar:/Users/oliverbuckley-salmon/.m2/
> > > repository/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar:/Use
> > > rs/ oliverbuckley-salmon/.m2/repository/org/apache/commons/
> > > commons-compress/1.4.1/commons-compress-1.4.1.jar:/
> > > Users/oliverbuckley-salmon/.m2/repository/org/tukaani/xz/
> > > 1.0/xz-1.0.jar:/Users/oliverbuckley-salmon/.m2/
> > > repository/org/apache/hadoop/hadoop-mapreduce-client-core/
> > > 2.5.1/hadoop-mapreduce-client-core-2.5.1.jar:/Users/
> > > oliverbuckley-salmon/.m2/repository/org/apache/hadoop/
> > > hadoop-yarn-common/2.5.1/hadoop-yarn-common-2.5.1.jar:/
> > > Users/oliverbuckley-salmon/.m2/repository/org/apache/
> > > hadoop/hadoop-yarn-api/2.5.1/hadoop-yarn-api-2.5.1.jar:/
> > > Users/oliverbuckley-salmon/.m2/repository/javax/xml/bind/
> > > jaxb-api/2.2.2/jaxb-api-2.2.2.jar:/Users/oliverbuckley-
> > > salmon/.m2/repository/javax/xml/stream/stax-api/1.0-2/
> > > stax-api-1.0-2.jar:/Users/oliverbuckley-salmon/.m2/
> > > repository/javax/activation/activation/1.1/activation-1.1.
> > > jar:/Users/oliverbuckley-salmon/.m2/repository/io/
> > > netty/netty/3.6.2.Final/netty-3.6.2.Final.jar:/Users/
> > > oliverbuckley-salmon/.m2/repository/log4j/log4j/1.2.17/
> > > log4j-1.2.17.jar:/Users/oliverbuckley-salmon/.m2/repository/com/hazelc
> > > ast/ hazelcast-all/3.7.2/hazelcast-all-3.7.2.jar:/Users/
> > > oliverbuckley-salmon/.m2/repository/org/apache/curator/
> > > curator-framework/2.10.0/curator-framework-2.10.0.jar:/
> > > Users/oliverbuckley-salmon/.m2/repository/org/apache/
> > > curator/curator-client/2.10.0/curator-client-2.10.0.jar:/
> > > Users/oliverbuckley-salmon/.m2/repository/org/apache/
> > > curator/curator-x-discovery/2.10.0/curator-x-discovery-2.10.
> > > 0.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> > > apache/curator/curator-recipes/2.10.0/curator-recipes-2.10.0.jar:/User
> > > s/ oliverbuckley-salmon/.m2/repository/org/apache/curator/
> > > curator-test/2.10.0/curator-test-2.10.0.jar:/Users/
> > > oliverbuckley-salmon/.m2/repository/org/javassist/
> > > javassist/3.18.1-GA/javassist-3.18.1-GA.jar:/Users/
> > > oliverbuckley-salmon/.m2/repository/org/apache/commons/
> > > commons-math/2.2/commons-math-2.2.jar:/Users/oliverbuckley-
> > > salmon/.m2/repository/com/hazelcast/hazelcast-zookeeper/
> > > 3.6.1/hazelcast-zookeeper-3.6.1.jar:/Users/oliverbuckley-
> > > salmon/.m2/repository/joda-time/joda-time/2.9.4/joda-
> > > time-2.9.4.jar:/Applications/IntelliJ
> > > IDEA.app/Contents/lib/idea_rt.jar
> > > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > > environment:java.library.path=/Users/oliverbuckley-salmon/
> > > Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java
> > > / Extensions:/System/Library/Java/Extensions:/usr/lib/java:.
> > > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > > environment:java.io.tmpdir=/var/folders/sx/g9vbcw9d3j54gtj89n57g1fw000
> > > 0gn
> > > /T/
> > > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > > environment:java.compiler=<NA>
> > > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > > environment:os.name=Mac OS X
> > > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > > environment:os.arch=x86_64
> > > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > > environment:os.version=10.11.6
> > > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > > environment:user.name= oliverbuckley-salmon
> > > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > > environment:user.home=/Users/oliverbuckley-salmon
> > > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > > environment:user.dir=/Users/oliverbuckley-salmon/IdeaProjects/sandpit
> > > 2016-11-06 15:18:36 INFO  ZooKeeper:438 - Initiating client
> > > connection,
> > > connectString=138.68.147.208:2181 sessionTimeout=90000
> > > watcher=hconnection-0x382db0870x0, quorum=138.68.147.208:2181,
> > > baseZNode=/hbase
> > > 2016-11-06 15:18:37 INFO  ClientCnxn:975 - Opening socket connection
> > > to server 138.68.147.208/138.68.147.208:2181. Will not attempt to
> > > authenticate using SASL (unknown error)
> > > 2016-11-06 15:18:37 INFO  ClientCnxn:852 - Socket connection
> > > established to 138.68.147.208/138.68.147.208:2181, initiating session
> > > 2016-11-06 15:18:37 INFO  ClientCnxn:1235 - Session establishment
> > > complete on server 138.68.147.208/138.68.147.208:2181, sessionid =
> > > 0x158273e5275001d, negotiated timeout = 90000
> > >
> > > I can connect to HBase as I can see it in the debugger, but when I try
> > > to create a table it fails after 35 retries with
> > > org.apache.hadoop.hbase.MasterNotRunningException:
> > > java.net.UnknownHostException
> > >
> > > I can connect to HBase with the UI and can see the Master and Region
> > > servers.
> > >
> > > My code looks like this
> > > Configuration hBaseConfig =  HBaseConfiguration.create();
> > >             hBaseConfig.setInt("timeout", 120000);
> > >             hBaseConfig.set("hbase.master", hbaseHost + ":60000");
> > >             hBaseConfig.set("hbase.zookeeper.quorum",zookeeperHost);
> > >             hBaseConfig.set("hbase.zookeeper.property.clientPort",
> > > "2181");
> > >
> > >             logger.info("Trying to connect to HBase");
> > >             Connection connection = ConnectionFactory.
> > > createConnection(hBaseConfig);
> > >             Admin admin = connection.getAdmin();
> > >             logger.info("Connected to HBase");
> > >
> > >             logger.info("Trying to create tables");
> > >             createSchemaTables(admin);
> > >             logger.info("Tables created");
> > >
> > > CreateSchemaTables looks like this and the code fails and retries at
> > > admin.createTable(table); public static void createSchemaTables(Admin
> > > admin) throws IOException {
> > >
> > >
> > >
> > >         HTableDescriptor table = new HTableDescriptor(TableName.
> > > valueOf(tableName));
> > >         HColumnDescriptor cf = new HColumnDescriptor(columnFamily).
> > > setCompressionType(Algorithm.NONE);
> > >
> > >         table.addFamily(cf);
> > >
> > >         System.out.print("Creating table. ");
> > >         admin.createTable(table);
> > >         System.out.println(" Done.");
> > >
> > > The client is running on my Mac Air and Hbase is running in a Docker
> > > container (nerdammer/hbase) Digital Ocean.
> > >
> > > Does anyone have any idea why I can connect to HBase but not create
> > tables?
> > >
> > > Thanks in advance for your help, Oliver
> > >
> > >
> > >
> > >
> > > ---
> > > This e-mail may contain confidential and/or privileged information. If
> > > you are not the intended recipient (or have received this e-mail in
> > > error) please notify the sender immediately and delete this e-mail.
> > > Any unauthorized copying, disclosure or distribution of the material
> > > in this e-mail is strictly forbidden.
> > >
> > > Please refer to https://www.db.com/disclosures for additional EU
> > > corporate and regulatory disclosures and to http://www.db.com/
> > > unitedkingdom/content/privacy.htm for information about privacy.
> > >
> >
> >
> > ---
> > This e-mail may contain confidential and/or privileged information. If
> you
> > are not the intended recipient (or have received this e-mail in error)
> > please notify the sender immediately and delete this e-mail. Any
> > unauthorized copying, disclosure or distribution of the material in this
> > e-mail is strictly forbidden.
> >
> > Please refer to https://www.db.com/disclosures for additional EU
> > corporate and regulatory disclosures and to
> http://www.db.com/unitedkingdo
> > m/content/privacy.htm for information about privacy.
> >
> >
> > ---
> > This e-mail may contain confidential and/or privileged information. If
> you
> > are not the intended recipient (or have received this e-mail in error)
> > please notify the sender immediately and delete this e-mail. Any
> > unauthorized copying, disclosure or distribution of the material in this
> > e-mail is strictly forbidden.
> >
> > Please refer to https://www.db.com/disclosures for additional EU
> > corporate and regulatory disclosures and to
> http://www.db.com/unitedkingdo
> > m/content/privacy.htm for information about privacy.
> >
>
>
> ---
> This e-mail may contain confidential and/or privileged information. If you
> are not the intended recipient (or have received this e-mail in error)
> please notify the sender immediately and delete this e-mail. Any
> unauthorized copying, disclosure or distribution of the material in this
> e-mail is strictly forbidden.
>
> Please refer to https://www.db.com/disclosures for additional EU
> corporate and regulatory disclosures and to http://www.db.com/
> unitedkingdom/content/privacy.htm for information about privacy.
>

RE: Can connect to HBase via Java API but can't create table

Posted by Oliver Buckley-Salmon <ol...@db.com>.
Thanks, the HBase region server was returning its docker container Id. Mapped that to the server IP in my hosts file and all working now.
Something to watch out for if you've got HBase running in docker containers.



-----Original Message-----
From: Stack [stack@duboce.net<ma...@duboce.net>]
Sent: Friday, November 11, 2016 01:37 AM W. Europe Standard Time
To: Hbase-User
Subject: Re: Can connect to HBase via Java API but can't create table


Please fix unknown host. The hbase client doesn't know how to get to the
server.
St.Ack

On Tue, Nov 8, 2016 at 12:26 AM, Oliver Buckley-Salmon <
oliver.buckley-salmon@db.com> wrote:

> Hi,
> Here's a better exception
>
> Exception in thread "main" org.apache.hadoop.hbase.client.RetriesExhaustedException:
> Failed after attempts=36, exceptions:
> Tue Nov 08 07:06:48 GMT 2016, null, java.net.SocketTimeoutException:
> callTimeout=60000, callDuration=69291: row 'INSTRUMENT,,' on table
> 'hbase:meta' at region=hbase:meta,,1.1588230740,
> hostname=e5611ffad72e,60020,1478588595835, seqNum=0
>
>                 at org.apache.hadoop.hbase.client
> .RpcRetryingCallerWithReadReplicas.throwEnrichedException(Rp
> cRetryingCallerWithReadReplicas.java:276)
>                 at org.apache.hadoop.hbase.client
> .ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:210)
>                 at org.apache.hadoop.hbase.client
> .ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:60)
>                 at org.apache.hadoop.hbase.client
> .RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:210)
>                 at org.apache.hadoop.hbase.client
> .ClientScanner.call(ClientScanner.java:326)
>                 at org.apache.hadoop.hbase.client
> .ClientScanner.nextScanner(ClientScanner.java:301)
>                 at org.apache.hadoop.hbase.client
> .ClientScanner.initializeScannerInConstruction(ClientScanner.java:166)
>                 at org.apache.hadoop.hbase.client
> .ClientScanner.<init>(ClientScanner.java:161)
>                 at org.apache.hadoop.hbase.client
> .HTable.getScanner(HTable.java:797)
>                 at org.apache.hadoop.hbase.MetaTa
> bleAccessor.fullScan(MetaTableAccessor.java:602)
>                 at org.apache.hadoop.hbase.MetaTa
> bleAccessor.tableExists(MetaTableAccessor.java:366)
>                 at org.apache.hadoop.hbase.client
> .HBaseAdmin.tableExists(HBaseAdmin.java:406)
>                 at com.example.projects.database.
> schema.SchemaBuilder.createOrOverwrite(SchemaBuilder.java:31)
>                 at com.example.projects.database.
> schema.SchemaBuilder.createSchemaTables(SchemaBuilder.java:52)
>                 at com.example.projects.database.
> schema.SchemaBuilder.main(SchemaBuilder.java:94)
>                 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> Method)
>                 at sun.reflect.NativeMethodAccess
> orImpl.invoke(NativeMethodAccessorImpl.java:62)
>                 at sun.reflect.DelegatingMethodAc
> cessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>                 at java.lang.reflect.Method.invoke(Method.java:497)
>                 at com.intellij.rt.execution.appl
> ication.AppMain.main(AppMain.java:147)
> Caused by: java.net.SocketTimeoutException: callTimeout=60000,
> callDuration=69291: row 'INSTRUMENT,,' on table 'hbase:meta' at
> region=hbase:meta,,1.1588230740, hostname=e5611ffad72e,60020,1478588595835,
> seqNum=0
>                 at org.apache.hadoop.hbase.client
> .RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:169)
>                 at org.apache.hadoop.hbase.client
> .ResultBoundedCompletionService$QueueingFuture.run(ResultBou
> ndedCompletionService.java:65)
>                 at java.util.concurrent.ThreadPoo
> lExecutor.runWorker(ThreadPoolExecutor.java:1142)
>                 at java.util.concurrent.ThreadPoo
> lExecutor$Worker.run(ThreadPoolExecutor.java:617)
>                 at java.lang.Thread.run(Thread.java:745)
> Caused by: java.net.UnknownHostException: e5611ffad72e
>                 at org.apache.hadoop.hbase.ipc.Ab
> stractRpcClient$BlockingRpcChannelImplementation.<init>(
> AbstractRpcClient.java:315)
>                 at org.apache.hadoop.hbase.ipc.Ab
> stractRpcClient.createBlockingRpcChannel(AbstractRpcClient.java:267)
>                 at org.apache.hadoop.hbase.client
> .ConnectionManager$HConnectionImplementation.getClient(
> ConnectionManager.java:1639)
>                 at org.apache.hadoop.hbase.client.ScannerCallable.prepare(
> ScannerCallable.java:162)
>                 at org.apache.hadoop.hbase.client
> .ScannerCallableWithReplicas$RetryingRPC.prepare(ScannerCall
> ableWithReplicas.java:376)
>                 at org.apache.hadoop.hbase.client
> .RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:134)
>                 ... 4 more
> Thanks again for your help,
> Oliver
>
> -----Original Message-----
> From: Oliver Buckley-Salmon [mailto:oliver.buckley-salmon+external@db.com]
> Sent: 07 November 2016 15:47
> To: user@hbase.apache.org
> Subject: RE: Can connect to HBase via Java API but can't create table
>
> Hi,
> Here's the log on Debug
> 2016-11-07 15:32:01 INFO  InstrumentLoader:61 - Trying to connect to HBase
> 2016-11-07 15:32:01 DEBUG Groups:238 -  Creating new Groups object
> 2016-11-07 15:32:01 DEBUG NativeCodeLoader:46 - Trying to load the
> custom-built native-hadoop library...
> 2016-11-07 15:32:01 DEBUG NativeCodeLoader:55 - Failed to load
> native-hadoop with error: java.lang.UnsatisfiedLinkError: no hadoop in
> java.library.path
> 2016-11-07 15:32:01 DEBUG NativeCodeLoader:56 -
> java.library.path=/Users/oliverbuckley-salmon/Library/Java/
> Extensions:/Library/Java/Extensions:/Network/Library/Java/
> Extensions:/System/Library/Java/Extensions:/usr/lib/java:.
> 2016-11-07 15:32:01 WARN  NativeCodeLoader:62 - Unable to load
> native-hadoop library for your platform... using builtin-java classes where
> applicable
> 2016-11-07 15:32:01 DEBUG JniBasedUnixGroupsMappingWithFallback:40 -
> Falling back to shell based
> 2016-11-07 15:32:01 DEBUG JniBasedUnixGroupsMappingWithFallback:44 -
> Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping
> 2016-11-07 15:32:01 DEBUG Shell:320 - Failed to detect a valid hadoop home
> directory
> java.io.IOException: HADOOP_HOME or hadoop.home.dir are not set.
>                 at org.apache.hadoop.util.Shell.c
> heckHadoopHome(Shell.java:302)
>                 at org.apache.hadoop.util.Shell.<clinit>(Shell.java:327)
>                 at org.apache.hadoop.util.StringU
> tils.<clinit>(StringUtils.java:78)
>                 at org.apache.hadoop.security.Gro
> ups.parseStaticMapping(Groups.java:93)
>                 at org.apache.hadoop.security.Gro
> ups.<init>(Groups.java:77)
>                 at org.apache.hadoop.security.Gro
> ups.getUserToGroupsMappingService(Groups.java:240)
>                 at org.apache.hadoop.security.Gro
> ups.getUserToGroupsMappingService(Groups.java:225)
>                 at org.apache.hadoop.hbase.security.UserProvider.<clinit>(
> UserProvider.java:56)
>                 at org.apache.hadoop.hbase.client
> .ConnectionFactory.createConnection(ConnectionFactory.java:214)
>                 at org.apache.hadoop.hbase.client
> .ConnectionFactory.createConnection(ConnectionFactory.java:119)
>                 at com.example.projects.database.
> loaders.InstrumentLoader.main(InstrumentLoader.java:62)
>                 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> Method)
>                 at sun.reflect.NativeMethodAccess
> orImpl.invoke(NativeMethodAccessorImpl.java:62)
>                 at sun.reflect.DelegatingMethodAc
> cessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>                 at java.lang.reflect.Method.invoke(Method.java:497)
>                 at com.intellij.rt.execution.appl
> ication.AppMain.main(AppMain.java:147)
> 2016-11-07 15:32:01 DEBUG Shell:392 - setsid is not available on this
> machine. So not using it.
> 2016-11-07 15:32:01 DEBUG Shell:396 - setsid exited with exit code 0
> 2016-11-07 15:32:01 DEBUG Groups:80 - Group mapping
> impl=org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback;
> cacheTimeout=300000; warningDeltaMs=5000
> 2016-11-07 15:32:02 DEBUG MutableMetricsFactory:42 - field
> org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.Use
> rGroupInformation$UgiMetrics.loginSuccess with annotation @
> org.apache.hadoop.metrics2.annotation.Metric(always=false, about=,
> sampleName=Ops, type=DEFAULT, value=[Rate of successful kerberos logins and
> latency (milliseconds)], valueName=Time)
> 2016-11-07 15:32:02 DEBUG MutableMetricsFactory:42 - field
> org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.Use
> rGroupInformation$UgiMetrics.loginFailure with annotation @
> org.apache.hadoop.metrics2.annotation.Metric(always=false, about=,
> sampleName=Ops, type=DEFAULT, value=[Rate of failed kerberos logins and
> latency (milliseconds)], valueName=Time)
> 2016-11-07 15:32:02 DEBUG MutableMetricsFactory:42 - field
> org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.Use
> rGroupInformation$UgiMetrics.getGroups with annotation @
> org.apache.hadoop.metrics2.annotation.Metric(always=false, about=,
> sampleName=Ops, type=DEFAULT, value=[GetGroups], valueName=Time)
> 2016-11-07 15:32:02 DEBUG MetricsSystemImpl:221 - UgiMetrics, User and
> group related metrics
> 2016-11-07 15:32:02 DEBUG KerberosName:88 - Kerberos krb5 configuration
> not found, setting default realm to empty
> 2016-11-07 15:32:02 DEBUG UserGroupInformation:195 - hadoop login
> 2016-11-07 15:32:02 DEBUG UserGroupInformation:144 - hadoop login commit
> 2016-11-07 15:32:02 DEBUG UserGroupInformation:174 - using local
> user:UnixPrincipal: oliverbuckley-salmon
> 2016-11-07 15:32:02 DEBUG UserGroupInformation:785 - UGI
> loginUser:oliverbuckley-salmon (auth:SIMPLE)
> 2016-11-07 15:32:02 INFO  RecoverableZooKeeper:120 - Process
> identifier=hconnection-0x43d7741f connecting to ZooKeeper ensemble=
> 138.68.147.208:2181
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:host.name
> =172.20.10.3
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> environment:java.version=1.8.0_45
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> environment:java.vendor=Oracle Corporation
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> environment:java.home=/Library/Java/JavaVirtualMachines/
> jdk1.8.0_45.jdk/Contents/Home/jre
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> environment:java.class.path=/Library/Java/JavaVirtualMachine
> s/jdk1.8.0_45.jdk/Contents/Home/jre/lib/charsets.jar:/
> Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/
> Home/jre/lib/deploy.jar:/Library/Java/JavaVirtualMachin
> es/jdk1.8.0_45.jdk/Contents/Home/jre/lib/ext/cldrdata.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> ext/dnsns.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> 45.jdk/Contents/Home/jre/lib/ext/jfxrt.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> ext/localedata.jar:/Library/Java/JavaVirtualMachines/jdk1.
> 8.0_45.jdk/Contents/Home/jre/lib/ext/nashorn.jar:/Library/
> Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/
> lib/ext/sunec.jar:/Library/Java/JavaVirtualMachines/jdk1.
> 8.0_45.jdk/Contents/Home/jre/lib/ext/sunjce_provider.jar:/L
> ibrary/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/
> Home/jre/lib/ext/sunpkcs11.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> 45.jdk/Contents/Home/jre/lib/ext/zipfs.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> javaws.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.
> jdk/Contents/Home/jre/lib/jce.jar:/Library/Java/JavaVirtualM
> achines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/jfr.jar:
> /Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/
> Home/jre/lib/jfxswt.jar:/Library/Java/JavaVirtualMachin
> es/jdk1.8.0_45.jdk/Contents/Home/jre/lib/jsse.jar:/
> Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/
> Home/jre/lib/management-agent.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> plugin.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.
> jdk/Contents/Home/jre/lib/resources.jar:/Library/Java/JavaVi
> rtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/rt.jar:/
> Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/
> Home/lib/ant-javafx.jar:/Library/Java/JavaVirtualMachin
> es/jdk1.8.0_45.jdk/Contents/Home/lib/dt.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/javafx
> -mx.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/
> Contents/Home/lib/jconsole.jar:/Library/Java/JavaVirtualM
> achines/jdk1.8.0_45.jdk/Contents/Home/lib/packager.
> jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/
> Contents/Home/lib/sa-jdi.jar:/Library/Java/JavaVirtualMachin
> es/jdk1.8.0_45.jdk/Contents/Home/lib/tools.jar:/Users/oliv
> erbuckley-salmon/IdeaProjects/sandpit/database/target/
> classes:/Users/oliverbuckley-salmon/IdeaProjects/sandpit/
> domain/target/classes:/Users/oliverbuckley-salmon/.m2/reposi
> tory/com/google/code/gson/gson/2.6.2/gson-2.6.2.jar:/
> Users/oliverbuckley-salmon/.m2/repository/org/apache/
> hbase/hbase-client/1.2.3/hbase-client-1.2.3.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/apache/hbase/
> hbase-annotations/1.2.3/hbase-annotations-1.2.3.jar:/Users/
> oliverbuckley-salmon/.m2/repository/com/github/stephenc
> /findbugs/findbugs-annotations/1.3.9-1/findbugs-annotations-
> 1.3.9-1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/hbase/
> hbase-common/1.2.3/hbase-common-1.2.3.jar:/Users/oliver
> buckley-salmon/.m2/repository/commons-collections/commons-co
> llections/3.2.2/commons-collections-3.2.2.jar:/Users/oliverb
> uckley-salmon/.m2/repository/org/mortbay/jetty/jetty-util/
> 6.1.26/jetty-util-6.1.26.jar:/Users/oliverbuckley-salmon/.
> m2/repository/org/apache/hbase/hbase-protocol/1.2.3/
> hbase-protocol-1.2.3.jar:/Users/oliverbuckley-salmon/.
> m2/repository/commons-codec/commons-codec/1.9/commons-codec-
> 1.9.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-
> io/commons-io/2.4/commons-io-2.4.jar:/Users/oliverbuckley-
> salmon/.m2/repository/commons-lang/commons-lang/2.6/commons-
> lang-2.6.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-logging/
> commons-logging/1.2/commons-logging-1.2.jar:/Users/
> oliverbuckley-salmon/.m2/repository/com/google/guava/
> guava/12.0.1/guava-12.0.1.jar:/Users/oliverbuckley-salmon/.
> m2/repository/com/google/protobuf/protobuf-java/2.5.0/
> protobuf-java-2.5.0.jar:/Users/oliverbuckley-salmon/.m2
> /repository/io/netty/netty-all/4.0.23.Final/netty-all-4.0.
> 23.Final.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> apache/zookeeper/zookeeper/3.4.6/zookeeper-3.4.6.jar:/
> Users/oliverbuckley-salmon/.m2/repository/org/slf4j/slf4j-
> api/1.6.1/slf4j-api-1.6.1.jar:/Users/oliverbuckley-salmon/.m
> 2/repository/org/slf4j/slf4j-log4j12/1.6.1/slf4j-log4j12-1.6
> .1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache
> /htrace/htrace-core/3.1.0-incubating/htrace-core-3.1.0-
> incubating.jar:/Users/oliverbuckley-salmon/.m2/repository/
> org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-
> mapper-asl-1.9.13.jar:/Users/oliverbuckley-salmon/.m2/
> repository/org/codehaus/jackson/jackson-core-asl/1.9.
> 13/jackson-core-asl-1.9.13.jar:/Users/oliverbuckley-salmo
> n/.m2/repository/org/jruby/jcodings/jcodings/1.0.8/jcodin
> gs-1.0.8.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> jruby/joni/joni/2.1.2/joni-2.1.2.jar:/Users/oliverbuckley-
> salmon/.m2/repository/com/yammer/metrics/metrics-core/2.
> 2.0/metrics-core-2.2.0.jar:/Users/oliverbuckley-salmon/.
> m2/repository/org/apache/hadoop/hadoop-auth/2.5.1/
> hadoop-auth-2.5.1.jar:/Users/oliverbuckley-salmon/.m2/reposi
> tory/org/apache/httpcomponents/httpclient/4.2.5/httpclient-
> 4.2.5.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> apache/httpcomponents/httpcore/4.2.4/httpcore-4.2.4.
> jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> apache/directory/server/apacheds-kerberos-codec/2.0.0-
> M15/apacheds-kerberos-codec-2.0.0-M15.jar:/Users/oliverbuckley-salmon/.m2/
> repository/org/apache/directory/server/apacheds-
> i18n/2.0.0-M15/apacheds-i18n-2.0.0-M15.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/apache/director
> y/api/api-asn1-api/1.0.0-M20/api-asn1-api-1.0.0-M20.jar:/
> Users/oliverbuckley-salmon/.m2/repository/org/apache/
> directory/api/api-util/1.0.0-M20/api-util-1.0.0-M20.jar:/
> Users/oliverbuckley-salmon/.m2/repository/org/apache/
> hadoop/hadoop-common/2.5.1/hadoop-common-2.5.1.jar:/Users
> /oliverbuckley-salmon/.m2/repository/org/apache/hadoop/
> hadoop-annotations/2.5.1/hadoop-annotations-2.5.1.jar:/
> Users/oliverbuckley-salmon/.m2/repository/commons-cli/
> commons-cli/1.2/commons-cli-1.2.jar:/Users/oliverbuckley-
> salmon/.m2/repository/org/apache/commons/commons-math3/
> 3.1.1/commons-math3-3.1.1.jar:/Users/oliverbuckley-salmon/.
> m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/Users/oliv
> erbuckley-salmon/.m2/repository/commons-httpclient/commons-
> httpclient/3.1/commons-httpclient-3.1.jar:/Users/oliverbuckley-salmon/.m2/
> repository/commons-net/commons-net/3.1/commons-net-3.1.jar:/
> Users/oliverbuckley-salmon/.m2/repository/commons-el/
> commons-el/1.0/commons-el-1.0.jar:/Users/oliverbuckley-salmo
> n/.m2/repository/commons-configuration/commons-configuration
> /1.6/commons-configuration-1.6.jar:/Users/oliverbuckley-
> salmon/.m2/repository/commons-digester/commons-digester/1.8/
> commons-digester-1.8.jar:/Users/oliverbuckley-salmon/.
> m2/repository/commons-beanutils/commons-beanutils/1.
> 7.0/commons-beanutils-1.7.0.jar:/Users/oliverbuckley-
> salmon/.m2/repository/commons-beanutils/commons-beanutils-co
> re/1.8.0/commons-beanutils-core-1.8.0.jar:/Users/oliverbuckl
> ey-salmon/.m2/repository/org/apache/avro/avro/1.7.4/avro-1.
> 7.4.jar:/Users/oliverbuckley-salmon/.m2/repository/com/thou
> ghtworks/paranamer/paranamer/2.3/paranamer-2.3.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/xerial/snappy/snappy-java/
> 1.0.4.1/snappy-java-1.0.4.1.jar:/Users/oliverbuckley-salmon/.m2/
> repository/com/jcraft/jsch/0.1.42/jsch-0.1.42.jar:/Users/ol
> iverbuckley-salmon/.m2/repository/com/google/code/findbugs/
> jsr305/1.3.9/jsr305-1.3.9.jar:/Users/oliverbuckley-salmon/.
> m2/repository/org/apache/commons/commons-compress/1.4.
> 1/commons-compress-1.4.1.jar:/Users/oliverbuckley-salmon/.m2
> /repository/org/tukaani/xz/1.0/xz-1.0.jar:/Users/oliverbuck
> ley-salmon/.m2/repository/org/apache/hadoop/hadoop-
> mapreduce-client-core/2.5.1/hadoop-mapreduce-client-core-
> 2.5.1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> apache/hadoop/hadoop-yarn-common/2.5.1/hadoop-yarn-
> common-2.5.1.jar:/Users/oliverbuckley-salmon/.m2/
> repository/org/apache/hadoop/hadoop-yarn-api/2.5.1/hadoop-
> yarn-api-2.5.1.jar:/Users/oliverbuckley-salmon/.m2/
> repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar:
> /Users/oliverbuckley-salmon/.m2/repository/javax/xml/
> stream/stax-api/1.0-2/stax-api-1.0-2.jar:/Users/oliverbuc
> kley-salmon/.m2/repository/javax/activation/activation/1.
> 1/activation-1.1.jar:/Users/oliverbuckley-salmon/.m2/
> repository/io/netty/netty/3.6.2.Final/netty-3.6.2.Final.jar:
> /Users/oliverbuckley-salmon/.m2/repository/log4j/log4j/1.2.
> 17/log4j-1.2.17.jar:/Users/oliverbuckley-salmon/.m2/reposito
> ry/com/hazelcast/hazelcast-all/3.7.2/hazelcast-all-3.7.2.
> jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/curator/curator-
> framework/2.10.0/curator-framework-2.10.0.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/apache/curator/
> curator-client/2.10.0/curator-client-2.10.0.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/apache/curator/
> curator-x-discovery/2.10.0/curator-x-discovery-2.10.0.
> jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/
> curator/curator-recipes/2.10.0/curator-recipes-2.10.0.jar:/
> Users/oliverbuckley-salmon/.m2/repository/org/apache/
> curator/curator-test/2.10.0/curator-test-2.10.0.jar:/
> Users/oliverbuckley-salmon/.m2/repository/org/javassist/ja
> vassist/3.18.1-GA/javassist-3.18.1-GA.jar:/Users/oliverbuckl
> ey-salmon/.m2/repository/org/apache/commons/commons-math/2.
> 2/commons-math-2.2.jar:/Users/oliverbuckley-salmon/.m2/
> repository/com/hazelcast/hazelcast-zookeeper/3.6.1/
> hazelcast-zookeeper-3.6.1.jar:/Users/oliverbuckley-salmon/.
> m2/repository/joda-time/joda-time/2.9.4/joda-time-2.9.4.
> jar:/Applications/IntelliJ IDEA.app/Contents/lib/idea_rt.jar
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> environment:java.library.path=/Users/oliverbuckley-salmon/Li
> brary/Java/Extensions:/Library/Java/Extensions:/Network/
> Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java:.
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> environment:java.io.tmpdir=/var/folders/sx/g9vbcw9d3j54gtj89
> n57g1fw0000gn/T/
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> environment:java.compiler=<NA>
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:os.name=Mac
> OS X
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:os.arch=x86_64
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> environment:os.version=10.11.6
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:user.name
> =oliverbuckley-salmon
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> environment:user.home=/Users/oliverbuckley-salmon
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> environment:user.dir=/Users/oliverbuckley-salmon/IdeaProjects/sandpit
> 2016-11-07 15:32:02 INFO  ZooKeeper:438 - Initiating client connection,
> connectString=138.68.147.208:2181 sessionTimeout=90000
> watcher=hconnection-0x43d7741f0x0, quorum=138.68.147.208:2181,
> baseZNode=/hbase
> 2016-11-07 15:32:02 DEBUG ClientCnxn:102 - zookeeper.disableAutoWatchReset
> is false
> 2016-11-07 15:32:02 INFO  ClientCnxn:975 - Opening socket connection to
> server 138.68.147.208/138.68.147.208:2181. Will not attempt to
> authenticate using SASL (unknown error)
> 2016-11-07 15:32:02 INFO  ClientCnxn:852 - Socket connection established
> to 138.68.147.208/138.68.147.208:2181, initiating session
> 2016-11-07 15:32:02 DEBUG ClientCnxn:892 - Session establishment request
> sent on 138.68.147.208/138.68.147.208:2181
> 2016-11-07 <http://138.68.147.208/138.68.147.208:21812016-11-07> 15:32:03
> INFO  ClientCnxn:1235 - Session establishment complete on server
> 138.68.147.208/138.68.147.208:2181, sessionid = 0x1583b2a4dbb000b,
> negotiated timeout = 90000
> 2016-11-07 15:32:03 DEBUG ZooKeeperWatcher:602 -
> hconnection-0x43d7741f0x0, quorum=138.68.147.208:2181, baseZNode=/hbase
> Received ZooKeeper Event, type=None, state=SyncConnected, path=null
> 2016-11-07 15:32:03 DEBUG ZooKeeperWatcher:686 -
> hconnection-0x43d7741f-0x1583b2a4dbb000b connected
> 2016-11-07 15:32:03 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 1,3  replyHeader:: 1,182,0  request::
> '/hbase/hbaseid,F  response:: s{17,132,1478127149340,1478461
> 382903,1,0,0,0,67,0,17}
> 2016-11-07 15:32:03 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 2,4  replyHeader:: 2,182,0  request::
> '/hbase/hbaseid,F  response:: #ffffffff000146d61737465723a36
> 3030303040ffffffd533ffffffc7ffffffa430fffffffafffffff5504255
> 46a2439353634626535382d616531632d343734352d393638352d3465643
> 43830343638636232,s{17,132,1478127149340,1478461382903,1,0,0,0,67,0,17}
> 2016-11-07 15:32:03 DEBUG AbstractRpcClient:116 -
> Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f3f4916,
> compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000,
> readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0,
> fallbackAllowed=false, bind address=null
> 2016-11-07 15:32:03 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 3,4  replyHeader:: 3,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:32:03 INFO  InstrumentLoader:64 - Master Info Port: 60010
> 2016-11-07 15:32:03 INFO  InstrumentLoader:65 - Connected to HBase
> 2016-11-07 15:32:03 INFO  InstrumentLoader:67 - Trying to create tables
> Creating table. 2016-11-07 15:32:03 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 4,3  replyHeader:: 4,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:32:03 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 5,4  replyHeader:: 5,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:32:04 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 6,3  replyHeader:: 6,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:32:04 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 7,4  replyHeader:: 7,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:32:04 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 8,3  replyHeader:: 8,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:32:04 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 9,4  replyHeader:: 9,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:32:05 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 10,3  replyHeader:: 10,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:32:05 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 11,4  replyHeader:: 11,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:32:05 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 12,3  replyHeader:: 12,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:32:05 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 13,4  replyHeader:: 13,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:32:06 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 14,3  replyHeader:: 14,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:32:06 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 15,4  replyHeader:: 15,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:32:09 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 16,3  replyHeader:: 16,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:32:09 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 17,4  replyHeader:: 17,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:32:13 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 18,3  replyHeader:: 18,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:32:13 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 19,4  replyHeader:: 19,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:32:23 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 20,3  replyHeader:: 20,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:32:23 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 280ms
> 2016-11-07 15:32:23 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 21,4  replyHeader:: 21,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:32:33 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 22,3  replyHeader:: 22,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:32:33 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 254ms
> 2016-11-07 15:32:33 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 23,4  replyHeader:: 23,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:32:44 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 24,3  replyHeader:: 24,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:32:44 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 261ms
> 2016-11-07 15:32:44 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 25,4  replyHeader:: 25,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:32:44 INFO  RpcRetryingCaller:142 - Call exception,
> tries=10, retries=35, started=40432 ms ago, cancelled=false, msg=
> 2016-11-07 15:32:54 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 26,3  replyHeader:: 26,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:32:54 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 121ms
> 2016-11-07 15:32:54 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 27,4  replyHeader:: 27,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:32:54 INFO  RpcRetryingCaller:142 - Call exception,
> tries=11, retries=35, started=50639 ms ago, cancelled=false, msg=
> 2016-11-07 15:33:14 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 28,3  replyHeader:: 28,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:33:14 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 82ms
> 2016-11-07 15:33:14 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 29,4  replyHeader:: 29,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:33:14 INFO  RpcRetryingCaller:142 - Call exception,
> tries=12, retries=35, started=70917 ms ago, cancelled=false, msg=
> 2016-11-07 15:33:34 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 30,3  replyHeader:: 30,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:33:34 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 100ms
> 2016-11-07 15:33:35 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 31,4  replyHeader:: 31,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:33:35 INFO  RpcRetryingCaller:142 - Call exception,
> tries=13, retries=35, started=91231 ms ago, cancelled=false, msg=
> 2016-11-07 15:33:55 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 32,3  replyHeader:: 32,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:33:55 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 49ms
> 2016-11-07 15:33:55 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 33,4  replyHeader:: 33,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:33:55 INFO  RpcRetryingCaller:142 - Call exception,
> tries=14, retries=35, started=111511 ms ago, cancelled=false, msg=
> 2016-11-07 15:34:15 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 34,3  replyHeader:: 34,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:34:15 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 62ms
> 2016-11-07 15:34:15 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 35,4  replyHeader:: 35,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:34:15 INFO  RpcRetryingCaller:142 - Call exception,
> tries=15, retries=35, started=131746 ms ago, cancelled=false, msg=
> 2016-11-07 15:34:35 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 36,3  replyHeader:: 36,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:34:35 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 96ms
> 2016-11-07 15:34:35 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 37,4  replyHeader:: 37,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:34:35 INFO  RpcRetryingCaller:142 - Call exception,
> tries=16, retries=35, started=152094 ms ago, cancelled=false, msg=
> 2016-11-07 15:34:56 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 38,3  replyHeader:: 38,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:34:56 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 77ms
> 2016-11-07 15:34:56 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 39,4  replyHeader:: 39,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:34:56 INFO  RpcRetryingCaller:142 - Call exception,
> tries=17, retries=35, started=172334 ms ago, cancelled=false, msg=
> 2016-11-07 15:35:16 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 40,3  replyHeader:: 40,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:35:16 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 177ms
> 2016-11-07 15:35:16 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 41,4  replyHeader:: 41,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:35:16 INFO  RpcRetryingCaller:142 - Call exception,
> tries=18, retries=35, started=192647 ms ago, cancelled=false, msg=
> 2016-11-07 15:35:36 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 42,3  replyHeader:: 42,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:35:36 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 45ms
> 2016-11-07 15:35:36 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 43,4  replyHeader:: 43,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:35:36 INFO  RpcRetryingCaller:142 - Call exception,
> tries=19, retries=35, started=212887 ms ago, cancelled=false, msg=
> 2016-11-07 15:35:56 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 44,3  replyHeader:: 44,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:35:56 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 187ms
> 2016-11-07 15:35:56 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 45,4  replyHeader:: 45,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:35:56 INFO  RpcRetryingCaller:142 - Call exception,
> tries=20, retries=35, started=233201 ms ago, cancelled=false, msg=
> 2016-11-07 15:36:17 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 46,3  replyHeader:: 46,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:36:17 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 115ms
> 2016-11-07 15:36:17 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 47,4  replyHeader:: 47,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:36:17 INFO  RpcRetryingCaller:142 - Call exception,
> tries=21, retries=35, started=253524 ms ago, cancelled=false, msg=
> 2016-11-07 15:36:37 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 48,3  replyHeader:: 48,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:36:37 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 121ms
> 2016-11-07 15:36:37 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 49,4  replyHeader:: 49,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:36:37 INFO  RpcRetryingCaller:142 - Call exception,
> tries=22, retries=35, started=273868 ms ago, cancelled=false, msg=
> 2016-11-07 15:36:57 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 50,3  replyHeader:: 50,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:36:57 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 67ms
> 2016-11-07 15:36:57 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 51,4  replyHeader:: 51,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:36:57 INFO  RpcRetryingCaller:142 - Call exception,
> tries=23, retries=35, started=294029 ms ago, cancelled=false, msg=
> 2016-11-07 15:37:18 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 52,3  replyHeader:: 52,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:37:18 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 43ms
> 2016-11-07 15:37:18 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 53,4  replyHeader:: 53,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:37:18 INFO  RpcRetryingCaller:142 - Call exception,
> tries=24, retries=35, started=314332 ms ago, cancelled=false, msg=
> 2016-11-07 15:37:38 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 54,3  replyHeader:: 54,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:37:38 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 79ms
> 2016-11-07 15:37:38 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 55,4  replyHeader:: 55,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:37:38 INFO  RpcRetryingCaller:142 - Call exception,
> tries=25, retries=35, started=334581 ms ago, cancelled=false, msg=
> 2016-11-07 15:37:58 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 56,3  replyHeader:: 56,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:37:58 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 118ms
> 2016-11-07 15:37:58 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 57,4  replyHeader:: 57,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:37:58 INFO  RpcRetryingCaller:142 - Call exception,
> tries=26, retries=35, started=354793 ms ago, cancelled=false, msg=
> 2016-11-07 15:38:18 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 58,3  replyHeader:: 58,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:38:18 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 180ms
> 2016-11-07 15:38:18 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 59,4  replyHeader:: 59,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:38:18 INFO  RpcRetryingCaller:142 - Call exception,
> tries=27, retries=35, started=375092 ms ago, cancelled=false, msg=
> 2016-11-07 15:38:39 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 60,3  replyHeader:: 60,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:38:39 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 64ms
> 2016-11-07 15:38:39 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 61,4  replyHeader:: 61,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:38:39 INFO  RpcRetryingCaller:142 - Call exception,
> tries=28, retries=35, started=395321 ms ago, cancelled=false, msg=
> 2016-11-07 15:38:59 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 62,3  replyHeader:: 62,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:38:59 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 63ms
> 2016-11-07 15:38:59 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 63,4  replyHeader:: 63,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:38:59 INFO  RpcRetryingCaller:142 - Call exception,
> tries=29, retries=35, started=415488 ms ago, cancelled=false, msg=
> 2016-11-07 15:39:19 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 64,3  replyHeader:: 64,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:39:19 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 164ms
> 2016-11-07 15:39:19 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 65,4  replyHeader:: 65,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:39:19 INFO  RpcRetryingCaller:142 - Call exception,
> tries=30, retries=35, started=435727 ms ago, cancelled=false, msg=
> 2016-11-07 15:39:39 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 66,3  replyHeader:: 66,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:39:39 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 63ms
> 2016-11-07 15:39:40 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 67,4  replyHeader:: 67,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:39:40 INFO  RpcRetryingCaller:142 - Call exception,
> tries=31, retries=35, started=456258 ms ago, cancelled=false, msg=
> 2016-11-07 15:40:00 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 68,3  replyHeader:: 68,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:40:00 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 186ms
> 2016-11-07 15:40:00 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 69,4  replyHeader:: 69,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:40:00 INFO  RpcRetryingCaller:142 - Call exception,
> tries=32, retries=35, started=476964 ms ago, cancelled=false, msg=
> 2016-11-07 15:40:20 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 70,3  replyHeader:: 70,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:40:20 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 38ms
> 2016-11-07 15:40:21 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 71,4  replyHeader:: 71,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:40:21 INFO  RpcRetryingCaller:142 - Call exception,
> tries=33, retries=35, started=497229 ms ago, cancelled=false, msg=
> 2016-11-07 15:40:41 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 72,3  replyHeader:: 72,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:40:41 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 51ms
> 2016-11-07 15:40:41 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 73,4  replyHeader:: 73,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:40:41 INFO  RpcRetryingCaller:142 - Call exception,
> tries=34, retries=35, started=517438 ms ago, cancelled=false, msg=
> 2016-11-07 15:40:41 ERROR InstrumentLoader:114 - Error connecting to HBase
> Serverorg.apache.hadoop.hbase.client.RetriesExhaustedException: Failed
> after attempts=35, exceptions:
> Mon Nov 07 15:32:04 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:32:04 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:32:04 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:32:05 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:32:05 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:32:06 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:32:09 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:32:13 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:32:23 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:32:33 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:32:44 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:32:54 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:33:14 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:33:35 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:33:55 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:34:15 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:34:35 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:34:56 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:35:16 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:35:36 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:35:56 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:36:17 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:36:37 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:36:57 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:37:18 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:37:38 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:37:58 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:38:18 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:38:39 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:38:59 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:39:19 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:39:40 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:40:00 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:40:21 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:40:41 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
>
>
> Process finished with exit code 0
>
> The container is contactable as Zookeeper is running in the same container.
> Thanks very much for your help.
> Oliver
>
> -----Original Message-----
> From: Ted Yu [mailto:yuzhihong@gmail.com]
> Sent: 07 November 2016 15:05
> To: user@hbase.apache.org
> Subject: Re: Can connect to HBase via Java API but can't create table
>
> Can you show more of the UnknownHostException ?
>
> Could this be related to the firewall on the Docker container ?
>
> Cheers
>
> On Mon, Nov 7, 2016 at 6:49 AM, Oliver Buckley-Salmon <
> oliver.buckley-salmon@db.com> wrote:
>
> > Hi
> >
> > I am trying to create a table in HBase using the Java API, I can
> > connect to Zookeeper
> >
> > 2016-11-06 15:18:36 INFO  RecoverableZooKeeper:120 - Process
> > identifier=hconnection-0x382db087 connecting to ZooKeeper ensemble=
> > 138.68.147.208:2181
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09
> > GMT
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client environment:host.name
> > =olivers-air.default
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:java.version=1.8.0_45
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:java.vendor=Oracle Corporation
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:java.home=/
> > Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:java.class.path=/Library/Java/JavaVirtualMachines/jdk1.8.0
> > _ 45.jdk/Contents/Home/jre/lib/charsets.jar:/Library/Java/
> > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> > deploy.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > 45.jdk/Contents/Home/jre/lib/ext/cldrdata.jar:/Library/
> > Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/
> > lib/ext/dnsns.jar:/Library/Java/JavaVirtualMachines/jdk1.
> > 8.0_45.jdk/Contents/Home/jre/lib/ext/jfxrt.jar:/Library/
> > Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/
> > lib/ext/localedata.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > 45.jdk/Contents/Home/jre/lib/ext/nashorn.jar:/Library/Java/
> > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> > ext/sunec.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > 45.jdk/Contents/Home/jre/lib/ext/sunjce_provider.jar:/Library/Java/
> > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> > ext/sunpkcs11.jar:/Library/Java/JavaVirtualMachines/jdk1.
> > 8.0_45.jdk/Contents/Home/jre/lib/ext/zipfs.jar:/Library/
> > Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/
> > lib/javaws.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > 45.jdk/Contents/Home/jre/lib/jce.jar:/Library/Java/
> > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> > jfr.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > 45.jdk/Contents/Home/jre/lib/jfxswt.jar:/Library/Java/
> > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> > jsse.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > 45.jdk/Contents/Home/jre/lib/management-agent.jar:/Library/
> > Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/
> > lib/plugin.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > 45.jdk/Contents/Home/jre/lib/resources.jar:/Library/Java/
> > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> > rt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > 45.jdk/Contents/Home/lib/ant-javafx.jar:/Library/Java/
> > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/dt.
> > jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/li
> > b/ javafx-mx.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > 45.jdk/Contents/Home/lib/jconsole.jar:/Library/Java/
> > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/
> > packager.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > 45.jdk/Contents/Home/lib/sa-jdi.jar:/Library/Java/
> > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/tools.jar:/Users
> > /
> > oliverbuckley-salmon/IdeaProjects/sandpit/database/target/classes:/Use
> > rs/
> > oliverbuckley-salmon/IdeaProjects/sandpit/domain/target/classes:/Users
> > / oliverbuckley-salmon/.m2/repository/com/google/code/
> > gson/gson/2.6.2/gson-2.6.2.jar:/Users/oliverbuckley-
> > salmon/.m2/repository/org/apache/hbase/hbase-client/1.2.
> > 3/hbase-client-1.2.3.jar:/Users/oliverbuckley-salmon/.
> > m2/repository/org/apache/hbase/hbase-annotations/1.2.3/
> > hbase-annotations-1.2.3.jar:/Users/oliverbuckley-salmon/.
> > m2/repository/com/github/stephenc/findbugs/findbugs-
> > annotations/1.3.9-1/findbugs-annotations-1.3.9-1.jar:/
> > Users/oliverbuckley-salmon/.m2/repository/org/apache/
> > hbase/hbase-common/1.2.3/hbase-common-1.2.3.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/commons-collections/commons-
> > collections/3.2.2/commons-collections-3.2.2.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/org/mortbay/jetty/
> > jetty-util/6.1.26/jetty-util-6.1.26.jar:/Users/oliverbuckley-salmon/.m
> > 2/
> > repository/org/apache/hbase/hbase-protocol/1.2.3/hbase-
> > protocol-1.2.3.jar:/Users/oliverbuckley-salmon/.m2/
> > repository/commons-codec/commons-codec/1.9/commons-codec-1.9.jar:/User
> > s/
> > oliverbuckley-salmon/.m2/repository/commons-io/commons-
> > io/2.4/commons-io-2.4.jar:/Users/oliverbuckley-salmon/.
> > m2/repository/commons-lang/commons-lang/2.6/commons-lang-
> > 2.6.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-
> > logging/commons-logging/1.2/commons-logging-1.2.jar:/
> > Users/oliverbuckley-salmon/.m2/repository/com/google/
> > guava/guava/12.0.1/guava-12.0.1.jar:/Users/oliverbuckley-
> > salmon/.m2/repository/com/google/protobuf/protobuf-java/
> > 2.5.0/protobuf-java-2.5.0.jar:/Users/oliverbuckley-salmon/.
> > m2/repository/io/netty/netty-all/4.0.23.Final/netty-all-4.
> > 0.23.Final.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/
> > zookeeper/zookeeper/3.4.6/zookeeper-3.4.6.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/org/slf4j/slf4j-
> > api/1.6.1/slf4j-api-1.6.1.jar:/Users/oliverbuckley-salmon/.
> > m2/repository/org/slf4j/slf4j-log4j12/1.6.1/slf4j-log4j12-1.
> > 6.1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> > apache/htrace/htrace-core/3.1.0-incubating/htrace-core-3.1.
> > 0-incubating.jar:/Users/oliverbuckley-salmon/.m2/repository/org/codeha
> > us/ jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.
> > 13.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> > codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.
> > 9.13.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> > jruby/jcodings/jcodings/1.0.8/jcodings-1.0.8.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/org/jruby/joni/
> > joni/2.1.2/joni-2.1.2.jar:/Users/oliverbuckley-salmon/.
> > m2/repository/com/yammer/metrics/metrics-core/2.2.0/
> > metrics-core-2.2.0.jar:/Users/oliverbuckley-salmon/.m2/
> > repository/org/apache/hadoop/hadoop-auth/2.5.1/hadoop-auth-
> > 2.5.1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/
> > httpcomponents/httpclient/4.2.5/httpclient-4.2.5.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/org/apache/
> > httpcomponents/httpcore/4.2.4/httpcore-4.2.4.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/org/apache/directory/server/apache
> > ds-
> > kerberos-codec/2.0.0-M15/apacheds-kerberos-codec-2.0.0-
> > M15.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> > apache/directory/server/apacheds-i18n/2.0.0-M15/
> > apacheds-i18n-2.0.0-M15.jar:/Users/oliverbuckley-salmon/.
> > m2/repository/org/apache/directory/api/api-asn1-api/1.
> > 0.0-M20/api-asn1-api-1.0.0-M20.jar:/Users/oliverbuckley-
> > salmon/.m2/repository/org/apache/directory/api/api-util/
> > 1.0.0-M20/api-util-1.0.0-M20.jar:/Users/oliverbuckley-
> > salmon/.m2/repository/org/apache/hadoop/hadoop-common/2.
> > 5.1/hadoop-common-2.5.1.jar:/Users/oliverbuckley-salmon/.
> > m2/repository/org/apache/hadoop/hadoop-annotations/2.5.
> > 1/hadoop-annotations-2.5.1.jar:/Users/oliverbuckley-
> > salmon/.m2/repository/commons-cli/commons-cli/1.2/commons-
> > cli-1.2.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/comm
> > ons/ commons-math3/3.1.1/commons-math3-3.1.1.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/xmlenc/xmlenc/0.52/
> > xmlenc-0.52.jar:/Users/oliverbuckley-salmon/.m2/
> > repository/commons-httpclient/commons-httpclient/3.1/
> > commons-httpclient-3.1.jar:/Users/oliverbuckley-salmon/.
> > m2/repository/commons-net/commons-net/3.1/commons-net-3.
> > 1.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-
> > el/commons-el/1.0/commons-el-1.0.jar:/Users/oliverbuckley-
> > salmon/.m2/repository/commons-configuration/commons-
> > configuration/1.6/commons-configuration-1.6.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/commons-digester/
> > commons-digester/1.8/commons-digester-1.8.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/commons-beanutils/
> > commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar:/
> > Users/oliverbuckley-salmon/.m2/repository/commons-
> > beanutils/commons-beanutils-core/1.8.0/commons-beanutils-
> > core-1.8.0.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/a
> > vro/
> > avro/1.7.4/avro-1.7.4.jar:/Users/oliverbuckley-salmon/.m2/repository/c
> > om/ thoughtworks/paranamer/paranamer/2.3/paranamer-2.3.
> > jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> > xerial/snappy/snappy-java/1.0.4.1/snappy-java-1.0.4.1.jar:/
> > Users/oliverbuckley-salmon/.m2/repository/com/jcraft/jsch/
> > 0.1.42/jsch-0.1.42.jar:/Users/oliverbuckley-salmon/.m2/
> > repository/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar:/Use
> > rs/ oliverbuckley-salmon/.m2/repository/org/apache/commons/
> > commons-compress/1.4.1/commons-compress-1.4.1.jar:/
> > Users/oliverbuckley-salmon/.m2/repository/org/tukaani/xz/
> > 1.0/xz-1.0.jar:/Users/oliverbuckley-salmon/.m2/
> > repository/org/apache/hadoop/hadoop-mapreduce-client-core/
> > 2.5.1/hadoop-mapreduce-client-core-2.5.1.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/org/apache/hadoop/
> > hadoop-yarn-common/2.5.1/hadoop-yarn-common-2.5.1.jar:/
> > Users/oliverbuckley-salmon/.m2/repository/org/apache/
> > hadoop/hadoop-yarn-api/2.5.1/hadoop-yarn-api-2.5.1.jar:/
> > Users/oliverbuckley-salmon/.m2/repository/javax/xml/bind/
> > jaxb-api/2.2.2/jaxb-api-2.2.2.jar:/Users/oliverbuckley-
> > salmon/.m2/repository/javax/xml/stream/stax-api/1.0-2/
> > stax-api-1.0-2.jar:/Users/oliverbuckley-salmon/.m2/
> > repository/javax/activation/activation/1.1/activation-1.1.
> > jar:/Users/oliverbuckley-salmon/.m2/repository/io/
> > netty/netty/3.6.2.Final/netty-3.6.2.Final.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/log4j/log4j/1.2.17/
> > log4j-1.2.17.jar:/Users/oliverbuckley-salmon/.m2/repository/com/hazelc
> > ast/ hazelcast-all/3.7.2/hazelcast-all-3.7.2.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/org/apache/curator/
> > curator-framework/2.10.0/curator-framework-2.10.0.jar:/
> > Users/oliverbuckley-salmon/.m2/repository/org/apache/
> > curator/curator-client/2.10.0/curator-client-2.10.0.jar:/
> > Users/oliverbuckley-salmon/.m2/repository/org/apache/
> > curator/curator-x-discovery/2.10.0/curator-x-discovery-2.10.
> > 0.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> > apache/curator/curator-recipes/2.10.0/curator-recipes-2.10.0.jar:/User
> > s/ oliverbuckley-salmon/.m2/repository/org/apache/curator/
> > curator-test/2.10.0/curator-test-2.10.0.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/org/javassist/
> > javassist/3.18.1-GA/javassist-3.18.1-GA.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/org/apache/commons/
> > commons-math/2.2/commons-math-2.2.jar:/Users/oliverbuckley-
> > salmon/.m2/repository/com/hazelcast/hazelcast-zookeeper/
> > 3.6.1/hazelcast-zookeeper-3.6.1.jar:/Users/oliverbuckley-
> > salmon/.m2/repository/joda-time/joda-time/2.9.4/joda-
> > time-2.9.4.jar:/Applications/IntelliJ
> > IDEA.app/Contents/lib/idea_rt.jar
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:java.library.path=/Users/oliverbuckley-salmon/
> > Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java
> > / Extensions:/System/Library/Java/Extensions:/usr/lib/java:.
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:java.io.tmpdir=/var/folders/sx/g9vbcw9d3j54gtj89n57g1fw000
> > 0gn
> > /T/
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:java.compiler=<NA>
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:os.name=Mac OS X
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:os.arch=x86_64
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:os.version=10.11.6
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:user.name= oliverbuckley-salmon
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:user.home=/Users/oliverbuckley-salmon
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:user.dir=/Users/oliverbuckley-salmon/IdeaProjects/sandpit
> > 2016-11-06 15:18:36 INFO  ZooKeeper:438 - Initiating client
> > connection,
> > connectString=138.68.147.208:2181 sessionTimeout=90000
> > watcher=hconnection-0x382db0870x0, quorum=138.68.147.208:2181,
> > baseZNode=/hbase
> > 2016-11-06 15:18:37 INFO  ClientCnxn:975 - Opening socket connection
> > to server 138.68.147.208/138.68.147.208:2181. Will not attempt to
> > authenticate using SASL (unknown error)
> > 2016-11-06 15:18:37 INFO  ClientCnxn:852 - Socket connection
> > established to 138.68.147.208/138.68.147.208:2181, initiating session
> > 2016-11-06 15:18:37 INFO  ClientCnxn:1235 - Session establishment
> > complete on server 138.68.147.208/138.68.147.208:2181, sessionid =
> > 0x158273e5275001d, negotiated timeout = 90000
> >
> > I can connect to HBase as I can see it in the debugger, but when I try
> > to create a table it fails after 35 retries with
> > org.apache.hadoop.hbase.MasterNotRunningException:
> > java.net.UnknownHostException
> >
> > I can connect to HBase with the UI and can see the Master and Region
> > servers.
> >
> > My code looks like this
> > Configuration hBaseConfig =  HBaseConfiguration.create();
> >             hBaseConfig.setInt("timeout", 120000);
> >             hBaseConfig.set("hbase.master", hbaseHost + ":60000");
> >             hBaseConfig.set("hbase.zookeeper.quorum",zookeeperHost);
> >             hBaseConfig.set("hbase.zookeeper.property.clientPort",
> > "2181");
> >
> >             logger.info("Trying to connect to HBase");
> >             Connection connection = ConnectionFactory.
> > createConnection(hBaseConfig);
> >             Admin admin = connection.getAdmin();
> >             logger.info("Connected to HBase");
> >
> >             logger.info("Trying to create tables");
> >             createSchemaTables(admin);
> >             logger.info("Tables created");
> >
> > CreateSchemaTables looks like this and the code fails and retries at
> > admin.createTable(table); public static void createSchemaTables(Admin
> > admin) throws IOException {
> >
> >
> >
> >         HTableDescriptor table = new HTableDescriptor(TableName.
> > valueOf(tableName));
> >         HColumnDescriptor cf = new HColumnDescriptor(columnFamily).
> > setCompressionType(Algorithm.NONE);
> >
> >         table.addFamily(cf);
> >
> >         System.out.print("Creating table. ");
> >         admin.createTable(table);
> >         System.out.println(" Done.");
> >
> > The client is running on my Mac Air and Hbase is running in a Docker
> > container (nerdammer/hbase) Digital Ocean.
> >
> > Does anyone have any idea why I can connect to HBase but not create
> tables?
> >
> > Thanks in advance for your help, Oliver
> >
> >
> >
> >
> > ---
> > This e-mail may contain confidential and/or privileged information. If
> > you are not the intended recipient (or have received this e-mail in
> > error) please notify the sender immediately and delete this e-mail.
> > Any unauthorized copying, disclosure or distribution of the material
> > in this e-mail is strictly forbidden.
> >
> > Please refer to https://www.db.com/disclosures for additional EU
> > corporate and regulatory disclosures and to http://www.db.com/
> > unitedkingdom/content/privacy.htm for information about privacy.
> >
>
>
> ---
> This e-mail may contain confidential and/or privileged information. If you
> are not the intended recipient (or have received this e-mail in error)
> please notify the sender immediately and delete this e-mail. Any
> unauthorized copying, disclosure or distribution of the material in this
> e-mail is strictly forbidden.
>
> Please refer to https://www.db.com/disclosures for additional EU
> corporate and regulatory disclosures and to http://www.db.com/unitedkingdo
> m/content/privacy.htm for information about privacy.
>
>
> ---
> This e-mail may contain confidential and/or privileged information. If you
> are not the intended recipient (or have received this e-mail in error)
> please notify the sender immediately and delete this e-mail. Any
> unauthorized copying, disclosure or distribution of the material in this
> e-mail is strictly forbidden.
>
> Please refer to https://www.db.com/disclosures for additional EU
> corporate and regulatory disclosures and to http://www.db.com/unitedkingdo
> m/content/privacy.htm for information about privacy.
>


---
This e-mail may contain confidential and/or privileged information. If you are not the intended recipient (or have received this e-mail in error) please notify the sender immediately and delete this e-mail. Any unauthorized copying, disclosure or distribution of the material in this e-mail is strictly forbidden.

Please refer to https://www.db.com/disclosures for additional EU corporate and regulatory disclosures and to http://www.db.com/unitedkingdom/content/privacy.htm for information about privacy.

RE: Can connect to HBase via Java API but can't create table

Posted by Oliver Buckley-Salmon <ol...@db.com>.
Hi,
HBase is running in Pseudo Clustered mode with Zookeeper in a docker container based on the nerdammer/hbase image.

Could it be that Zookeeper is returning 0.0.0.0 as the IP address and I need to map the server's IP address to that in my hosts file?

I can connect to Zookeeper fine so my mac can definitely reach the server, it's post Zookeeper session establishment that the problem occurs.

Thanks again for your help,
Oliver

-----Original Message-----
From: saint.ack@gmail.com [mailto:saint.ack@gmail.com] On Behalf Of Stack
Sent: 11 November 2016 00:37
To: Hbase-User <us...@hbase.apache.org>
Subject: Re: Can connect to HBase via Java API but can't create table

Please fix unknown host. The hbase client doesn't know how to get to the
server.
St.Ack

On Tue, Nov 8, 2016 at 12:26 AM, Oliver Buckley-Salmon <
oliver.buckley-salmon@db.com> wrote:

> Hi,
> Here's a better exception
>
> Exception in thread "main" org.apache.hadoop.hbase.client.RetriesExhaustedException:
> Failed after attempts=36, exceptions:
> Tue Nov 08 07:06:48 GMT 2016, null, java.net.SocketTimeoutException:
> callTimeout=60000, callDuration=69291: row 'INSTRUMENT,,' on table
> 'hbase:meta' at region=hbase:meta,,1.1588230740,
> hostname=e5611ffad72e,60020,1478588595835, seqNum=0
>
>                 at org.apache.hadoop.hbase.client
> .RpcRetryingCallerWithReadReplicas.throwEnrichedException(Rp
> cRetryingCallerWithReadReplicas.java:276)
>                 at org.apache.hadoop.hbase.client
> .ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:210)
>                 at org.apache.hadoop.hbase.client
> .ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:60)
>                 at org.apache.hadoop.hbase.client
> .RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:210)
>                 at org.apache.hadoop.hbase.client
> .ClientScanner.call(ClientScanner.java:326)
>                 at org.apache.hadoop.hbase.client
> .ClientScanner.nextScanner(ClientScanner.java:301)
>                 at org.apache.hadoop.hbase.client
> .ClientScanner.initializeScannerInConstruction(ClientScanner.java:166)
>                 at org.apache.hadoop.hbase.client
> .ClientScanner.<init>(ClientScanner.java:161)
>                 at org.apache.hadoop.hbase.client
> .HTable.getScanner(HTable.java:797)
>                 at org.apache.hadoop.hbase.MetaTa
> bleAccessor.fullScan(MetaTableAccessor.java:602)
>                 at org.apache.hadoop.hbase.MetaTa
> bleAccessor.tableExists(MetaTableAccessor.java:366)
>                 at org.apache.hadoop.hbase.client
> .HBaseAdmin.tableExists(HBaseAdmin.java:406)
>                 at com.example.projects.database.
> schema.SchemaBuilder.createOrOverwrite(SchemaBuilder.java:31)
>                 at com.example.projects.database.
> schema.SchemaBuilder.createSchemaTables(SchemaBuilder.java:52)
>                 at com.example.projects.database.
> schema.SchemaBuilder.main(SchemaBuilder.java:94)
>                 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> Method)
>                 at sun.reflect.NativeMethodAccess
> orImpl.invoke(NativeMethodAccessorImpl.java:62)
>                 at sun.reflect.DelegatingMethodAc
> cessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>                 at java.lang.reflect.Method.invoke(Method.java:497)
>                 at com.intellij.rt.execution.appl
> ication.AppMain.main(AppMain.java:147)
> Caused by: java.net.SocketTimeoutException: callTimeout=60000,
> callDuration=69291: row 'INSTRUMENT,,' on table 'hbase:meta' at
> region=hbase:meta,,1.1588230740, hostname=e5611ffad72e,60020,1478588595835,
> seqNum=0
>                 at org.apache.hadoop.hbase.client
> .RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:169)
>                 at org.apache.hadoop.hbase.client
> .ResultBoundedCompletionService$QueueingFuture.run(ResultBou
> ndedCompletionService.java:65)
>                 at java.util.concurrent.ThreadPoo
> lExecutor.runWorker(ThreadPoolExecutor.java:1142)
>                 at java.util.concurrent.ThreadPoo
> lExecutor$Worker.run(ThreadPoolExecutor.java:617)
>                 at java.lang.Thread.run(Thread.java:745)
> Caused by: java.net.UnknownHostException: e5611ffad72e
>                 at org.apache.hadoop.hbase.ipc.Ab
> stractRpcClient$BlockingRpcChannelImplementation.<init>(
> AbstractRpcClient.java:315)
>                 at org.apache.hadoop.hbase.ipc.Ab
> stractRpcClient.createBlockingRpcChannel(AbstractRpcClient.java:267)
>                 at org.apache.hadoop.hbase.client
> .ConnectionManager$HConnectionImplementation.getClient(
> ConnectionManager.java:1639)
>                 at org.apache.hadoop.hbase.client.ScannerCallable.prepare(
> ScannerCallable.java:162)
>                 at org.apache.hadoop.hbase.client
> .ScannerCallableWithReplicas$RetryingRPC.prepare(ScannerCall
> ableWithReplicas.java:376)
>                 at org.apache.hadoop.hbase.client
> .RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:134)
>                 ... 4 more
> Thanks again for your help,
> Oliver
>
> -----Original Message-----
> From: Oliver Buckley-Salmon [mailto:oliver.buckley-salmon+external@db.com]
> Sent: 07 November 2016 15:47
> To: user@hbase.apache.org
> Subject: RE: Can connect to HBase via Java API but can't create table
>
> Hi,
> Here's the log on Debug
> 2016-11-07 15:32:01 INFO  InstrumentLoader:61 - Trying to connect to HBase
> 2016-11-07 15:32:01 DEBUG Groups:238 -  Creating new Groups object
> 2016-11-07 15:32:01 DEBUG NativeCodeLoader:46 - Trying to load the
> custom-built native-hadoop library...
> 2016-11-07 15:32:01 DEBUG NativeCodeLoader:55 - Failed to load
> native-hadoop with error: java.lang.UnsatisfiedLinkError: no hadoop in
> java.library.path
> 2016-11-07 15:32:01 DEBUG NativeCodeLoader:56 -
> java.library.path=/Users/oliverbuckley-salmon/Library/Java/
> Extensions:/Library/Java/Extensions:/Network/Library/Java/
> Extensions:/System/Library/Java/Extensions:/usr/lib/java:.
> 2016-11-07 15:32:01 WARN  NativeCodeLoader:62 - Unable to load
> native-hadoop library for your platform... using builtin-java classes where
> applicable
> 2016-11-07 15:32:01 DEBUG JniBasedUnixGroupsMappingWithFallback:40 -
> Falling back to shell based
> 2016-11-07 15:32:01 DEBUG JniBasedUnixGroupsMappingWithFallback:44 -
> Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping
> 2016-11-07 15:32:01 DEBUG Shell:320 - Failed to detect a valid hadoop home
> directory
> java.io.IOException: HADOOP_HOME or hadoop.home.dir are not set.
>                 at org.apache.hadoop.util.Shell.c
> heckHadoopHome(Shell.java:302)
>                 at org.apache.hadoop.util.Shell.<clinit>(Shell.java:327)
>                 at org.apache.hadoop.util.StringU
> tils.<clinit>(StringUtils.java:78)
>                 at org.apache.hadoop.security.Gro
> ups.parseStaticMapping(Groups.java:93)
>                 at org.apache.hadoop.security.Gro
> ups.<init>(Groups.java:77)
>                 at org.apache.hadoop.security.Gro
> ups.getUserToGroupsMappingService(Groups.java:240)
>                 at org.apache.hadoop.security.Gro
> ups.getUserToGroupsMappingService(Groups.java:225)
>                 at org.apache.hadoop.hbase.security.UserProvider.<clinit>(
> UserProvider.java:56)
>                 at org.apache.hadoop.hbase.client
> .ConnectionFactory.createConnection(ConnectionFactory.java:214)
>                 at org.apache.hadoop.hbase.client
> .ConnectionFactory.createConnection(ConnectionFactory.java:119)
>                 at com.example.projects.database.
> loaders.InstrumentLoader.main(InstrumentLoader.java:62)
>                 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> Method)
>                 at sun.reflect.NativeMethodAccess
> orImpl.invoke(NativeMethodAccessorImpl.java:62)
>                 at sun.reflect.DelegatingMethodAc
> cessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>                 at java.lang.reflect.Method.invoke(Method.java:497)
>                 at com.intellij.rt.execution.appl
> ication.AppMain.main(AppMain.java:147)
> 2016-11-07 15:32:01 DEBUG Shell:392 - setsid is not available on this
> machine. So not using it.
> 2016-11-07 15:32:01 DEBUG Shell:396 - setsid exited with exit code 0
> 2016-11-07 15:32:01 DEBUG Groups:80 - Group mapping
> impl=org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback;
> cacheTimeout=300000; warningDeltaMs=5000
> 2016-11-07 15:32:02 DEBUG MutableMetricsFactory:42 - field
> org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.Use
> rGroupInformation$UgiMetrics.loginSuccess with annotation @
> org.apache.hadoop.metrics2.annotation.Metric(always=false, about=,
> sampleName=Ops, type=DEFAULT, value=[Rate of successful kerberos logins and
> latency (milliseconds)], valueName=Time)
> 2016-11-07 15:32:02 DEBUG MutableMetricsFactory:42 - field
> org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.Use
> rGroupInformation$UgiMetrics.loginFailure with annotation @
> org.apache.hadoop.metrics2.annotation.Metric(always=false, about=,
> sampleName=Ops, type=DEFAULT, value=[Rate of failed kerberos logins and
> latency (milliseconds)], valueName=Time)
> 2016-11-07 15:32:02 DEBUG MutableMetricsFactory:42 - field
> org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.Use
> rGroupInformation$UgiMetrics.getGroups with annotation @
> org.apache.hadoop.metrics2.annotation.Metric(always=false, about=,
> sampleName=Ops, type=DEFAULT, value=[GetGroups], valueName=Time)
> 2016-11-07 15:32:02 DEBUG MetricsSystemImpl:221 - UgiMetrics, User and
> group related metrics
> 2016-11-07 15:32:02 DEBUG KerberosName:88 - Kerberos krb5 configuration
> not found, setting default realm to empty
> 2016-11-07 15:32:02 DEBUG UserGroupInformation:195 - hadoop login
> 2016-11-07 15:32:02 DEBUG UserGroupInformation:144 - hadoop login commit
> 2016-11-07 15:32:02 DEBUG UserGroupInformation:174 - using local
> user:UnixPrincipal: oliverbuckley-salmon
> 2016-11-07 15:32:02 DEBUG UserGroupInformation:785 - UGI
> loginUser:oliverbuckley-salmon (auth:SIMPLE)
> 2016-11-07 15:32:02 INFO  RecoverableZooKeeper:120 - Process
> identifier=hconnection-0x43d7741f connecting to ZooKeeper ensemble=
> 138.68.147.208:2181
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:host.name
> =172.20.10.3
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> environment:java.version=1.8.0_45
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> environment:java.vendor=Oracle Corporation
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> environment:java.home=/Library/Java/JavaVirtualMachines/
> jdk1.8.0_45.jdk/Contents/Home/jre
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> environment:java.class.path=/Library/Java/JavaVirtualMachine
> s/jdk1.8.0_45.jdk/Contents/Home/jre/lib/charsets.jar:/
> Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/
> Home/jre/lib/deploy.jar:/Library/Java/JavaVirtualMachin
> es/jdk1.8.0_45.jdk/Contents/Home/jre/lib/ext/cldrdata.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> ext/dnsns.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> 45.jdk/Contents/Home/jre/lib/ext/jfxrt.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> ext/localedata.jar:/Library/Java/JavaVirtualMachines/jdk1.
> 8.0_45.jdk/Contents/Home/jre/lib/ext/nashorn.jar:/Library/
> Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/
> lib/ext/sunec.jar:/Library/Java/JavaVirtualMachines/jdk1.
> 8.0_45.jdk/Contents/Home/jre/lib/ext/sunjce_provider.jar:/L
> ibrary/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/
> Home/jre/lib/ext/sunpkcs11.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> 45.jdk/Contents/Home/jre/lib/ext/zipfs.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> javaws.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.
> jdk/Contents/Home/jre/lib/jce.jar:/Library/Java/JavaVirtualM
> achines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/jfr.jar:
> /Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/
> Home/jre/lib/jfxswt.jar:/Library/Java/JavaVirtualMachin
> es/jdk1.8.0_45.jdk/Contents/Home/jre/lib/jsse.jar:/
> Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/
> Home/jre/lib/management-agent.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> plugin.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.
> jdk/Contents/Home/jre/lib/resources.jar:/Library/Java/JavaVi
> rtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/rt.jar:/
> Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/
> Home/lib/ant-javafx.jar:/Library/Java/JavaVirtualMachin
> es/jdk1.8.0_45.jdk/Contents/Home/lib/dt.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/javafx
> -mx.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/
> Contents/Home/lib/jconsole.jar:/Library/Java/JavaVirtualM
> achines/jdk1.8.0_45.jdk/Contents/Home/lib/packager.
> jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/
> Contents/Home/lib/sa-jdi.jar:/Library/Java/JavaVirtualMachin
> es/jdk1.8.0_45.jdk/Contents/Home/lib/tools.jar:/Users/oliv
> erbuckley-salmon/IdeaProjects/sandpit/database/target/
> classes:/Users/oliverbuckley-salmon/IdeaProjects/sandpit/
> domain/target/classes:/Users/oliverbuckley-salmon/.m2/reposi
> tory/com/google/code/gson/gson/2.6.2/gson-2.6.2.jar:/
> Users/oliverbuckley-salmon/.m2/repository/org/apache/
> hbase/hbase-client/1.2.3/hbase-client-1.2.3.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/apache/hbase/
> hbase-annotations/1.2.3/hbase-annotations-1.2.3.jar:/Users/
> oliverbuckley-salmon/.m2/repository/com/github/stephenc
> /findbugs/findbugs-annotations/1.3.9-1/findbugs-annotations-
> 1.3.9-1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/hbase/
> hbase-common/1.2.3/hbase-common-1.2.3.jar:/Users/oliver
> buckley-salmon/.m2/repository/commons-collections/commons-co
> llections/3.2.2/commons-collections-3.2.2.jar:/Users/oliverb
> uckley-salmon/.m2/repository/org/mortbay/jetty/jetty-util/
> 6.1.26/jetty-util-6.1.26.jar:/Users/oliverbuckley-salmon/.
> m2/repository/org/apache/hbase/hbase-protocol/1.2.3/
> hbase-protocol-1.2.3.jar:/Users/oliverbuckley-salmon/.
> m2/repository/commons-codec/commons-codec/1.9/commons-codec-
> 1.9.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-
> io/commons-io/2.4/commons-io-2.4.jar:/Users/oliverbuckley-
> salmon/.m2/repository/commons-lang/commons-lang/2.6/commons-
> lang-2.6.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-logging/
> commons-logging/1.2/commons-logging-1.2.jar:/Users/
> oliverbuckley-salmon/.m2/repository/com/google/guava/
> guava/12.0.1/guava-12.0.1.jar:/Users/oliverbuckley-salmon/.
> m2/repository/com/google/protobuf/protobuf-java/2.5.0/
> protobuf-java-2.5.0.jar:/Users/oliverbuckley-salmon/.m2
> /repository/io/netty/netty-all/4.0.23.Final/netty-all-4.0.
> 23.Final.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> apache/zookeeper/zookeeper/3.4.6/zookeeper-3.4.6.jar:/
> Users/oliverbuckley-salmon/.m2/repository/org/slf4j/slf4j-
> api/1.6.1/slf4j-api-1.6.1.jar:/Users/oliverbuckley-salmon/.m
> 2/repository/org/slf4j/slf4j-log4j12/1.6.1/slf4j-log4j12-1.6
> .1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache
> /htrace/htrace-core/3.1.0-incubating/htrace-core-3.1.0-
> incubating.jar:/Users/oliverbuckley-salmon/.m2/repository/
> org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-
> mapper-asl-1.9.13.jar:/Users/oliverbuckley-salmon/.m2/
> repository/org/codehaus/jackson/jackson-core-asl/1.9.
> 13/jackson-core-asl-1.9.13.jar:/Users/oliverbuckley-salmo
> n/.m2/repository/org/jruby/jcodings/jcodings/1.0.8/jcodin
> gs-1.0.8.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> jruby/joni/joni/2.1.2/joni-2.1.2.jar:/Users/oliverbuckley-
> salmon/.m2/repository/com/yammer/metrics/metrics-core/2.
> 2.0/metrics-core-2.2.0.jar:/Users/oliverbuckley-salmon/.
> m2/repository/org/apache/hadoop/hadoop-auth/2.5.1/
> hadoop-auth-2.5.1.jar:/Users/oliverbuckley-salmon/.m2/reposi
> tory/org/apache/httpcomponents/httpclient/4.2.5/httpclient-
> 4.2.5.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> apache/httpcomponents/httpcore/4.2.4/httpcore-4.2.4.
> jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> apache/directory/server/apacheds-kerberos-codec/2.0.0-
> M15/apacheds-kerberos-codec-2.0.0-M15.jar:/Users/oliverbuckley-salmon/.m2/
> repository/org/apache/directory/server/apacheds-
> i18n/2.0.0-M15/apacheds-i18n-2.0.0-M15.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/apache/director
> y/api/api-asn1-api/1.0.0-M20/api-asn1-api-1.0.0-M20.jar:/
> Users/oliverbuckley-salmon/.m2/repository/org/apache/
> directory/api/api-util/1.0.0-M20/api-util-1.0.0-M20.jar:/
> Users/oliverbuckley-salmon/.m2/repository/org/apache/
> hadoop/hadoop-common/2.5.1/hadoop-common-2.5.1.jar:/Users
> /oliverbuckley-salmon/.m2/repository/org/apache/hadoop/
> hadoop-annotations/2.5.1/hadoop-annotations-2.5.1.jar:/
> Users/oliverbuckley-salmon/.m2/repository/commons-cli/
> commons-cli/1.2/commons-cli-1.2.jar:/Users/oliverbuckley-
> salmon/.m2/repository/org/apache/commons/commons-math3/
> 3.1.1/commons-math3-3.1.1.jar:/Users/oliverbuckley-salmon/.
> m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/Users/oliv
> erbuckley-salmon/.m2/repository/commons-httpclient/commons-
> httpclient/3.1/commons-httpclient-3.1.jar:/Users/oliverbuckley-salmon/.m2/
> repository/commons-net/commons-net/3.1/commons-net-3.1.jar:/
> Users/oliverbuckley-salmon/.m2/repository/commons-el/
> commons-el/1.0/commons-el-1.0.jar:/Users/oliverbuckley-salmo
> n/.m2/repository/commons-configuration/commons-configuration
> /1.6/commons-configuration-1.6.jar:/Users/oliverbuckley-
> salmon/.m2/repository/commons-digester/commons-digester/1.8/
> commons-digester-1.8.jar:/Users/oliverbuckley-salmon/.
> m2/repository/commons-beanutils/commons-beanutils/1.
> 7.0/commons-beanutils-1.7.0.jar:/Users/oliverbuckley-
> salmon/.m2/repository/commons-beanutils/commons-beanutils-co
> re/1.8.0/commons-beanutils-core-1.8.0.jar:/Users/oliverbuckl
> ey-salmon/.m2/repository/org/apache/avro/avro/1.7.4/avro-1.
> 7.4.jar:/Users/oliverbuckley-salmon/.m2/repository/com/thou
> ghtworks/paranamer/paranamer/2.3/paranamer-2.3.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/xerial/snappy/snappy-java/
> 1.0.4.1/snappy-java-1.0.4.1.jar:/Users/oliverbuckley-salmon/.m2/
> repository/com/jcraft/jsch/0.1.42/jsch-0.1.42.jar:/Users/ol
> iverbuckley-salmon/.m2/repository/com/google/code/findbugs/
> jsr305/1.3.9/jsr305-1.3.9.jar:/Users/oliverbuckley-salmon/.
> m2/repository/org/apache/commons/commons-compress/1.4.
> 1/commons-compress-1.4.1.jar:/Users/oliverbuckley-salmon/.m2
> /repository/org/tukaani/xz/1.0/xz-1.0.jar:/Users/oliverbuck
> ley-salmon/.m2/repository/org/apache/hadoop/hadoop-
> mapreduce-client-core/2.5.1/hadoop-mapreduce-client-core-
> 2.5.1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> apache/hadoop/hadoop-yarn-common/2.5.1/hadoop-yarn-
> common-2.5.1.jar:/Users/oliverbuckley-salmon/.m2/
> repository/org/apache/hadoop/hadoop-yarn-api/2.5.1/hadoop-
> yarn-api-2.5.1.jar:/Users/oliverbuckley-salmon/.m2/
> repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar:
> /Users/oliverbuckley-salmon/.m2/repository/javax/xml/
> stream/stax-api/1.0-2/stax-api-1.0-2.jar:/Users/oliverbuc
> kley-salmon/.m2/repository/javax/activation/activation/1.
> 1/activation-1.1.jar:/Users/oliverbuckley-salmon/.m2/
> repository/io/netty/netty/3.6.2.Final/netty-3.6.2.Final.jar:
> /Users/oliverbuckley-salmon/.m2/repository/log4j/log4j/1.2.
> 17/log4j-1.2.17.jar:/Users/oliverbuckley-salmon/.m2/reposito
> ry/com/hazelcast/hazelcast-all/3.7.2/hazelcast-all-3.7.2.
> jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/curator/curator-
> framework/2.10.0/curator-framework-2.10.0.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/apache/curator/
> curator-client/2.10.0/curator-client-2.10.0.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/apache/curator/
> curator-x-discovery/2.10.0/curator-x-discovery-2.10.0.
> jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/
> curator/curator-recipes/2.10.0/curator-recipes-2.10.0.jar:/
> Users/oliverbuckley-salmon/.m2/repository/org/apache/
> curator/curator-test/2.10.0/curator-test-2.10.0.jar:/
> Users/oliverbuckley-salmon/.m2/repository/org/javassist/ja
> vassist/3.18.1-GA/javassist-3.18.1-GA.jar:/Users/oliverbuckl
> ey-salmon/.m2/repository/org/apache/commons/commons-math/2.
> 2/commons-math-2.2.jar:/Users/oliverbuckley-salmon/.m2/
> repository/com/hazelcast/hazelcast-zookeeper/3.6.1/
> hazelcast-zookeeper-3.6.1.jar:/Users/oliverbuckley-salmon/.
> m2/repository/joda-time/joda-time/2.9.4/joda-time-2.9.4.
> jar:/Applications/IntelliJ IDEA.app/Contents/lib/idea_rt.jar
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> environment:java.library.path=/Users/oliverbuckley-salmon/Li
> brary/Java/Extensions:/Library/Java/Extensions:/Network/
> Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java:.
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> environment:java.io.tmpdir=/var/folders/sx/g9vbcw9d3j54gtj89
> n57g1fw0000gn/T/
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> environment:java.compiler=<NA>
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:os.name=Mac
> OS X
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:os.arch=x86_64
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> environment:os.version=10.11.6
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:user.name
> =oliverbuckley-salmon
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> environment:user.home=/Users/oliverbuckley-salmon
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> environment:user.dir=/Users/oliverbuckley-salmon/IdeaProjects/sandpit
> 2016-11-07 15:32:02 INFO  ZooKeeper:438 - Initiating client connection,
> connectString=138.68.147.208:2181 sessionTimeout=90000
> watcher=hconnection-0x43d7741f0x0, quorum=138.68.147.208:2181,
> baseZNode=/hbase
> 2016-11-07 15:32:02 DEBUG ClientCnxn:102 - zookeeper.disableAutoWatchReset
> is false
> 2016-11-07 15:32:02 INFO  ClientCnxn:975 - Opening socket connection to
> server 138.68.147.208/138.68.147.208:2181. Will not attempt to
> authenticate using SASL (unknown error)
> 2016-11-07 15:32:02 INFO  ClientCnxn:852 - Socket connection established
> to 138.68.147.208/138.68.147.208:2181, initiating session
> 2016-11-07 15:32:02 DEBUG ClientCnxn:892 - Session establishment request
> sent on 138.68.147.208/138.68.147.208:2181
> 2016-11-07 <http://138.68.147.208/138.68.147.208:21812016-11-07> 15:32:03
> INFO  ClientCnxn:1235 - Session establishment complete on server
> 138.68.147.208/138.68.147.208:2181, sessionid = 0x1583b2a4dbb000b,
> negotiated timeout = 90000
> 2016-11-07 15:32:03 DEBUG ZooKeeperWatcher:602 -
> hconnection-0x43d7741f0x0, quorum=138.68.147.208:2181, baseZNode=/hbase
> Received ZooKeeper Event, type=None, state=SyncConnected, path=null
> 2016-11-07 15:32:03 DEBUG ZooKeeperWatcher:686 -
> hconnection-0x43d7741f-0x1583b2a4dbb000b connected
> 2016-11-07 15:32:03 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 1,3  replyHeader:: 1,182,0  request::
> '/hbase/hbaseid,F  response:: s{17,132,1478127149340,1478461
> 382903,1,0,0,0,67,0,17}
> 2016-11-07 15:32:03 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 2,4  replyHeader:: 2,182,0  request::
> '/hbase/hbaseid,F  response:: #ffffffff000146d61737465723a36
> 3030303040ffffffd533ffffffc7ffffffa430fffffffafffffff5504255
> 46a2439353634626535382d616531632d343734352d393638352d3465643
> 43830343638636232,s{17,132,1478127149340,1478461382903,1,0,0,0,67,0,17}
> 2016-11-07 15:32:03 DEBUG AbstractRpcClient:116 -
> Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f3f4916,
> compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000,
> readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0,
> fallbackAllowed=false, bind address=null
> 2016-11-07 15:32:03 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 3,4  replyHeader:: 3,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:32:03 INFO  InstrumentLoader:64 - Master Info Port: 60010
> 2016-11-07 15:32:03 INFO  InstrumentLoader:65 - Connected to HBase
> 2016-11-07 15:32:03 INFO  InstrumentLoader:67 - Trying to create tables
> Creating table. 2016-11-07 15:32:03 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 4,3  replyHeader:: 4,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:32:03 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 5,4  replyHeader:: 5,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:32:04 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 6,3  replyHeader:: 6,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:32:04 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 7,4  replyHeader:: 7,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:32:04 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 8,3  replyHeader:: 8,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:32:04 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 9,4  replyHeader:: 9,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:32:05 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 10,3  replyHeader:: 10,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:32:05 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 11,4  replyHeader:: 11,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:32:05 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 12,3  replyHeader:: 12,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:32:05 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 13,4  replyHeader:: 13,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:32:06 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 14,3  replyHeader:: 14,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:32:06 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 15,4  replyHeader:: 15,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:32:09 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 16,3  replyHeader:: 16,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:32:09 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 17,4  replyHeader:: 17,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:32:13 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 18,3  replyHeader:: 18,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:32:13 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 19,4  replyHeader:: 19,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:32:23 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 20,3  replyHeader:: 20,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:32:23 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 280ms
> 2016-11-07 15:32:23 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 21,4  replyHeader:: 21,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:32:33 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 22,3  replyHeader:: 22,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:32:33 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 254ms
> 2016-11-07 15:32:33 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 23,4  replyHeader:: 23,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:32:44 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 24,3  replyHeader:: 24,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:32:44 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 261ms
> 2016-11-07 15:32:44 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 25,4  replyHeader:: 25,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:32:44 INFO  RpcRetryingCaller:142 - Call exception,
> tries=10, retries=35, started=40432 ms ago, cancelled=false, msg=
> 2016-11-07 15:32:54 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 26,3  replyHeader:: 26,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:32:54 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 121ms
> 2016-11-07 15:32:54 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 27,4  replyHeader:: 27,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:32:54 INFO  RpcRetryingCaller:142 - Call exception,
> tries=11, retries=35, started=50639 ms ago, cancelled=false, msg=
> 2016-11-07 15:33:14 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 28,3  replyHeader:: 28,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:33:14 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 82ms
> 2016-11-07 15:33:14 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 29,4  replyHeader:: 29,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:33:14 INFO  RpcRetryingCaller:142 - Call exception,
> tries=12, retries=35, started=70917 ms ago, cancelled=false, msg=
> 2016-11-07 15:33:34 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 30,3  replyHeader:: 30,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:33:34 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 100ms
> 2016-11-07 15:33:35 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 31,4  replyHeader:: 31,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:33:35 INFO  RpcRetryingCaller:142 - Call exception,
> tries=13, retries=35, started=91231 ms ago, cancelled=false, msg=
> 2016-11-07 15:33:55 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 32,3  replyHeader:: 32,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:33:55 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 49ms
> 2016-11-07 15:33:55 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 33,4  replyHeader:: 33,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:33:55 INFO  RpcRetryingCaller:142 - Call exception,
> tries=14, retries=35, started=111511 ms ago, cancelled=false, msg=
> 2016-11-07 15:34:15 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 34,3  replyHeader:: 34,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:34:15 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 62ms
> 2016-11-07 15:34:15 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 35,4  replyHeader:: 35,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:34:15 INFO  RpcRetryingCaller:142 - Call exception,
> tries=15, retries=35, started=131746 ms ago, cancelled=false, msg=
> 2016-11-07 15:34:35 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 36,3  replyHeader:: 36,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:34:35 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 96ms
> 2016-11-07 15:34:35 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 37,4  replyHeader:: 37,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:34:35 INFO  RpcRetryingCaller:142 - Call exception,
> tries=16, retries=35, started=152094 ms ago, cancelled=false, msg=
> 2016-11-07 15:34:56 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 38,3  replyHeader:: 38,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:34:56 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 77ms
> 2016-11-07 15:34:56 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 39,4  replyHeader:: 39,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:34:56 INFO  RpcRetryingCaller:142 - Call exception,
> tries=17, retries=35, started=172334 ms ago, cancelled=false, msg=
> 2016-11-07 15:35:16 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 40,3  replyHeader:: 40,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:35:16 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 177ms
> 2016-11-07 15:35:16 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 41,4  replyHeader:: 41,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:35:16 INFO  RpcRetryingCaller:142 - Call exception,
> tries=18, retries=35, started=192647 ms ago, cancelled=false, msg=
> 2016-11-07 15:35:36 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 42,3  replyHeader:: 42,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:35:36 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 45ms
> 2016-11-07 15:35:36 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 43,4  replyHeader:: 43,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:35:36 INFO  RpcRetryingCaller:142 - Call exception,
> tries=19, retries=35, started=212887 ms ago, cancelled=false, msg=
> 2016-11-07 15:35:56 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 44,3  replyHeader:: 44,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:35:56 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 187ms
> 2016-11-07 15:35:56 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 45,4  replyHeader:: 45,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:35:56 INFO  RpcRetryingCaller:142 - Call exception,
> tries=20, retries=35, started=233201 ms ago, cancelled=false, msg=
> 2016-11-07 15:36:17 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 46,3  replyHeader:: 46,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:36:17 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 115ms
> 2016-11-07 15:36:17 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 47,4  replyHeader:: 47,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:36:17 INFO  RpcRetryingCaller:142 - Call exception,
> tries=21, retries=35, started=253524 ms ago, cancelled=false, msg=
> 2016-11-07 15:36:37 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 48,3  replyHeader:: 48,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:36:37 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 121ms
> 2016-11-07 15:36:37 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 49,4  replyHeader:: 49,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:36:37 INFO  RpcRetryingCaller:142 - Call exception,
> tries=22, retries=35, started=273868 ms ago, cancelled=false, msg=
> 2016-11-07 15:36:57 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 50,3  replyHeader:: 50,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:36:57 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 67ms
> 2016-11-07 15:36:57 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 51,4  replyHeader:: 51,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:36:57 INFO  RpcRetryingCaller:142 - Call exception,
> tries=23, retries=35, started=294029 ms ago, cancelled=false, msg=
> 2016-11-07 15:37:18 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 52,3  replyHeader:: 52,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:37:18 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 43ms
> 2016-11-07 15:37:18 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 53,4  replyHeader:: 53,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:37:18 INFO  RpcRetryingCaller:142 - Call exception,
> tries=24, retries=35, started=314332 ms ago, cancelled=false, msg=
> 2016-11-07 15:37:38 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 54,3  replyHeader:: 54,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:37:38 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 79ms
> 2016-11-07 15:37:38 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 55,4  replyHeader:: 55,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:37:38 INFO  RpcRetryingCaller:142 - Call exception,
> tries=25, retries=35, started=334581 ms ago, cancelled=false, msg=
> 2016-11-07 15:37:58 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 56,3  replyHeader:: 56,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:37:58 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 118ms
> 2016-11-07 15:37:58 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 57,4  replyHeader:: 57,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:37:58 INFO  RpcRetryingCaller:142 - Call exception,
> tries=26, retries=35, started=354793 ms ago, cancelled=false, msg=
> 2016-11-07 15:38:18 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 58,3  replyHeader:: 58,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:38:18 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 180ms
> 2016-11-07 15:38:18 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 59,4  replyHeader:: 59,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:38:18 INFO  RpcRetryingCaller:142 - Call exception,
> tries=27, retries=35, started=375092 ms ago, cancelled=false, msg=
> 2016-11-07 15:38:39 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 60,3  replyHeader:: 60,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:38:39 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 64ms
> 2016-11-07 15:38:39 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 61,4  replyHeader:: 61,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:38:39 INFO  RpcRetryingCaller:142 - Call exception,
> tries=28, retries=35, started=395321 ms ago, cancelled=false, msg=
> 2016-11-07 15:38:59 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 62,3  replyHeader:: 62,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:38:59 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 63ms
> 2016-11-07 15:38:59 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 63,4  replyHeader:: 63,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:38:59 INFO  RpcRetryingCaller:142 - Call exception,
> tries=29, retries=35, started=415488 ms ago, cancelled=false, msg=
> 2016-11-07 15:39:19 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 64,3  replyHeader:: 64,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:39:19 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 164ms
> 2016-11-07 15:39:19 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 65,4  replyHeader:: 65,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:39:19 INFO  RpcRetryingCaller:142 - Call exception,
> tries=30, retries=35, started=435727 ms ago, cancelled=false, msg=
> 2016-11-07 15:39:39 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 66,3  replyHeader:: 66,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:39:39 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 63ms
> 2016-11-07 15:39:40 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 67,4  replyHeader:: 67,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:39:40 INFO  RpcRetryingCaller:142 - Call exception,
> tries=31, retries=35, started=456258 ms ago, cancelled=false, msg=
> 2016-11-07 15:40:00 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 68,3  replyHeader:: 68,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:40:00 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 186ms
> 2016-11-07 15:40:00 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 69,4  replyHeader:: 69,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:40:00 INFO  RpcRetryingCaller:142 - Call exception,
> tries=32, retries=35, started=476964 ms ago, cancelled=false, msg=
> 2016-11-07 15:40:20 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 70,3  replyHeader:: 70,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:40:20 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 38ms
> 2016-11-07 15:40:21 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 71,4  replyHeader:: 71,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:40:21 INFO  RpcRetryingCaller:142 - Call exception,
> tries=33, retries=35, started=497229 ms ago, cancelled=false, msg=
> 2016-11-07 15:40:41 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 72,3  replyHeader:: 72,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:40:41 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 51ms
> 2016-11-07 15:40:41 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 73,4  replyHeader:: 73,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:40:41 INFO  RpcRetryingCaller:142 - Call exception,
> tries=34, retries=35, started=517438 ms ago, cancelled=false, msg=
> 2016-11-07 15:40:41 ERROR InstrumentLoader:114 - Error connecting to HBase
> Serverorg.apache.hadoop.hbase.client.RetriesExhaustedException: Failed
> after attempts=35, exceptions:
> Mon Nov 07 15:32:04 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:32:04 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:32:04 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:32:05 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:32:05 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:32:06 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:32:09 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:32:13 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:32:23 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:32:33 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:32:44 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:32:54 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:33:14 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:33:35 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:33:55 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:34:15 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:34:35 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:34:56 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:35:16 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:35:36 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:35:56 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:36:17 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:36:37 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:36:57 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:37:18 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:37:38 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:37:58 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:38:18 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:38:39 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:38:59 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:39:19 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:39:40 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:40:00 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:40:21 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:40:41 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
>
>
> Process finished with exit code 0
>
> The container is contactable as Zookeeper is running in the same container.
> Thanks very much for your help.
> Oliver
>
> -----Original Message-----
> From: Ted Yu [mailto:yuzhihong@gmail.com]
> Sent: 07 November 2016 15:05
> To: user@hbase.apache.org
> Subject: Re: Can connect to HBase via Java API but can't create table
>
> Can you show more of the UnknownHostException ?
>
> Could this be related to the firewall on the Docker container ?
>
> Cheers
>
> On Mon, Nov 7, 2016 at 6:49 AM, Oliver Buckley-Salmon <
> oliver.buckley-salmon@db.com> wrote:
>
> > Hi
> >
> > I am trying to create a table in HBase using the Java API, I can
> > connect to Zookeeper
> >
> > 2016-11-06 15:18:36 INFO  RecoverableZooKeeper:120 - Process
> > identifier=hconnection-0x382db087 connecting to ZooKeeper ensemble=
> > 138.68.147.208:2181
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09
> > GMT
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client environment:host.name
> > =olivers-air.default
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:java.version=1.8.0_45
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:java.vendor=Oracle Corporation
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:java.home=/
> > Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:java.class.path=/Library/Java/JavaVirtualMachines/jdk1.8.0
> > _ 45.jdk/Contents/Home/jre/lib/charsets.jar:/Library/Java/
> > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> > deploy.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > 45.jdk/Contents/Home/jre/lib/ext/cldrdata.jar:/Library/
> > Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/
> > lib/ext/dnsns.jar:/Library/Java/JavaVirtualMachines/jdk1.
> > 8.0_45.jdk/Contents/Home/jre/lib/ext/jfxrt.jar:/Library/
> > Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/
> > lib/ext/localedata.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > 45.jdk/Contents/Home/jre/lib/ext/nashorn.jar:/Library/Java/
> > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> > ext/sunec.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > 45.jdk/Contents/Home/jre/lib/ext/sunjce_provider.jar:/Library/Java/
> > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> > ext/sunpkcs11.jar:/Library/Java/JavaVirtualMachines/jdk1.
> > 8.0_45.jdk/Contents/Home/jre/lib/ext/zipfs.jar:/Library/
> > Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/
> > lib/javaws.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > 45.jdk/Contents/Home/jre/lib/jce.jar:/Library/Java/
> > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> > jfr.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > 45.jdk/Contents/Home/jre/lib/jfxswt.jar:/Library/Java/
> > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> > jsse.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > 45.jdk/Contents/Home/jre/lib/management-agent.jar:/Library/
> > Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/
> > lib/plugin.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > 45.jdk/Contents/Home/jre/lib/resources.jar:/Library/Java/
> > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> > rt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > 45.jdk/Contents/Home/lib/ant-javafx.jar:/Library/Java/
> > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/dt.
> > jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/li
> > b/ javafx-mx.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > 45.jdk/Contents/Home/lib/jconsole.jar:/Library/Java/
> > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/
> > packager.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > 45.jdk/Contents/Home/lib/sa-jdi.jar:/Library/Java/
> > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/tools.jar:/Users
> > /
> > oliverbuckley-salmon/IdeaProjects/sandpit/database/target/classes:/Use
> > rs/
> > oliverbuckley-salmon/IdeaProjects/sandpit/domain/target/classes:/Users
> > / oliverbuckley-salmon/.m2/repository/com/google/code/
> > gson/gson/2.6.2/gson-2.6.2.jar:/Users/oliverbuckley-
> > salmon/.m2/repository/org/apache/hbase/hbase-client/1.2.
> > 3/hbase-client-1.2.3.jar:/Users/oliverbuckley-salmon/.
> > m2/repository/org/apache/hbase/hbase-annotations/1.2.3/
> > hbase-annotations-1.2.3.jar:/Users/oliverbuckley-salmon/.
> > m2/repository/com/github/stephenc/findbugs/findbugs-
> > annotations/1.3.9-1/findbugs-annotations-1.3.9-1.jar:/
> > Users/oliverbuckley-salmon/.m2/repository/org/apache/
> > hbase/hbase-common/1.2.3/hbase-common-1.2.3.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/commons-collections/commons-
> > collections/3.2.2/commons-collections-3.2.2.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/org/mortbay/jetty/
> > jetty-util/6.1.26/jetty-util-6.1.26.jar:/Users/oliverbuckley-salmon/.m
> > 2/
> > repository/org/apache/hbase/hbase-protocol/1.2.3/hbase-
> > protocol-1.2.3.jar:/Users/oliverbuckley-salmon/.m2/
> > repository/commons-codec/commons-codec/1.9/commons-codec-1.9.jar:/User
> > s/
> > oliverbuckley-salmon/.m2/repository/commons-io/commons-
> > io/2.4/commons-io-2.4.jar:/Users/oliverbuckley-salmon/.
> > m2/repository/commons-lang/commons-lang/2.6/commons-lang-
> > 2.6.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-
> > logging/commons-logging/1.2/commons-logging-1.2.jar:/
> > Users/oliverbuckley-salmon/.m2/repository/com/google/
> > guava/guava/12.0.1/guava-12.0.1.jar:/Users/oliverbuckley-
> > salmon/.m2/repository/com/google/protobuf/protobuf-java/
> > 2.5.0/protobuf-java-2.5.0.jar:/Users/oliverbuckley-salmon/.
> > m2/repository/io/netty/netty-all/4.0.23.Final/netty-all-4.
> > 0.23.Final.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/
> > zookeeper/zookeeper/3.4.6/zookeeper-3.4.6.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/org/slf4j/slf4j-
> > api/1.6.1/slf4j-api-1.6.1.jar:/Users/oliverbuckley-salmon/.
> > m2/repository/org/slf4j/slf4j-log4j12/1.6.1/slf4j-log4j12-1.
> > 6.1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> > apache/htrace/htrace-core/3.1.0-incubating/htrace-core-3.1.
> > 0-incubating.jar:/Users/oliverbuckley-salmon/.m2/repository/org/codeha
> > us/ jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.
> > 13.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> > codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.
> > 9.13.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> > jruby/jcodings/jcodings/1.0.8/jcodings-1.0.8.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/org/jruby/joni/
> > joni/2.1.2/joni-2.1.2.jar:/Users/oliverbuckley-salmon/.
> > m2/repository/com/yammer/metrics/metrics-core/2.2.0/
> > metrics-core-2.2.0.jar:/Users/oliverbuckley-salmon/.m2/
> > repository/org/apache/hadoop/hadoop-auth/2.5.1/hadoop-auth-
> > 2.5.1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/
> > httpcomponents/httpclient/4.2.5/httpclient-4.2.5.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/org/apache/
> > httpcomponents/httpcore/4.2.4/httpcore-4.2.4.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/org/apache/directory/server/apache
> > ds-
> > kerberos-codec/2.0.0-M15/apacheds-kerberos-codec-2.0.0-
> > M15.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> > apache/directory/server/apacheds-i18n/2.0.0-M15/
> > apacheds-i18n-2.0.0-M15.jar:/Users/oliverbuckley-salmon/.
> > m2/repository/org/apache/directory/api/api-asn1-api/1.
> > 0.0-M20/api-asn1-api-1.0.0-M20.jar:/Users/oliverbuckley-
> > salmon/.m2/repository/org/apache/directory/api/api-util/
> > 1.0.0-M20/api-util-1.0.0-M20.jar:/Users/oliverbuckley-
> > salmon/.m2/repository/org/apache/hadoop/hadoop-common/2.
> > 5.1/hadoop-common-2.5.1.jar:/Users/oliverbuckley-salmon/.
> > m2/repository/org/apache/hadoop/hadoop-annotations/2.5.
> > 1/hadoop-annotations-2.5.1.jar:/Users/oliverbuckley-
> > salmon/.m2/repository/commons-cli/commons-cli/1.2/commons-
> > cli-1.2.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/comm
> > ons/ commons-math3/3.1.1/commons-math3-3.1.1.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/xmlenc/xmlenc/0.52/
> > xmlenc-0.52.jar:/Users/oliverbuckley-salmon/.m2/
> > repository/commons-httpclient/commons-httpclient/3.1/
> > commons-httpclient-3.1.jar:/Users/oliverbuckley-salmon/.
> > m2/repository/commons-net/commons-net/3.1/commons-net-3.
> > 1.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-
> > el/commons-el/1.0/commons-el-1.0.jar:/Users/oliverbuckley-
> > salmon/.m2/repository/commons-configuration/commons-
> > configuration/1.6/commons-configuration-1.6.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/commons-digester/
> > commons-digester/1.8/commons-digester-1.8.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/commons-beanutils/
> > commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar:/
> > Users/oliverbuckley-salmon/.m2/repository/commons-
> > beanutils/commons-beanutils-core/1.8.0/commons-beanutils-
> > core-1.8.0.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/a
> > vro/
> > avro/1.7.4/avro-1.7.4.jar:/Users/oliverbuckley-salmon/.m2/repository/c
> > om/ thoughtworks/paranamer/paranamer/2.3/paranamer-2.3.
> > jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> > xerial/snappy/snappy-java/1.0.4.1/snappy-java-1.0.4.1.jar:/
> > Users/oliverbuckley-salmon/.m2/repository/com/jcraft/jsch/
> > 0.1.42/jsch-0.1.42.jar:/Users/oliverbuckley-salmon/.m2/
> > repository/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar:/Use
> > rs/ oliverbuckley-salmon/.m2/repository/org/apache/commons/
> > commons-compress/1.4.1/commons-compress-1.4.1.jar:/
> > Users/oliverbuckley-salmon/.m2/repository/org/tukaani/xz/
> > 1.0/xz-1.0.jar:/Users/oliverbuckley-salmon/.m2/
> > repository/org/apache/hadoop/hadoop-mapreduce-client-core/
> > 2.5.1/hadoop-mapreduce-client-core-2.5.1.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/org/apache/hadoop/
> > hadoop-yarn-common/2.5.1/hadoop-yarn-common-2.5.1.jar:/
> > Users/oliverbuckley-salmon/.m2/repository/org/apache/
> > hadoop/hadoop-yarn-api/2.5.1/hadoop-yarn-api-2.5.1.jar:/
> > Users/oliverbuckley-salmon/.m2/repository/javax/xml/bind/
> > jaxb-api/2.2.2/jaxb-api-2.2.2.jar:/Users/oliverbuckley-
> > salmon/.m2/repository/javax/xml/stream/stax-api/1.0-2/
> > stax-api-1.0-2.jar:/Users/oliverbuckley-salmon/.m2/
> > repository/javax/activation/activation/1.1/activation-1.1.
> > jar:/Users/oliverbuckley-salmon/.m2/repository/io/
> > netty/netty/3.6.2.Final/netty-3.6.2.Final.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/log4j/log4j/1.2.17/
> > log4j-1.2.17.jar:/Users/oliverbuckley-salmon/.m2/repository/com/hazelc
> > ast/ hazelcast-all/3.7.2/hazelcast-all-3.7.2.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/org/apache/curator/
> > curator-framework/2.10.0/curator-framework-2.10.0.jar:/
> > Users/oliverbuckley-salmon/.m2/repository/org/apache/
> > curator/curator-client/2.10.0/curator-client-2.10.0.jar:/
> > Users/oliverbuckley-salmon/.m2/repository/org/apache/
> > curator/curator-x-discovery/2.10.0/curator-x-discovery-2.10.
> > 0.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> > apache/curator/curator-recipes/2.10.0/curator-recipes-2.10.0.jar:/User
> > s/ oliverbuckley-salmon/.m2/repository/org/apache/curator/
> > curator-test/2.10.0/curator-test-2.10.0.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/org/javassist/
> > javassist/3.18.1-GA/javassist-3.18.1-GA.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/org/apache/commons/
> > commons-math/2.2/commons-math-2.2.jar:/Users/oliverbuckley-
> > salmon/.m2/repository/com/hazelcast/hazelcast-zookeeper/
> > 3.6.1/hazelcast-zookeeper-3.6.1.jar:/Users/oliverbuckley-
> > salmon/.m2/repository/joda-time/joda-time/2.9.4/joda-
> > time-2.9.4.jar:/Applications/IntelliJ
> > IDEA.app/Contents/lib/idea_rt.jar
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:java.library.path=/Users/oliverbuckley-salmon/
> > Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java
> > / Extensions:/System/Library/Java/Extensions:/usr/lib/java:.
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:java.io.tmpdir=/var/folders/sx/g9vbcw9d3j54gtj89n57g1fw000
> > 0gn
> > /T/
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:java.compiler=<NA>
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:os.name=Mac OS X
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:os.arch=x86_64
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:os.version=10.11.6
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:user.name= oliverbuckley-salmon
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:user.home=/Users/oliverbuckley-salmon
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:user.dir=/Users/oliverbuckley-salmon/IdeaProjects/sandpit
> > 2016-11-06 15:18:36 INFO  ZooKeeper:438 - Initiating client
> > connection,
> > connectString=138.68.147.208:2181 sessionTimeout=90000
> > watcher=hconnection-0x382db0870x0, quorum=138.68.147.208:2181,
> > baseZNode=/hbase
> > 2016-11-06 15:18:37 INFO  ClientCnxn:975 - Opening socket connection
> > to server 138.68.147.208/138.68.147.208:2181. Will not attempt to
> > authenticate using SASL (unknown error)
> > 2016-11-06 15:18:37 INFO  ClientCnxn:852 - Socket connection
> > established to 138.68.147.208/138.68.147.208:2181, initiating session
> > 2016-11-06 15:18:37 INFO  ClientCnxn:1235 - Session establishment
> > complete on server 138.68.147.208/138.68.147.208:2181, sessionid =
> > 0x158273e5275001d, negotiated timeout = 90000
> >
> > I can connect to HBase as I can see it in the debugger, but when I try
> > to create a table it fails after 35 retries with
> > org.apache.hadoop.hbase.MasterNotRunningException:
> > java.net.UnknownHostException
> >
> > I can connect to HBase with the UI and can see the Master and Region
> > servers.
> >
> > My code looks like this
> > Configuration hBaseConfig =  HBaseConfiguration.create();
> >             hBaseConfig.setInt("timeout", 120000);
> >             hBaseConfig.set("hbase.master", hbaseHost + ":60000");
> >             hBaseConfig.set("hbase.zookeeper.quorum",zookeeperHost);
> >             hBaseConfig.set("hbase.zookeeper.property.clientPort",
> > "2181");
> >
> >             logger.info("Trying to connect to HBase");
> >             Connection connection = ConnectionFactory.
> > createConnection(hBaseConfig);
> >             Admin admin = connection.getAdmin();
> >             logger.info("Connected to HBase");
> >
> >             logger.info("Trying to create tables");
> >             createSchemaTables(admin);
> >             logger.info("Tables created");
> >
> > CreateSchemaTables looks like this and the code fails and retries at
> > admin.createTable(table); public static void createSchemaTables(Admin
> > admin) throws IOException {
> >
> >
> >
> >         HTableDescriptor table = new HTableDescriptor(TableName.
> > valueOf(tableName));
> >         HColumnDescriptor cf = new HColumnDescriptor(columnFamily).
> > setCompressionType(Algorithm.NONE);
> >
> >         table.addFamily(cf);
> >
> >         System.out.print("Creating table. ");
> >         admin.createTable(table);
> >         System.out.println(" Done.");
> >
> > The client is running on my Mac Air and Hbase is running in a Docker
> > container (nerdammer/hbase) Digital Ocean.
> >
> > Does anyone have any idea why I can connect to HBase but not create
> tables?
> >
> > Thanks in advance for your help, Oliver
> >
> >
> >
> >
> > ---
> > This e-mail may contain confidential and/or privileged information. If
> > you are not the intended recipient (or have received this e-mail in
> > error) please notify the sender immediately and delete this e-mail.
> > Any unauthorized copying, disclosure or distribution of the material
> > in this e-mail is strictly forbidden.
> >
> > Please refer to https://www.db.com/disclosures for additional EU
> > corporate and regulatory disclosures and to http://www.db.com/
> > unitedkingdom/content/privacy.htm for information about privacy.
> >
>
>
> ---
> This e-mail may contain confidential and/or privileged information. If you
> are not the intended recipient (or have received this e-mail in error)
> please notify the sender immediately and delete this e-mail. Any
> unauthorized copying, disclosure or distribution of the material in this
> e-mail is strictly forbidden.
>
> Please refer to https://www.db.com/disclosures for additional EU
> corporate and regulatory disclosures and to http://www.db.com/unitedkingdo
> m/content/privacy.htm for information about privacy.
>
>
> ---
> This e-mail may contain confidential and/or privileged information. If you
> are not the intended recipient (or have received this e-mail in error)
> please notify the sender immediately and delete this e-mail. Any
> unauthorized copying, disclosure or distribution of the material in this
> e-mail is strictly forbidden.
>
> Please refer to https://www.db.com/disclosures for additional EU
> corporate and regulatory disclosures and to http://www.db.com/unitedkingdo
> m/content/privacy.htm for information about privacy.
>


---
This e-mail may contain confidential and/or privileged information. If you are not the intended recipient (or have received this e-mail in error) please notify the sender immediately and delete this e-mail. Any unauthorized copying, disclosure or distribution of the material in this e-mail is strictly forbidden.

Please refer to https://www.db.com/disclosures for additional EU corporate and regulatory disclosures and to http://www.db.com/unitedkingdom/content/privacy.htm for information about privacy.

Re: Can connect to HBase via Java API but can't create table

Posted by Stack <st...@duboce.net>.
Please fix unknown host. The hbase client doesn't know how to get to the
server.
St.Ack

On Tue, Nov 8, 2016 at 12:26 AM, Oliver Buckley-Salmon <
oliver.buckley-salmon@db.com> wrote:

> Hi,
> Here's a better exception
>
> Exception in thread "main" org.apache.hadoop.hbase.client.RetriesExhaustedException:
> Failed after attempts=36, exceptions:
> Tue Nov 08 07:06:48 GMT 2016, null, java.net.SocketTimeoutException:
> callTimeout=60000, callDuration=69291: row 'INSTRUMENT,,' on table
> 'hbase:meta' at region=hbase:meta,,1.1588230740,
> hostname=e5611ffad72e,60020,1478588595835, seqNum=0
>
>                 at org.apache.hadoop.hbase.client
> .RpcRetryingCallerWithReadReplicas.throwEnrichedException(Rp
> cRetryingCallerWithReadReplicas.java:276)
>                 at org.apache.hadoop.hbase.client
> .ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:210)
>                 at org.apache.hadoop.hbase.client
> .ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:60)
>                 at org.apache.hadoop.hbase.client
> .RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:210)
>                 at org.apache.hadoop.hbase.client
> .ClientScanner.call(ClientScanner.java:326)
>                 at org.apache.hadoop.hbase.client
> .ClientScanner.nextScanner(ClientScanner.java:301)
>                 at org.apache.hadoop.hbase.client
> .ClientScanner.initializeScannerInConstruction(ClientScanner.java:166)
>                 at org.apache.hadoop.hbase.client
> .ClientScanner.<init>(ClientScanner.java:161)
>                 at org.apache.hadoop.hbase.client
> .HTable.getScanner(HTable.java:797)
>                 at org.apache.hadoop.hbase.MetaTa
> bleAccessor.fullScan(MetaTableAccessor.java:602)
>                 at org.apache.hadoop.hbase.MetaTa
> bleAccessor.tableExists(MetaTableAccessor.java:366)
>                 at org.apache.hadoop.hbase.client
> .HBaseAdmin.tableExists(HBaseAdmin.java:406)
>                 at com.example.projects.database.
> schema.SchemaBuilder.createOrOverwrite(SchemaBuilder.java:31)
>                 at com.example.projects.database.
> schema.SchemaBuilder.createSchemaTables(SchemaBuilder.java:52)
>                 at com.example.projects.database.
> schema.SchemaBuilder.main(SchemaBuilder.java:94)
>                 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> Method)
>                 at sun.reflect.NativeMethodAccess
> orImpl.invoke(NativeMethodAccessorImpl.java:62)
>                 at sun.reflect.DelegatingMethodAc
> cessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>                 at java.lang.reflect.Method.invoke(Method.java:497)
>                 at com.intellij.rt.execution.appl
> ication.AppMain.main(AppMain.java:147)
> Caused by: java.net.SocketTimeoutException: callTimeout=60000,
> callDuration=69291: row 'INSTRUMENT,,' on table 'hbase:meta' at
> region=hbase:meta,,1.1588230740, hostname=e5611ffad72e,60020,1478588595835,
> seqNum=0
>                 at org.apache.hadoop.hbase.client
> .RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:169)
>                 at org.apache.hadoop.hbase.client
> .ResultBoundedCompletionService$QueueingFuture.run(ResultBou
> ndedCompletionService.java:65)
>                 at java.util.concurrent.ThreadPoo
> lExecutor.runWorker(ThreadPoolExecutor.java:1142)
>                 at java.util.concurrent.ThreadPoo
> lExecutor$Worker.run(ThreadPoolExecutor.java:617)
>                 at java.lang.Thread.run(Thread.java:745)
> Caused by: java.net.UnknownHostException: e5611ffad72e
>                 at org.apache.hadoop.hbase.ipc.Ab
> stractRpcClient$BlockingRpcChannelImplementation.<init>(
> AbstractRpcClient.java:315)
>                 at org.apache.hadoop.hbase.ipc.Ab
> stractRpcClient.createBlockingRpcChannel(AbstractRpcClient.java:267)
>                 at org.apache.hadoop.hbase.client
> .ConnectionManager$HConnectionImplementation.getClient(
> ConnectionManager.java:1639)
>                 at org.apache.hadoop.hbase.client.ScannerCallable.prepare(
> ScannerCallable.java:162)
>                 at org.apache.hadoop.hbase.client
> .ScannerCallableWithReplicas$RetryingRPC.prepare(ScannerCall
> ableWithReplicas.java:376)
>                 at org.apache.hadoop.hbase.client
> .RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:134)
>                 ... 4 more
> Thanks again for your help,
> Oliver
>
> -----Original Message-----
> From: Oliver Buckley-Salmon [mailto:oliver.buckley-salmon+external@db.com]
> Sent: 07 November 2016 15:47
> To: user@hbase.apache.org
> Subject: RE: Can connect to HBase via Java API but can't create table
>
> Hi,
> Here's the log on Debug
> 2016-11-07 15:32:01 INFO  InstrumentLoader:61 - Trying to connect to HBase
> 2016-11-07 15:32:01 DEBUG Groups:238 -  Creating new Groups object
> 2016-11-07 15:32:01 DEBUG NativeCodeLoader:46 - Trying to load the
> custom-built native-hadoop library...
> 2016-11-07 15:32:01 DEBUG NativeCodeLoader:55 - Failed to load
> native-hadoop with error: java.lang.UnsatisfiedLinkError: no hadoop in
> java.library.path
> 2016-11-07 15:32:01 DEBUG NativeCodeLoader:56 -
> java.library.path=/Users/oliverbuckley-salmon/Library/Java/
> Extensions:/Library/Java/Extensions:/Network/Library/Java/
> Extensions:/System/Library/Java/Extensions:/usr/lib/java:.
> 2016-11-07 15:32:01 WARN  NativeCodeLoader:62 - Unable to load
> native-hadoop library for your platform... using builtin-java classes where
> applicable
> 2016-11-07 15:32:01 DEBUG JniBasedUnixGroupsMappingWithFallback:40 -
> Falling back to shell based
> 2016-11-07 15:32:01 DEBUG JniBasedUnixGroupsMappingWithFallback:44 -
> Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping
> 2016-11-07 15:32:01 DEBUG Shell:320 - Failed to detect a valid hadoop home
> directory
> java.io.IOException: HADOOP_HOME or hadoop.home.dir are not set.
>                 at org.apache.hadoop.util.Shell.c
> heckHadoopHome(Shell.java:302)
>                 at org.apache.hadoop.util.Shell.<clinit>(Shell.java:327)
>                 at org.apache.hadoop.util.StringU
> tils.<clinit>(StringUtils.java:78)
>                 at org.apache.hadoop.security.Gro
> ups.parseStaticMapping(Groups.java:93)
>                 at org.apache.hadoop.security.Gro
> ups.<init>(Groups.java:77)
>                 at org.apache.hadoop.security.Gro
> ups.getUserToGroupsMappingService(Groups.java:240)
>                 at org.apache.hadoop.security.Gro
> ups.getUserToGroupsMappingService(Groups.java:225)
>                 at org.apache.hadoop.hbase.security.UserProvider.<clinit>(
> UserProvider.java:56)
>                 at org.apache.hadoop.hbase.client
> .ConnectionFactory.createConnection(ConnectionFactory.java:214)
>                 at org.apache.hadoop.hbase.client
> .ConnectionFactory.createConnection(ConnectionFactory.java:119)
>                 at com.example.projects.database.
> loaders.InstrumentLoader.main(InstrumentLoader.java:62)
>                 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> Method)
>                 at sun.reflect.NativeMethodAccess
> orImpl.invoke(NativeMethodAccessorImpl.java:62)
>                 at sun.reflect.DelegatingMethodAc
> cessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>                 at java.lang.reflect.Method.invoke(Method.java:497)
>                 at com.intellij.rt.execution.appl
> ication.AppMain.main(AppMain.java:147)
> 2016-11-07 15:32:01 DEBUG Shell:392 - setsid is not available on this
> machine. So not using it.
> 2016-11-07 15:32:01 DEBUG Shell:396 - setsid exited with exit code 0
> 2016-11-07 15:32:01 DEBUG Groups:80 - Group mapping
> impl=org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback;
> cacheTimeout=300000; warningDeltaMs=5000
> 2016-11-07 15:32:02 DEBUG MutableMetricsFactory:42 - field
> org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.Use
> rGroupInformation$UgiMetrics.loginSuccess with annotation @
> org.apache.hadoop.metrics2.annotation.Metric(always=false, about=,
> sampleName=Ops, type=DEFAULT, value=[Rate of successful kerberos logins and
> latency (milliseconds)], valueName=Time)
> 2016-11-07 15:32:02 DEBUG MutableMetricsFactory:42 - field
> org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.Use
> rGroupInformation$UgiMetrics.loginFailure with annotation @
> org.apache.hadoop.metrics2.annotation.Metric(always=false, about=,
> sampleName=Ops, type=DEFAULT, value=[Rate of failed kerberos logins and
> latency (milliseconds)], valueName=Time)
> 2016-11-07 15:32:02 DEBUG MutableMetricsFactory:42 - field
> org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.Use
> rGroupInformation$UgiMetrics.getGroups with annotation @
> org.apache.hadoop.metrics2.annotation.Metric(always=false, about=,
> sampleName=Ops, type=DEFAULT, value=[GetGroups], valueName=Time)
> 2016-11-07 15:32:02 DEBUG MetricsSystemImpl:221 - UgiMetrics, User and
> group related metrics
> 2016-11-07 15:32:02 DEBUG KerberosName:88 - Kerberos krb5 configuration
> not found, setting default realm to empty
> 2016-11-07 15:32:02 DEBUG UserGroupInformation:195 - hadoop login
> 2016-11-07 15:32:02 DEBUG UserGroupInformation:144 - hadoop login commit
> 2016-11-07 15:32:02 DEBUG UserGroupInformation:174 - using local
> user:UnixPrincipal: oliverbuckley-salmon
> 2016-11-07 15:32:02 DEBUG UserGroupInformation:785 - UGI
> loginUser:oliverbuckley-salmon (auth:SIMPLE)
> 2016-11-07 15:32:02 INFO  RecoverableZooKeeper:120 - Process
> identifier=hconnection-0x43d7741f connecting to ZooKeeper ensemble=
> 138.68.147.208:2181
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:host.name
> =172.20.10.3
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> environment:java.version=1.8.0_45
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> environment:java.vendor=Oracle Corporation
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> environment:java.home=/Library/Java/JavaVirtualMachines/
> jdk1.8.0_45.jdk/Contents/Home/jre
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> environment:java.class.path=/Library/Java/JavaVirtualMachine
> s/jdk1.8.0_45.jdk/Contents/Home/jre/lib/charsets.jar:/
> Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/
> Home/jre/lib/deploy.jar:/Library/Java/JavaVirtualMachin
> es/jdk1.8.0_45.jdk/Contents/Home/jre/lib/ext/cldrdata.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> ext/dnsns.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> 45.jdk/Contents/Home/jre/lib/ext/jfxrt.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> ext/localedata.jar:/Library/Java/JavaVirtualMachines/jdk1.
> 8.0_45.jdk/Contents/Home/jre/lib/ext/nashorn.jar:/Library/
> Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/
> lib/ext/sunec.jar:/Library/Java/JavaVirtualMachines/jdk1.
> 8.0_45.jdk/Contents/Home/jre/lib/ext/sunjce_provider.jar:/L
> ibrary/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/
> Home/jre/lib/ext/sunpkcs11.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> 45.jdk/Contents/Home/jre/lib/ext/zipfs.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> javaws.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.
> jdk/Contents/Home/jre/lib/jce.jar:/Library/Java/JavaVirtualM
> achines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/jfr.jar:
> /Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/
> Home/jre/lib/jfxswt.jar:/Library/Java/JavaVirtualMachin
> es/jdk1.8.0_45.jdk/Contents/Home/jre/lib/jsse.jar:/
> Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/
> Home/jre/lib/management-agent.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> plugin.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.
> jdk/Contents/Home/jre/lib/resources.jar:/Library/Java/JavaVi
> rtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/rt.jar:/
> Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/
> Home/lib/ant-javafx.jar:/Library/Java/JavaVirtualMachin
> es/jdk1.8.0_45.jdk/Contents/Home/lib/dt.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/javafx
> -mx.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/
> Contents/Home/lib/jconsole.jar:/Library/Java/JavaVirtualM
> achines/jdk1.8.0_45.jdk/Contents/Home/lib/packager.
> jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/
> Contents/Home/lib/sa-jdi.jar:/Library/Java/JavaVirtualMachin
> es/jdk1.8.0_45.jdk/Contents/Home/lib/tools.jar:/Users/oliv
> erbuckley-salmon/IdeaProjects/sandpit/database/target/
> classes:/Users/oliverbuckley-salmon/IdeaProjects/sandpit/
> domain/target/classes:/Users/oliverbuckley-salmon/.m2/reposi
> tory/com/google/code/gson/gson/2.6.2/gson-2.6.2.jar:/
> Users/oliverbuckley-salmon/.m2/repository/org/apache/
> hbase/hbase-client/1.2.3/hbase-client-1.2.3.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/apache/hbase/
> hbase-annotations/1.2.3/hbase-annotations-1.2.3.jar:/Users/
> oliverbuckley-salmon/.m2/repository/com/github/stephenc
> /findbugs/findbugs-annotations/1.3.9-1/findbugs-annotations-
> 1.3.9-1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/hbase/
> hbase-common/1.2.3/hbase-common-1.2.3.jar:/Users/oliver
> buckley-salmon/.m2/repository/commons-collections/commons-co
> llections/3.2.2/commons-collections-3.2.2.jar:/Users/oliverb
> uckley-salmon/.m2/repository/org/mortbay/jetty/jetty-util/
> 6.1.26/jetty-util-6.1.26.jar:/Users/oliverbuckley-salmon/.
> m2/repository/org/apache/hbase/hbase-protocol/1.2.3/
> hbase-protocol-1.2.3.jar:/Users/oliverbuckley-salmon/.
> m2/repository/commons-codec/commons-codec/1.9/commons-codec-
> 1.9.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-
> io/commons-io/2.4/commons-io-2.4.jar:/Users/oliverbuckley-
> salmon/.m2/repository/commons-lang/commons-lang/2.6/commons-
> lang-2.6.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-logging/
> commons-logging/1.2/commons-logging-1.2.jar:/Users/
> oliverbuckley-salmon/.m2/repository/com/google/guava/
> guava/12.0.1/guava-12.0.1.jar:/Users/oliverbuckley-salmon/.
> m2/repository/com/google/protobuf/protobuf-java/2.5.0/
> protobuf-java-2.5.0.jar:/Users/oliverbuckley-salmon/.m2
> /repository/io/netty/netty-all/4.0.23.Final/netty-all-4.0.
> 23.Final.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> apache/zookeeper/zookeeper/3.4.6/zookeeper-3.4.6.jar:/
> Users/oliverbuckley-salmon/.m2/repository/org/slf4j/slf4j-
> api/1.6.1/slf4j-api-1.6.1.jar:/Users/oliverbuckley-salmon/.m
> 2/repository/org/slf4j/slf4j-log4j12/1.6.1/slf4j-log4j12-1.6
> .1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache
> /htrace/htrace-core/3.1.0-incubating/htrace-core-3.1.0-
> incubating.jar:/Users/oliverbuckley-salmon/.m2/repository/
> org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-
> mapper-asl-1.9.13.jar:/Users/oliverbuckley-salmon/.m2/
> repository/org/codehaus/jackson/jackson-core-asl/1.9.
> 13/jackson-core-asl-1.9.13.jar:/Users/oliverbuckley-salmo
> n/.m2/repository/org/jruby/jcodings/jcodings/1.0.8/jcodin
> gs-1.0.8.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> jruby/joni/joni/2.1.2/joni-2.1.2.jar:/Users/oliverbuckley-
> salmon/.m2/repository/com/yammer/metrics/metrics-core/2.
> 2.0/metrics-core-2.2.0.jar:/Users/oliverbuckley-salmon/.
> m2/repository/org/apache/hadoop/hadoop-auth/2.5.1/
> hadoop-auth-2.5.1.jar:/Users/oliverbuckley-salmon/.m2/reposi
> tory/org/apache/httpcomponents/httpclient/4.2.5/httpclient-
> 4.2.5.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> apache/httpcomponents/httpcore/4.2.4/httpcore-4.2.4.
> jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> apache/directory/server/apacheds-kerberos-codec/2.0.0-
> M15/apacheds-kerberos-codec-2.0.0-M15.jar:/Users/oliverbuckley-salmon/.m2/
> repository/org/apache/directory/server/apacheds-
> i18n/2.0.0-M15/apacheds-i18n-2.0.0-M15.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/apache/director
> y/api/api-asn1-api/1.0.0-M20/api-asn1-api-1.0.0-M20.jar:/
> Users/oliverbuckley-salmon/.m2/repository/org/apache/
> directory/api/api-util/1.0.0-M20/api-util-1.0.0-M20.jar:/
> Users/oliverbuckley-salmon/.m2/repository/org/apache/
> hadoop/hadoop-common/2.5.1/hadoop-common-2.5.1.jar:/Users
> /oliverbuckley-salmon/.m2/repository/org/apache/hadoop/
> hadoop-annotations/2.5.1/hadoop-annotations-2.5.1.jar:/
> Users/oliverbuckley-salmon/.m2/repository/commons-cli/
> commons-cli/1.2/commons-cli-1.2.jar:/Users/oliverbuckley-
> salmon/.m2/repository/org/apache/commons/commons-math3/
> 3.1.1/commons-math3-3.1.1.jar:/Users/oliverbuckley-salmon/.
> m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/Users/oliv
> erbuckley-salmon/.m2/repository/commons-httpclient/commons-
> httpclient/3.1/commons-httpclient-3.1.jar:/Users/oliverbuckley-salmon/.m2/
> repository/commons-net/commons-net/3.1/commons-net-3.1.jar:/
> Users/oliverbuckley-salmon/.m2/repository/commons-el/
> commons-el/1.0/commons-el-1.0.jar:/Users/oliverbuckley-salmo
> n/.m2/repository/commons-configuration/commons-configuration
> /1.6/commons-configuration-1.6.jar:/Users/oliverbuckley-
> salmon/.m2/repository/commons-digester/commons-digester/1.8/
> commons-digester-1.8.jar:/Users/oliverbuckley-salmon/.
> m2/repository/commons-beanutils/commons-beanutils/1.
> 7.0/commons-beanutils-1.7.0.jar:/Users/oliverbuckley-
> salmon/.m2/repository/commons-beanutils/commons-beanutils-co
> re/1.8.0/commons-beanutils-core-1.8.0.jar:/Users/oliverbuckl
> ey-salmon/.m2/repository/org/apache/avro/avro/1.7.4/avro-1.
> 7.4.jar:/Users/oliverbuckley-salmon/.m2/repository/com/thou
> ghtworks/paranamer/paranamer/2.3/paranamer-2.3.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/xerial/snappy/snappy-java/
> 1.0.4.1/snappy-java-1.0.4.1.jar:/Users/oliverbuckley-salmon/.m2/
> repository/com/jcraft/jsch/0.1.42/jsch-0.1.42.jar:/Users/ol
> iverbuckley-salmon/.m2/repository/com/google/code/findbugs/
> jsr305/1.3.9/jsr305-1.3.9.jar:/Users/oliverbuckley-salmon/.
> m2/repository/org/apache/commons/commons-compress/1.4.
> 1/commons-compress-1.4.1.jar:/Users/oliverbuckley-salmon/.m2
> /repository/org/tukaani/xz/1.0/xz-1.0.jar:/Users/oliverbuck
> ley-salmon/.m2/repository/org/apache/hadoop/hadoop-
> mapreduce-client-core/2.5.1/hadoop-mapreduce-client-core-
> 2.5.1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> apache/hadoop/hadoop-yarn-common/2.5.1/hadoop-yarn-
> common-2.5.1.jar:/Users/oliverbuckley-salmon/.m2/
> repository/org/apache/hadoop/hadoop-yarn-api/2.5.1/hadoop-
> yarn-api-2.5.1.jar:/Users/oliverbuckley-salmon/.m2/
> repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar:
> /Users/oliverbuckley-salmon/.m2/repository/javax/xml/
> stream/stax-api/1.0-2/stax-api-1.0-2.jar:/Users/oliverbuc
> kley-salmon/.m2/repository/javax/activation/activation/1.
> 1/activation-1.1.jar:/Users/oliverbuckley-salmon/.m2/
> repository/io/netty/netty/3.6.2.Final/netty-3.6.2.Final.jar:
> /Users/oliverbuckley-salmon/.m2/repository/log4j/log4j/1.2.
> 17/log4j-1.2.17.jar:/Users/oliverbuckley-salmon/.m2/reposito
> ry/com/hazelcast/hazelcast-all/3.7.2/hazelcast-all-3.7.2.
> jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/curator/curator-
> framework/2.10.0/curator-framework-2.10.0.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/apache/curator/
> curator-client/2.10.0/curator-client-2.10.0.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/apache/curator/
> curator-x-discovery/2.10.0/curator-x-discovery-2.10.0.
> jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/
> curator/curator-recipes/2.10.0/curator-recipes-2.10.0.jar:/
> Users/oliverbuckley-salmon/.m2/repository/org/apache/
> curator/curator-test/2.10.0/curator-test-2.10.0.jar:/
> Users/oliverbuckley-salmon/.m2/repository/org/javassist/ja
> vassist/3.18.1-GA/javassist-3.18.1-GA.jar:/Users/oliverbuckl
> ey-salmon/.m2/repository/org/apache/commons/commons-math/2.
> 2/commons-math-2.2.jar:/Users/oliverbuckley-salmon/.m2/
> repository/com/hazelcast/hazelcast-zookeeper/3.6.1/
> hazelcast-zookeeper-3.6.1.jar:/Users/oliverbuckley-salmon/.
> m2/repository/joda-time/joda-time/2.9.4/joda-time-2.9.4.
> jar:/Applications/IntelliJ IDEA.app/Contents/lib/idea_rt.jar
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> environment:java.library.path=/Users/oliverbuckley-salmon/Li
> brary/Java/Extensions:/Library/Java/Extensions:/Network/
> Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java:.
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> environment:java.io.tmpdir=/var/folders/sx/g9vbcw9d3j54gtj89
> n57g1fw0000gn/T/
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> environment:java.compiler=<NA>
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:os.name=Mac
> OS X
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:os.arch=x86_64
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> environment:os.version=10.11.6
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:user.name
> =oliverbuckley-salmon
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> environment:user.home=/Users/oliverbuckley-salmon
> 2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client
> environment:user.dir=/Users/oliverbuckley-salmon/IdeaProjects/sandpit
> 2016-11-07 15:32:02 INFO  ZooKeeper:438 - Initiating client connection,
> connectString=138.68.147.208:2181 sessionTimeout=90000
> watcher=hconnection-0x43d7741f0x0, quorum=138.68.147.208:2181,
> baseZNode=/hbase
> 2016-11-07 15:32:02 DEBUG ClientCnxn:102 - zookeeper.disableAutoWatchReset
> is false
> 2016-11-07 15:32:02 INFO  ClientCnxn:975 - Opening socket connection to
> server 138.68.147.208/138.68.147.208:2181. Will not attempt to
> authenticate using SASL (unknown error)
> 2016-11-07 15:32:02 INFO  ClientCnxn:852 - Socket connection established
> to 138.68.147.208/138.68.147.208:2181, initiating session
> 2016-11-07 15:32:02 DEBUG ClientCnxn:892 - Session establishment request
> sent on 138.68.147.208/138.68.147.208:2181
> 2016-11-07 <http://138.68.147.208/138.68.147.208:21812016-11-07> 15:32:03
> INFO  ClientCnxn:1235 - Session establishment complete on server
> 138.68.147.208/138.68.147.208:2181, sessionid = 0x1583b2a4dbb000b,
> negotiated timeout = 90000
> 2016-11-07 15:32:03 DEBUG ZooKeeperWatcher:602 -
> hconnection-0x43d7741f0x0, quorum=138.68.147.208:2181, baseZNode=/hbase
> Received ZooKeeper Event, type=None, state=SyncConnected, path=null
> 2016-11-07 15:32:03 DEBUG ZooKeeperWatcher:686 -
> hconnection-0x43d7741f-0x1583b2a4dbb000b connected
> 2016-11-07 15:32:03 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 1,3  replyHeader:: 1,182,0  request::
> '/hbase/hbaseid,F  response:: s{17,132,1478127149340,1478461
> 382903,1,0,0,0,67,0,17}
> 2016-11-07 15:32:03 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 2,4  replyHeader:: 2,182,0  request::
> '/hbase/hbaseid,F  response:: #ffffffff000146d61737465723a36
> 3030303040ffffffd533ffffffc7ffffffa430fffffffafffffff5504255
> 46a2439353634626535382d616531632d343734352d393638352d3465643
> 43830343638636232,s{17,132,1478127149340,1478461382903,1,0,0,0,67,0,17}
> 2016-11-07 15:32:03 DEBUG AbstractRpcClient:116 -
> Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f3f4916,
> compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000,
> readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0,
> fallbackAllowed=false, bind address=null
> 2016-11-07 15:32:03 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 3,4  replyHeader:: 3,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:32:03 INFO  InstrumentLoader:64 - Master Info Port: 60010
> 2016-11-07 15:32:03 INFO  InstrumentLoader:65 - Connected to HBase
> 2016-11-07 15:32:03 INFO  InstrumentLoader:67 - Trying to create tables
> Creating table. 2016-11-07 15:32:03 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 4,3  replyHeader:: 4,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:32:03 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 5,4  replyHeader:: 5,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:32:04 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 6,3  replyHeader:: 6,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:32:04 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 7,4  replyHeader:: 7,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:32:04 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 8,3  replyHeader:: 8,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:32:04 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 9,4  replyHeader:: 9,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:32:05 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 10,3  replyHeader:: 10,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:32:05 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 11,4  replyHeader:: 11,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:32:05 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 12,3  replyHeader:: 12,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:32:05 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 13,4  replyHeader:: 13,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:32:06 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 14,3  replyHeader:: 14,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:32:06 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 15,4  replyHeader:: 15,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:32:09 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 16,3  replyHeader:: 16,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:32:09 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 17,4  replyHeader:: 17,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:32:13 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 18,3  replyHeader:: 18,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:32:13 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 19,4  replyHeader:: 19,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:32:23 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 20,3  replyHeader:: 20,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:32:23 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 280ms
> 2016-11-07 15:32:23 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 21,4  replyHeader:: 21,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:32:33 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 22,3  replyHeader:: 22,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:32:33 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 254ms
> 2016-11-07 15:32:33 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 23,4  replyHeader:: 23,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:32:44 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 24,3  replyHeader:: 24,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:32:44 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 261ms
> 2016-11-07 15:32:44 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 25,4  replyHeader:: 25,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:32:44 INFO  RpcRetryingCaller:142 - Call exception,
> tries=10, retries=35, started=40432 ms ago, cancelled=false, msg=
> 2016-11-07 15:32:54 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 26,3  replyHeader:: 26,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:32:54 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 121ms
> 2016-11-07 15:32:54 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 27,4  replyHeader:: 27,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:32:54 INFO  RpcRetryingCaller:142 - Call exception,
> tries=11, retries=35, started=50639 ms ago, cancelled=false, msg=
> 2016-11-07 15:33:14 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 28,3  replyHeader:: 28,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:33:14 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 82ms
> 2016-11-07 15:33:14 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 29,4  replyHeader:: 29,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:33:14 INFO  RpcRetryingCaller:142 - Call exception,
> tries=12, retries=35, started=70917 ms ago, cancelled=false, msg=
> 2016-11-07 15:33:34 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 30,3  replyHeader:: 30,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:33:34 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 100ms
> 2016-11-07 15:33:35 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 31,4  replyHeader:: 31,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:33:35 INFO  RpcRetryingCaller:142 - Call exception,
> tries=13, retries=35, started=91231 ms ago, cancelled=false, msg=
> 2016-11-07 15:33:55 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 32,3  replyHeader:: 32,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:33:55 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 49ms
> 2016-11-07 15:33:55 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 33,4  replyHeader:: 33,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:33:55 INFO  RpcRetryingCaller:142 - Call exception,
> tries=14, retries=35, started=111511 ms ago, cancelled=false, msg=
> 2016-11-07 15:34:15 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 34,3  replyHeader:: 34,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:34:15 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 62ms
> 2016-11-07 15:34:15 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 35,4  replyHeader:: 35,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:34:15 INFO  RpcRetryingCaller:142 - Call exception,
> tries=15, retries=35, started=131746 ms ago, cancelled=false, msg=
> 2016-11-07 15:34:35 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 36,3  replyHeader:: 36,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:34:35 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 96ms
> 2016-11-07 15:34:35 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 37,4  replyHeader:: 37,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:34:35 INFO  RpcRetryingCaller:142 - Call exception,
> tries=16, retries=35, started=152094 ms ago, cancelled=false, msg=
> 2016-11-07 15:34:56 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 38,3  replyHeader:: 38,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:34:56 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 77ms
> 2016-11-07 15:34:56 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 39,4  replyHeader:: 39,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:34:56 INFO  RpcRetryingCaller:142 - Call exception,
> tries=17, retries=35, started=172334 ms ago, cancelled=false, msg=
> 2016-11-07 15:35:16 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 40,3  replyHeader:: 40,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:35:16 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 177ms
> 2016-11-07 15:35:16 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 41,4  replyHeader:: 41,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:35:16 INFO  RpcRetryingCaller:142 - Call exception,
> tries=18, retries=35, started=192647 ms ago, cancelled=false, msg=
> 2016-11-07 15:35:36 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 42,3  replyHeader:: 42,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:35:36 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 45ms
> 2016-11-07 15:35:36 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 43,4  replyHeader:: 43,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:35:36 INFO  RpcRetryingCaller:142 - Call exception,
> tries=19, retries=35, started=212887 ms ago, cancelled=false, msg=
> 2016-11-07 15:35:56 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 44,3  replyHeader:: 44,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:35:56 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 187ms
> 2016-11-07 15:35:56 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 45,4  replyHeader:: 45,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:35:56 INFO  RpcRetryingCaller:142 - Call exception,
> tries=20, retries=35, started=233201 ms ago, cancelled=false, msg=
> 2016-11-07 15:36:17 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 46,3  replyHeader:: 46,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:36:17 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 115ms
> 2016-11-07 15:36:17 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 47,4  replyHeader:: 47,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:36:17 INFO  RpcRetryingCaller:142 - Call exception,
> tries=21, retries=35, started=253524 ms ago, cancelled=false, msg=
> 2016-11-07 15:36:37 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 48,3  replyHeader:: 48,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:36:37 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 121ms
> 2016-11-07 15:36:37 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 49,4  replyHeader:: 49,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:36:37 INFO  RpcRetryingCaller:142 - Call exception,
> tries=22, retries=35, started=273868 ms ago, cancelled=false, msg=
> 2016-11-07 15:36:57 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 50,3  replyHeader:: 50,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:36:57 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 67ms
> 2016-11-07 15:36:57 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 51,4  replyHeader:: 51,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:36:57 INFO  RpcRetryingCaller:142 - Call exception,
> tries=23, retries=35, started=294029 ms ago, cancelled=false, msg=
> 2016-11-07 15:37:18 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 52,3  replyHeader:: 52,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:37:18 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 43ms
> 2016-11-07 15:37:18 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 53,4  replyHeader:: 53,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:37:18 INFO  RpcRetryingCaller:142 - Call exception,
> tries=24, retries=35, started=314332 ms ago, cancelled=false, msg=
> 2016-11-07 15:37:38 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 54,3  replyHeader:: 54,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:37:38 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 79ms
> 2016-11-07 15:37:38 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 55,4  replyHeader:: 55,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:37:38 INFO  RpcRetryingCaller:142 - Call exception,
> tries=25, retries=35, started=334581 ms ago, cancelled=false, msg=
> 2016-11-07 15:37:58 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 56,3  replyHeader:: 56,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:37:58 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 118ms
> 2016-11-07 15:37:58 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 57,4  replyHeader:: 57,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:37:58 INFO  RpcRetryingCaller:142 - Call exception,
> tries=26, retries=35, started=354793 ms ago, cancelled=false, msg=
> 2016-11-07 15:38:18 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 58,3  replyHeader:: 58,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:38:18 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 180ms
> 2016-11-07 15:38:18 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 59,4  replyHeader:: 59,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:38:18 INFO  RpcRetryingCaller:142 - Call exception,
> tries=27, retries=35, started=375092 ms ago, cancelled=false, msg=
> 2016-11-07 15:38:39 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 60,3  replyHeader:: 60,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:38:39 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 64ms
> 2016-11-07 15:38:39 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 61,4  replyHeader:: 61,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:38:39 INFO  RpcRetryingCaller:142 - Call exception,
> tries=28, retries=35, started=395321 ms ago, cancelled=false, msg=
> 2016-11-07 15:38:59 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 62,3  replyHeader:: 62,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:38:59 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 63ms
> 2016-11-07 15:38:59 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 63,4  replyHeader:: 63,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:38:59 INFO  RpcRetryingCaller:142 - Call exception,
> tries=29, retries=35, started=415488 ms ago, cancelled=false, msg=
> 2016-11-07 15:39:19 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 64,3  replyHeader:: 64,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:39:19 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 164ms
> 2016-11-07 15:39:19 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 65,4  replyHeader:: 65,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:39:19 INFO  RpcRetryingCaller:142 - Call exception,
> tries=30, retries=35, started=435727 ms ago, cancelled=false, msg=
> 2016-11-07 15:39:39 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 66,3  replyHeader:: 66,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:39:39 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 63ms
> 2016-11-07 15:39:40 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 67,4  replyHeader:: 67,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:39:40 INFO  RpcRetryingCaller:142 - Call exception,
> tries=31, retries=35, started=456258 ms ago, cancelled=false, msg=
> 2016-11-07 15:40:00 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 68,3  replyHeader:: 68,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:40:00 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 186ms
> 2016-11-07 15:40:00 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 69,4  replyHeader:: 69,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:40:00 INFO  RpcRetryingCaller:142 - Call exception,
> tries=32, retries=35, started=476964 ms ago, cancelled=false, msg=
> 2016-11-07 15:40:20 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 70,3  replyHeader:: 70,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:40:20 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 38ms
> 2016-11-07 15:40:21 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 71,4  replyHeader:: 71,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:40:21 INFO  RpcRetryingCaller:142 - Call exception,
> tries=33, retries=35, started=497229 ms ago, cancelled=false, msg=
> 2016-11-07 15:40:41 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 72,3  replyHeader:: 72,182,0  request:: '/hbase,F
> response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
> 2016-11-07 15:40:41 DEBUG ClientCnxn:717 - Got ping response for
> sessionid: 0x1583b2a4dbb000b after 51ms
> 2016-11-07 15:40:41 DEBUG ClientCnxn:818 - Reading reply
> sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null
> finished:false header:: 73,4  replyHeader:: 73,182,0  request::
> '/hbase/master,F  response:: #ffffffff000146d61737465723a36
> 30303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383
> 236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffff
> ffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,14784
> 61382627,1478461382627,0,0,0,96892444867231745,62,0,126}
> 2016-11-07 15:40:41 INFO  RpcRetryingCaller:142 - Call exception,
> tries=34, retries=35, started=517438 ms ago, cancelled=false, msg=
> 2016-11-07 15:40:41 ERROR InstrumentLoader:114 - Error connecting to HBase
> Serverorg.apache.hadoop.hbase.client.RetriesExhaustedException: Failed
> after attempts=35, exceptions:
> Mon Nov 07 15:32:04 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:32:04 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:32:04 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:32:05 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:32:05 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:32:06 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:32:09 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:32:13 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:32:23 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:32:33 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:32:44 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:32:54 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:33:14 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:33:35 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:33:55 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:34:15 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:34:35 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:34:56 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:35:16 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:35:36 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:35:56 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:36:17 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:36:37 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:36:57 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:37:18 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:37:38 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:37:58 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:38:18 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:38:39 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:38:59 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:39:19 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:39:40 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:40:00 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:40:21 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
> Mon Nov 07 15:40:41 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784,
> pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException: a826d5422c4d
>
>
> Process finished with exit code 0
>
> The container is contactable as Zookeeper is running in the same container.
> Thanks very much for your help.
> Oliver
>
> -----Original Message-----
> From: Ted Yu [mailto:yuzhihong@gmail.com]
> Sent: 07 November 2016 15:05
> To: user@hbase.apache.org
> Subject: Re: Can connect to HBase via Java API but can't create table
>
> Can you show more of the UnknownHostException ?
>
> Could this be related to the firewall on the Docker container ?
>
> Cheers
>
> On Mon, Nov 7, 2016 at 6:49 AM, Oliver Buckley-Salmon <
> oliver.buckley-salmon@db.com> wrote:
>
> > Hi
> >
> > I am trying to create a table in HBase using the Java API, I can
> > connect to Zookeeper
> >
> > 2016-11-06 15:18:36 INFO  RecoverableZooKeeper:120 - Process
> > identifier=hconnection-0x382db087 connecting to ZooKeeper ensemble=
> > 138.68.147.208:2181
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09
> > GMT
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client environment:host.name
> > =olivers-air.default
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:java.version=1.8.0_45
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:java.vendor=Oracle Corporation
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:java.home=/
> > Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:java.class.path=/Library/Java/JavaVirtualMachines/jdk1.8.0
> > _ 45.jdk/Contents/Home/jre/lib/charsets.jar:/Library/Java/
> > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> > deploy.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > 45.jdk/Contents/Home/jre/lib/ext/cldrdata.jar:/Library/
> > Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/
> > lib/ext/dnsns.jar:/Library/Java/JavaVirtualMachines/jdk1.
> > 8.0_45.jdk/Contents/Home/jre/lib/ext/jfxrt.jar:/Library/
> > Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/
> > lib/ext/localedata.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > 45.jdk/Contents/Home/jre/lib/ext/nashorn.jar:/Library/Java/
> > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> > ext/sunec.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > 45.jdk/Contents/Home/jre/lib/ext/sunjce_provider.jar:/Library/Java/
> > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> > ext/sunpkcs11.jar:/Library/Java/JavaVirtualMachines/jdk1.
> > 8.0_45.jdk/Contents/Home/jre/lib/ext/zipfs.jar:/Library/
> > Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/
> > lib/javaws.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > 45.jdk/Contents/Home/jre/lib/jce.jar:/Library/Java/
> > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> > jfr.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > 45.jdk/Contents/Home/jre/lib/jfxswt.jar:/Library/Java/
> > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> > jsse.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > 45.jdk/Contents/Home/jre/lib/management-agent.jar:/Library/
> > Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/
> > lib/plugin.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > 45.jdk/Contents/Home/jre/lib/resources.jar:/Library/Java/
> > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> > rt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > 45.jdk/Contents/Home/lib/ant-javafx.jar:/Library/Java/
> > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/dt.
> > jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/li
> > b/ javafx-mx.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > 45.jdk/Contents/Home/lib/jconsole.jar:/Library/Java/
> > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/
> > packager.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> > 45.jdk/Contents/Home/lib/sa-jdi.jar:/Library/Java/
> > JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/tools.jar:/Users
> > /
> > oliverbuckley-salmon/IdeaProjects/sandpit/database/target/classes:/Use
> > rs/
> > oliverbuckley-salmon/IdeaProjects/sandpit/domain/target/classes:/Users
> > / oliverbuckley-salmon/.m2/repository/com/google/code/
> > gson/gson/2.6.2/gson-2.6.2.jar:/Users/oliverbuckley-
> > salmon/.m2/repository/org/apache/hbase/hbase-client/1.2.
> > 3/hbase-client-1.2.3.jar:/Users/oliverbuckley-salmon/.
> > m2/repository/org/apache/hbase/hbase-annotations/1.2.3/
> > hbase-annotations-1.2.3.jar:/Users/oliverbuckley-salmon/.
> > m2/repository/com/github/stephenc/findbugs/findbugs-
> > annotations/1.3.9-1/findbugs-annotations-1.3.9-1.jar:/
> > Users/oliverbuckley-salmon/.m2/repository/org/apache/
> > hbase/hbase-common/1.2.3/hbase-common-1.2.3.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/commons-collections/commons-
> > collections/3.2.2/commons-collections-3.2.2.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/org/mortbay/jetty/
> > jetty-util/6.1.26/jetty-util-6.1.26.jar:/Users/oliverbuckley-salmon/.m
> > 2/
> > repository/org/apache/hbase/hbase-protocol/1.2.3/hbase-
> > protocol-1.2.3.jar:/Users/oliverbuckley-salmon/.m2/
> > repository/commons-codec/commons-codec/1.9/commons-codec-1.9.jar:/User
> > s/
> > oliverbuckley-salmon/.m2/repository/commons-io/commons-
> > io/2.4/commons-io-2.4.jar:/Users/oliverbuckley-salmon/.
> > m2/repository/commons-lang/commons-lang/2.6/commons-lang-
> > 2.6.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-
> > logging/commons-logging/1.2/commons-logging-1.2.jar:/
> > Users/oliverbuckley-salmon/.m2/repository/com/google/
> > guava/guava/12.0.1/guava-12.0.1.jar:/Users/oliverbuckley-
> > salmon/.m2/repository/com/google/protobuf/protobuf-java/
> > 2.5.0/protobuf-java-2.5.0.jar:/Users/oliverbuckley-salmon/.
> > m2/repository/io/netty/netty-all/4.0.23.Final/netty-all-4.
> > 0.23.Final.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/
> > zookeeper/zookeeper/3.4.6/zookeeper-3.4.6.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/org/slf4j/slf4j-
> > api/1.6.1/slf4j-api-1.6.1.jar:/Users/oliverbuckley-salmon/.
> > m2/repository/org/slf4j/slf4j-log4j12/1.6.1/slf4j-log4j12-1.
> > 6.1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> > apache/htrace/htrace-core/3.1.0-incubating/htrace-core-3.1.
> > 0-incubating.jar:/Users/oliverbuckley-salmon/.m2/repository/org/codeha
> > us/ jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.
> > 13.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> > codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.
> > 9.13.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> > jruby/jcodings/jcodings/1.0.8/jcodings-1.0.8.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/org/jruby/joni/
> > joni/2.1.2/joni-2.1.2.jar:/Users/oliverbuckley-salmon/.
> > m2/repository/com/yammer/metrics/metrics-core/2.2.0/
> > metrics-core-2.2.0.jar:/Users/oliverbuckley-salmon/.m2/
> > repository/org/apache/hadoop/hadoop-auth/2.5.1/hadoop-auth-
> > 2.5.1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/
> > httpcomponents/httpclient/4.2.5/httpclient-4.2.5.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/org/apache/
> > httpcomponents/httpcore/4.2.4/httpcore-4.2.4.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/org/apache/directory/server/apache
> > ds-
> > kerberos-codec/2.0.0-M15/apacheds-kerberos-codec-2.0.0-
> > M15.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> > apache/directory/server/apacheds-i18n/2.0.0-M15/
> > apacheds-i18n-2.0.0-M15.jar:/Users/oliverbuckley-salmon/.
> > m2/repository/org/apache/directory/api/api-asn1-api/1.
> > 0.0-M20/api-asn1-api-1.0.0-M20.jar:/Users/oliverbuckley-
> > salmon/.m2/repository/org/apache/directory/api/api-util/
> > 1.0.0-M20/api-util-1.0.0-M20.jar:/Users/oliverbuckley-
> > salmon/.m2/repository/org/apache/hadoop/hadoop-common/2.
> > 5.1/hadoop-common-2.5.1.jar:/Users/oliverbuckley-salmon/.
> > m2/repository/org/apache/hadoop/hadoop-annotations/2.5.
> > 1/hadoop-annotations-2.5.1.jar:/Users/oliverbuckley-
> > salmon/.m2/repository/commons-cli/commons-cli/1.2/commons-
> > cli-1.2.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/comm
> > ons/ commons-math3/3.1.1/commons-math3-3.1.1.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/xmlenc/xmlenc/0.52/
> > xmlenc-0.52.jar:/Users/oliverbuckley-salmon/.m2/
> > repository/commons-httpclient/commons-httpclient/3.1/
> > commons-httpclient-3.1.jar:/Users/oliverbuckley-salmon/.
> > m2/repository/commons-net/commons-net/3.1/commons-net-3.
> > 1.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-
> > el/commons-el/1.0/commons-el-1.0.jar:/Users/oliverbuckley-
> > salmon/.m2/repository/commons-configuration/commons-
> > configuration/1.6/commons-configuration-1.6.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/commons-digester/
> > commons-digester/1.8/commons-digester-1.8.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/commons-beanutils/
> > commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar:/
> > Users/oliverbuckley-salmon/.m2/repository/commons-
> > beanutils/commons-beanutils-core/1.8.0/commons-beanutils-
> > core-1.8.0.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/a
> > vro/
> > avro/1.7.4/avro-1.7.4.jar:/Users/oliverbuckley-salmon/.m2/repository/c
> > om/ thoughtworks/paranamer/paranamer/2.3/paranamer-2.3.
> > jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> > xerial/snappy/snappy-java/1.0.4.1/snappy-java-1.0.4.1.jar:/
> > Users/oliverbuckley-salmon/.m2/repository/com/jcraft/jsch/
> > 0.1.42/jsch-0.1.42.jar:/Users/oliverbuckley-salmon/.m2/
> > repository/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar:/Use
> > rs/ oliverbuckley-salmon/.m2/repository/org/apache/commons/
> > commons-compress/1.4.1/commons-compress-1.4.1.jar:/
> > Users/oliverbuckley-salmon/.m2/repository/org/tukaani/xz/
> > 1.0/xz-1.0.jar:/Users/oliverbuckley-salmon/.m2/
> > repository/org/apache/hadoop/hadoop-mapreduce-client-core/
> > 2.5.1/hadoop-mapreduce-client-core-2.5.1.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/org/apache/hadoop/
> > hadoop-yarn-common/2.5.1/hadoop-yarn-common-2.5.1.jar:/
> > Users/oliverbuckley-salmon/.m2/repository/org/apache/
> > hadoop/hadoop-yarn-api/2.5.1/hadoop-yarn-api-2.5.1.jar:/
> > Users/oliverbuckley-salmon/.m2/repository/javax/xml/bind/
> > jaxb-api/2.2.2/jaxb-api-2.2.2.jar:/Users/oliverbuckley-
> > salmon/.m2/repository/javax/xml/stream/stax-api/1.0-2/
> > stax-api-1.0-2.jar:/Users/oliverbuckley-salmon/.m2/
> > repository/javax/activation/activation/1.1/activation-1.1.
> > jar:/Users/oliverbuckley-salmon/.m2/repository/io/
> > netty/netty/3.6.2.Final/netty-3.6.2.Final.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/log4j/log4j/1.2.17/
> > log4j-1.2.17.jar:/Users/oliverbuckley-salmon/.m2/repository/com/hazelc
> > ast/ hazelcast-all/3.7.2/hazelcast-all-3.7.2.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/org/apache/curator/
> > curator-framework/2.10.0/curator-framework-2.10.0.jar:/
> > Users/oliverbuckley-salmon/.m2/repository/org/apache/
> > curator/curator-client/2.10.0/curator-client-2.10.0.jar:/
> > Users/oliverbuckley-salmon/.m2/repository/org/apache/
> > curator/curator-x-discovery/2.10.0/curator-x-discovery-2.10.
> > 0.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> > apache/curator/curator-recipes/2.10.0/curator-recipes-2.10.0.jar:/User
> > s/ oliverbuckley-salmon/.m2/repository/org/apache/curator/
> > curator-test/2.10.0/curator-test-2.10.0.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/org/javassist/
> > javassist/3.18.1-GA/javassist-3.18.1-GA.jar:/Users/
> > oliverbuckley-salmon/.m2/repository/org/apache/commons/
> > commons-math/2.2/commons-math-2.2.jar:/Users/oliverbuckley-
> > salmon/.m2/repository/com/hazelcast/hazelcast-zookeeper/
> > 3.6.1/hazelcast-zookeeper-3.6.1.jar:/Users/oliverbuckley-
> > salmon/.m2/repository/joda-time/joda-time/2.9.4/joda-
> > time-2.9.4.jar:/Applications/IntelliJ
> > IDEA.app/Contents/lib/idea_rt.jar
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:java.library.path=/Users/oliverbuckley-salmon/
> > Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java
> > / Extensions:/System/Library/Java/Extensions:/usr/lib/java:.
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:java.io.tmpdir=/var/folders/sx/g9vbcw9d3j54gtj89n57g1fw000
> > 0gn
> > /T/
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:java.compiler=<NA>
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:os.name=Mac OS X
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:os.arch=x86_64
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:os.version=10.11.6
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:user.name= oliverbuckley-salmon
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:user.home=/Users/oliverbuckley-salmon
> > 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> > environment:user.dir=/Users/oliverbuckley-salmon/IdeaProjects/sandpit
> > 2016-11-06 15:18:36 INFO  ZooKeeper:438 - Initiating client
> > connection,
> > connectString=138.68.147.208:2181 sessionTimeout=90000
> > watcher=hconnection-0x382db0870x0, quorum=138.68.147.208:2181,
> > baseZNode=/hbase
> > 2016-11-06 15:18:37 INFO  ClientCnxn:975 - Opening socket connection
> > to server 138.68.147.208/138.68.147.208:2181. Will not attempt to
> > authenticate using SASL (unknown error)
> > 2016-11-06 15:18:37 INFO  ClientCnxn:852 - Socket connection
> > established to 138.68.147.208/138.68.147.208:2181, initiating session
> > 2016-11-06 15:18:37 INFO  ClientCnxn:1235 - Session establishment
> > complete on server 138.68.147.208/138.68.147.208:2181, sessionid =
> > 0x158273e5275001d, negotiated timeout = 90000
> >
> > I can connect to HBase as I can see it in the debugger, but when I try
> > to create a table it fails after 35 retries with
> > org.apache.hadoop.hbase.MasterNotRunningException:
> > java.net.UnknownHostException
> >
> > I can connect to HBase with the UI and can see the Master and Region
> > servers.
> >
> > My code looks like this
> > Configuration hBaseConfig =  HBaseConfiguration.create();
> >             hBaseConfig.setInt("timeout", 120000);
> >             hBaseConfig.set("hbase.master", hbaseHost + ":60000");
> >             hBaseConfig.set("hbase.zookeeper.quorum",zookeeperHost);
> >             hBaseConfig.set("hbase.zookeeper.property.clientPort",
> > "2181");
> >
> >             logger.info("Trying to connect to HBase");
> >             Connection connection = ConnectionFactory.
> > createConnection(hBaseConfig);
> >             Admin admin = connection.getAdmin();
> >             logger.info("Connected to HBase");
> >
> >             logger.info("Trying to create tables");
> >             createSchemaTables(admin);
> >             logger.info("Tables created");
> >
> > CreateSchemaTables looks like this and the code fails and retries at
> > admin.createTable(table); public static void createSchemaTables(Admin
> > admin) throws IOException {
> >
> >
> >
> >         HTableDescriptor table = new HTableDescriptor(TableName.
> > valueOf(tableName));
> >         HColumnDescriptor cf = new HColumnDescriptor(columnFamily).
> > setCompressionType(Algorithm.NONE);
> >
> >         table.addFamily(cf);
> >
> >         System.out.print("Creating table. ");
> >         admin.createTable(table);
> >         System.out.println(" Done.");
> >
> > The client is running on my Mac Air and Hbase is running in a Docker
> > container (nerdammer/hbase) Digital Ocean.
> >
> > Does anyone have any idea why I can connect to HBase but not create
> tables?
> >
> > Thanks in advance for your help, Oliver
> >
> >
> >
> >
> > ---
> > This e-mail may contain confidential and/or privileged information. If
> > you are not the intended recipient (or have received this e-mail in
> > error) please notify the sender immediately and delete this e-mail.
> > Any unauthorized copying, disclosure or distribution of the material
> > in this e-mail is strictly forbidden.
> >
> > Please refer to https://www.db.com/disclosures for additional EU
> > corporate and regulatory disclosures and to http://www.db.com/
> > unitedkingdom/content/privacy.htm for information about privacy.
> >
>
>
> ---
> This e-mail may contain confidential and/or privileged information. If you
> are not the intended recipient (or have received this e-mail in error)
> please notify the sender immediately and delete this e-mail. Any
> unauthorized copying, disclosure or distribution of the material in this
> e-mail is strictly forbidden.
>
> Please refer to https://www.db.com/disclosures for additional EU
> corporate and regulatory disclosures and to http://www.db.com/unitedkingdo
> m/content/privacy.htm for information about privacy.
>
>
> ---
> This e-mail may contain confidential and/or privileged information. If you
> are not the intended recipient (or have received this e-mail in error)
> please notify the sender immediately and delete this e-mail. Any
> unauthorized copying, disclosure or distribution of the material in this
> e-mail is strictly forbidden.
>
> Please refer to https://www.db.com/disclosures for additional EU
> corporate and regulatory disclosures and to http://www.db.com/unitedkingdo
> m/content/privacy.htm for information about privacy.
>

RE: Can connect to HBase via Java API but can't create table

Posted by Oliver Buckley-Salmon <ol...@db.com>.
Hi,
Here's a better exception

Exception in thread "main" org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=36, exceptions:
Tue Nov 08 07:06:48 GMT 2016, null, java.net.SocketTimeoutException: callTimeout=60000, callDuration=69291: row 'INSTRUMENT,,' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=e5611ffad72e,60020,1478588595835, seqNum=0

                at org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.throwEnrichedException(RpcRetryingCallerWithReadReplicas.java:276)
                at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:210)
                at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:60)
                at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:210)
                at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:326)
                at org.apache.hadoop.hbase.client.ClientScanner.nextScanner(ClientScanner.java:301)
                at org.apache.hadoop.hbase.client.ClientScanner.initializeScannerInConstruction(ClientScanner.java:166)
                at org.apache.hadoop.hbase.client.ClientScanner.<init>(ClientScanner.java:161)
                at org.apache.hadoop.hbase.client.HTable.getScanner(HTable.java:797)
                at org.apache.hadoop.hbase.MetaTableAccessor.fullScan(MetaTableAccessor.java:602)
                at org.apache.hadoop.hbase.MetaTableAccessor.tableExists(MetaTableAccessor.java:366)
                at org.apache.hadoop.hbase.client.HBaseAdmin.tableExists(HBaseAdmin.java:406)
                at com.example.projects.database.schema.SchemaBuilder.createOrOverwrite(SchemaBuilder.java:31)
                at com.example.projects.database.schema.SchemaBuilder.createSchemaTables(SchemaBuilder.java:52)
                at com.example.projects.database.schema.SchemaBuilder.main(SchemaBuilder.java:94)
                at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
                at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
                at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
                at java.lang.reflect.Method.invoke(Method.java:497)
                at com.intellij.rt.execution.application.AppMain.main(AppMain.java:147)
Caused by: java.net.SocketTimeoutException: callTimeout=60000, callDuration=69291: row 'INSTRUMENT,,' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=e5611ffad72e,60020,1478588595835, seqNum=0
                at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:169)
                at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:65)
                at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
                at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
                at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.UnknownHostException: e5611ffad72e
                at org.apache.hadoop.hbase.ipc.AbstractRpcClient$BlockingRpcChannelImplementation.<init>(AbstractRpcClient.java:315)
                at org.apache.hadoop.hbase.ipc.AbstractRpcClient.createBlockingRpcChannel(AbstractRpcClient.java:267)
                at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.getClient(ConnectionManager.java:1639)
                at org.apache.hadoop.hbase.client.ScannerCallable.prepare(ScannerCallable.java:162)
                at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.prepare(ScannerCallableWithReplicas.java:376)
                at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:134)
                ... 4 more
Thanks again for your help,
Oliver

-----Original Message-----
From: Oliver Buckley-Salmon [mailto:oliver.buckley-salmon+external@db.com]
Sent: 07 November 2016 15:47
To: user@hbase.apache.org
Subject: RE: Can connect to HBase via Java API but can't create table

Hi,
Here's the log on Debug
2016-11-07 15:32:01 INFO  InstrumentLoader:61 - Trying to connect to HBase
2016-11-07 15:32:01 DEBUG Groups:238 -  Creating new Groups object
2016-11-07 15:32:01 DEBUG NativeCodeLoader:46 - Trying to load the custom-built native-hadoop library...
2016-11-07 15:32:01 DEBUG NativeCodeLoader:55 - Failed to load native-hadoop with error: java.lang.UnsatisfiedLinkError: no hadoop in java.library.path
2016-11-07 15:32:01 DEBUG NativeCodeLoader:56 - java.library.path=/Users/oliverbuckley-salmon/Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java:.
2016-11-07 15:32:01 WARN  NativeCodeLoader:62 - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2016-11-07 15:32:01 DEBUG JniBasedUnixGroupsMappingWithFallback:40 - Falling back to shell based
2016-11-07 15:32:01 DEBUG JniBasedUnixGroupsMappingWithFallback:44 - Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping
2016-11-07 15:32:01 DEBUG Shell:320 - Failed to detect a valid hadoop home directory
java.io.IOException: HADOOP_HOME or hadoop.home.dir are not set.
                at org.apache.hadoop.util.Shell.checkHadoopHome(Shell.java:302)
                at org.apache.hadoop.util.Shell.<clinit>(Shell.java:327)
                at org.apache.hadoop.util.StringUtils.<clinit>(StringUtils.java:78)
                at org.apache.hadoop.security.Groups.parseStaticMapping(Groups.java:93)
                at org.apache.hadoop.security.Groups.<init>(Groups.java:77)
                at org.apache.hadoop.security.Groups.getUserToGroupsMappingService(Groups.java:240)
                at org.apache.hadoop.security.Groups.getUserToGroupsMappingService(Groups.java:225)
                at org.apache.hadoop.hbase.security.UserProvider.<clinit>(UserProvider.java:56)
                at org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:214)
                at org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:119)
                at com.example.projects.database.loaders.InstrumentLoader.main(InstrumentLoader.java:62)
                at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
                at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
                at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
                at java.lang.reflect.Method.invoke(Method.java:497)
                at com.intellij.rt.execution.application.AppMain.main(AppMain.java:147)
2016-11-07 15:32:01 DEBUG Shell:392 - setsid is not available on this machine. So not using it.
2016-11-07 15:32:01 DEBUG Shell:396 - setsid exited with exit code 0
2016-11-07 15:32:01 DEBUG Groups:80 - Group mapping impl=org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback; cacheTimeout=300000; warningDeltaMs=5000
2016-11-07 15:32:02 DEBUG MutableMetricsFactory:42 - field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginSuccess with annotation @org.apache.hadoop.metrics2.annotation.Metric(always=false, about=, sampleName=Ops, type=DEFAULT, value=[Rate of successful kerberos logins and latency (milliseconds)], valueName=Time)
2016-11-07 15:32:02 DEBUG MutableMetricsFactory:42 - field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginFailure with annotation @org.apache.hadoop.metrics2.annotation.Metric(always=false, about=, sampleName=Ops, type=DEFAULT, value=[Rate of failed kerberos logins and latency (milliseconds)], valueName=Time)
2016-11-07 15:32:02 DEBUG MutableMetricsFactory:42 - field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.getGroups with annotation @org.apache.hadoop.metrics2.annotation.Metric(always=false, about=, sampleName=Ops, type=DEFAULT, value=[GetGroups], valueName=Time)
2016-11-07 15:32:02 DEBUG MetricsSystemImpl:221 - UgiMetrics, User and group related metrics
2016-11-07 15:32:02 DEBUG KerberosName:88 - Kerberos krb5 configuration not found, setting default realm to empty
2016-11-07 15:32:02 DEBUG UserGroupInformation:195 - hadoop login
2016-11-07 15:32:02 DEBUG UserGroupInformation:144 - hadoop login commit
2016-11-07 15:32:02 DEBUG UserGroupInformation:174 - using local user:UnixPrincipal: oliverbuckley-salmon
2016-11-07 15:32:02 DEBUG UserGroupInformation:785 - UGI loginUser:oliverbuckley-salmon (auth:SIMPLE)
2016-11-07 15:32:02 INFO  RecoverableZooKeeper:120 - Process identifier=hconnection-0x43d7741f connecting to ZooKeeper ensemble=138.68.147.208:2181
2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT
2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:host.name=172.20.10.3
2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:java.version=1.8.0_45
2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:java.vendor=Oracle Corporation
2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:java.home=/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre
2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:java.class.path=/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/charsets.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/deploy.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/ext/cldrdata.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/ext/dnsns.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/ext/jfxrt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/ext/localedata.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/ext/nashorn.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/ext/sunec.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/ext/sunjce_provider.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/ext/sunpkcs11.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/ext/zipfs.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/javaws.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/jce.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/jfr.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/jfxswt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/jsse.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/management-agent.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/plugin.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/resources.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/rt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/ant-javafx.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/dt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/javafx-mx.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/jconsole.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/packager.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/sa-jdi.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/tools.jar:/Users/oliverbuckley-salmon/IdeaProjects/sandpit/database/target/classes:/Users/oliverbuckley-salmon/IdeaProjects/sandpit/domain/target/classes:/Users/oliverbuckley-salmon/.m2/repository/com/google/code/gson/gson/2.6.2/gson-2.6.2.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/hbase/hbase-client/1.2.3/hbase-client-1.2.3.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/hbase/hbase-annotations/1.2.3/hbase-annotations-1.2.3.jar:/Users/oliverbuckley-salmon/.m2/repository/com/github/stephenc/findbugs/findbugs-annotations/1.3.9-1/findbugs-annotations-1.3.9-1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/hbase/hbase-common/1.2.3/hbase-common-1.2.3.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar:/Users/oliverbuckley-salmon/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/hbase/hbase-protocol/1.2.3/hbase-protocol-1.2.3.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-codec/commons-codec/1.9/commons-codec-1.9.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-logging/commons-logging/1.2/commons-logging-1.2.jar:/Users/oliverbuckley-salmon/.m2/repository/com/google/guava/guava/12.0.1/guava-12.0.1.jar:/Users/oliverbuckley-salmon/.m2/repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar:/Users/oliverbuckley-salmon/.m2/repository/io/netty/netty-all/4.0.23.Final/netty-all-4.0.23.Final.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/zookeeper/zookeeper/3.4.6/zookeeper-3.4.6.jar:/Users/oliverbuckley-salmon/.m2/repository/org/slf4j/slf4j-api/1.6.1/slf4j-api-1.6.1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/slf4j/slf4j-log4j12/1.6.1/slf4j-log4j12-1.6.1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/htrace/htrace-core/3.1.0-incubating/htrace-core-3.1.0-incubating.jar:/Users/oliverbuckley-salmon/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.13.jar:/Users/oliverbuckley-salmon/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar:/Users/oliverbuckley-salmon/.m2/repository/org/jruby/jcodings/jcodings/1.0.8/jcodings-1.0.8.jar:/Users/oliverbuckley-salmon/.m2/repository/org/jruby/joni/joni/2.1.2/joni-2.1.2.jar:/Users/oliverbuckley-salmon/.m2/repository/com/yammer/metrics/metrics-core/2.2.0/metrics-core-2.2.0.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/hadoop/hadoop-auth/2.5.1/hadoop-auth-2.5.1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/httpcomponents/httpclient/4.2.5/httpclient-4.2.5.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/httpcomponents/httpcore/4.2.4/httpcore-4.2.4.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/directory/server/apacheds-kerberos-codec/2.0.0-M15/apacheds-kerberos-codec-2.0.0-M15.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/directory/server/apacheds-i18n/2.0.0-M15/apacheds-i18n-2.0.0-M15.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/directory/api/api-asn1-api/1.0.0-M20/api-asn1-api-1.0.0-M20.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/directory/api/api-util/1.0.0-M20/api-util-1.0.0-M20.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/hadoop/hadoop-common/2.5.1/hadoop-common-2.5.1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/hadoop/hadoop-annotations/2.5.1/hadoop-annotations-2.5.1.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/commons/commons-math3/3.1.1/commons-math3-3.1.1.jar:/Users/oliverbuckley-salmon/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-net/commons-net/3.1/commons-net-3.1.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-el/commons-el/1.0/commons-el-1.0.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-beanutils/commons-beanutils-core/1.8.0/commons-beanutils-core-1.8.0.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/avro/avro/1.7.4/avro-1.7.4.jar:/Users/oliverbuckley-salmon/.m2/repository/com/thoughtworks/paranamer/paranamer/2.3/paranamer-2.3.jar:/Users/oliverbuckley-salmon/.m2/repository/org/xerial/snappy/snappy-java/1.0.4.1/snappy-java-1.0.4.1.jar:/Users/oliverbuckley-salmon/.m2/repository/com/jcraft/jsch/0.1.42/jsch-0.1.42.jar:/Users/oliverbuckley-salmon/.m2/repository/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/commons/commons-compress/1.4.1/commons-compress-1.4.1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/tukaani/xz/1.0/xz-1.0.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.5.1/hadoop-mapreduce-client-core-2.5.1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/hadoop/hadoop-yarn-common/2.5.1/hadoop-yarn-common-2.5.1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/hadoop/hadoop-yarn-api/2.5.1/hadoop-yarn-api-2.5.1.jar:/Users/oliverbuckley-salmon/.m2/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar:/Users/oliverbuckley-salmon/.m2/repository/javax/xml/stream/stax-api/1.0-2/stax-api-1.0-2.jar:/Users/oliverbuckley-salmon/.m2/repository/javax/activation/activation/1.1/activation-1.1.jar:/Users/oliverbuckley-salmon/.m2/repository/io/netty/netty/3.6.2.Final/netty-3.6.2.Final.jar:/Users/oliverbuckley-salmon/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar:/Users/oliverbuckley-salmon/.m2/repository/com/hazelcast/hazelcast-all/3.7.2/hazelcast-all-3.7.2.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/curator/curator-framework/2.10.0/curator-framework-2.10.0.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/curator/curator-client/2.10.0/curator-client-2.10.0.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/curator/curator-x-discovery/2.10.0/curator-x-discovery-2.10.0.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/curator/curator-recipes/2.10.0/curator-recipes-2.10.0.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/curator/curator-test/2.10.0/curator-test-2.10.0.jar:/Users/oliverbuckley-salmon/.m2/repository/org/javassist/javassist/3.18.1-GA/javassist-3.18.1-GA.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/commons/commons-math/2.2/commons-math-2.2.jar:/Users/oliverbuckley-salmon/.m2/repository/com/hazelcast/hazelcast-zookeeper/3.6.1/hazelcast-zookeeper-3.6.1.jar:/Users/oliverbuckley-salmon/.m2/repository/joda-time/joda-time/2.9.4/joda-time-2.9.4.jar:/Applications/IntelliJ IDEA.app/Contents/lib/idea_rt.jar
2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:java.library.path=/Users/oliverbuckley-salmon/Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java:.
2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:java.io.tmpdir=/var/folders/sx/g9vbcw9d3j54gtj89n57g1fw0000gn/T/
2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:java.compiler=<NA>
2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:os.name=Mac OS X
2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:os.arch=x86_64
2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:os.version=10.11.6
2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:user.name=oliverbuckley-salmon
2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:user.home=/Users/oliverbuckley-salmon
2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:user.dir=/Users/oliverbuckley-salmon/IdeaProjects/sandpit
2016-11-07 15:32:02 INFO  ZooKeeper:438 - Initiating client connection, connectString=138.68.147.208:2181 sessionTimeout=90000 watcher=hconnection-0x43d7741f0x0, quorum=138.68.147.208:2181, baseZNode=/hbase
2016-11-07 15:32:02 DEBUG ClientCnxn:102 - zookeeper.disableAutoWatchReset is false
2016-11-07 15:32:02 INFO  ClientCnxn:975 - Opening socket connection to server 138.68.147.208/138.68.147.208:2181. Will not attempt to authenticate using SASL (unknown error)
2016-11-07 15:32:02 INFO  ClientCnxn:852 - Socket connection established to 138.68.147.208/138.68.147.208:2181, initiating session
2016-11-07 15:32:02 DEBUG ClientCnxn:892 - Session establishment request sent on 138.68.147.208/138.68.147.208:2181
2016-11-07 15:32:03 INFO  ClientCnxn:1235 - Session establishment complete on server 138.68.147.208/138.68.147.208:2181, sessionid = 0x1583b2a4dbb000b, negotiated timeout = 90000
2016-11-07 15:32:03 DEBUG ZooKeeperWatcher:602 - hconnection-0x43d7741f0x0, quorum=138.68.147.208:2181, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null
2016-11-07 15:32:03 DEBUG ZooKeeperWatcher:686 - hconnection-0x43d7741f-0x1583b2a4dbb000b connected
2016-11-07 15:32:03 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 1,3  replyHeader:: 1,182,0  request:: '/hbase/hbaseid,F  response:: s{17,132,1478127149340,1478461382903,1,0,0,0,67,0,17}
2016-11-07 15:32:03 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 2,4  replyHeader:: 2,182,0  request:: '/hbase/hbaseid,F  response:: #ffffffff000146d61737465723a363030303040ffffffd533ffffffc7ffffffa430fffffffafffffff550425546a2439353634626535382d616531632d343734352d393638352d346564343830343638636232,s{17,132,1478127149340,1478461382903,1,0,0,0,67,0,17}
2016-11-07 15:32:03 DEBUG AbstractRpcClient:116 - Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f3f4916, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null
2016-11-07 15:32:03 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 3,4  replyHeader:: 3,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:32:03 INFO  InstrumentLoader:64 - Master Info Port: 60010
2016-11-07 15:32:03 INFO  InstrumentLoader:65 - Connected to HBase
2016-11-07 15:32:03 INFO  InstrumentLoader:67 - Trying to create tables
Creating table. 2016-11-07 15:32:03 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 4,3  replyHeader:: 4,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:32:03 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 5,4  replyHeader:: 5,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:32:04 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 6,3  replyHeader:: 6,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:32:04 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 7,4  replyHeader:: 7,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:32:04 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 8,3  replyHeader:: 8,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:32:04 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 9,4  replyHeader:: 9,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:32:05 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 10,3  replyHeader:: 10,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:32:05 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 11,4  replyHeader:: 11,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:32:05 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 12,3  replyHeader:: 12,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:32:05 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 13,4  replyHeader:: 13,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:32:06 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 14,3  replyHeader:: 14,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:32:06 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 15,4  replyHeader:: 15,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:32:09 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 16,3  replyHeader:: 16,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:32:09 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 17,4  replyHeader:: 17,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:32:13 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 18,3  replyHeader:: 18,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:32:13 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 19,4  replyHeader:: 19,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:32:23 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 20,3  replyHeader:: 20,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:32:23 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 280ms
2016-11-07 15:32:23 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 21,4  replyHeader:: 21,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:32:33 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 22,3  replyHeader:: 22,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:32:33 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 254ms
2016-11-07 15:32:33 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 23,4  replyHeader:: 23,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:32:44 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 24,3  replyHeader:: 24,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:32:44 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 261ms
2016-11-07 15:32:44 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 25,4  replyHeader:: 25,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:32:44 INFO  RpcRetryingCaller:142 - Call exception, tries=10, retries=35, started=40432 ms ago, cancelled=false, msg=
2016-11-07 15:32:54 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 26,3  replyHeader:: 26,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:32:54 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 121ms
2016-11-07 15:32:54 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 27,4  replyHeader:: 27,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:32:54 INFO  RpcRetryingCaller:142 - Call exception, tries=11, retries=35, started=50639 ms ago, cancelled=false, msg=
2016-11-07 15:33:14 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 28,3  replyHeader:: 28,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:33:14 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 82ms
2016-11-07 15:33:14 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 29,4  replyHeader:: 29,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:33:14 INFO  RpcRetryingCaller:142 - Call exception, tries=12, retries=35, started=70917 ms ago, cancelled=false, msg=
2016-11-07 15:33:34 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 30,3  replyHeader:: 30,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:33:34 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 100ms
2016-11-07 15:33:35 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 31,4  replyHeader:: 31,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:33:35 INFO  RpcRetryingCaller:142 - Call exception, tries=13, retries=35, started=91231 ms ago, cancelled=false, msg=
2016-11-07 15:33:55 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 32,3  replyHeader:: 32,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:33:55 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 49ms
2016-11-07 15:33:55 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 33,4  replyHeader:: 33,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:33:55 INFO  RpcRetryingCaller:142 - Call exception, tries=14, retries=35, started=111511 ms ago, cancelled=false, msg=
2016-11-07 15:34:15 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 34,3  replyHeader:: 34,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:34:15 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 62ms
2016-11-07 15:34:15 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 35,4  replyHeader:: 35,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:34:15 INFO  RpcRetryingCaller:142 - Call exception, tries=15, retries=35, started=131746 ms ago, cancelled=false, msg=
2016-11-07 15:34:35 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 36,3  replyHeader:: 36,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:34:35 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 96ms
2016-11-07 15:34:35 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 37,4  replyHeader:: 37,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:34:35 INFO  RpcRetryingCaller:142 - Call exception, tries=16, retries=35, started=152094 ms ago, cancelled=false, msg=
2016-11-07 15:34:56 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 38,3  replyHeader:: 38,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:34:56 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 77ms
2016-11-07 15:34:56 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 39,4  replyHeader:: 39,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:34:56 INFO  RpcRetryingCaller:142 - Call exception, tries=17, retries=35, started=172334 ms ago, cancelled=false, msg=
2016-11-07 15:35:16 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 40,3  replyHeader:: 40,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:35:16 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 177ms
2016-11-07 15:35:16 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 41,4  replyHeader:: 41,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:35:16 INFO  RpcRetryingCaller:142 - Call exception, tries=18, retries=35, started=192647 ms ago, cancelled=false, msg=
2016-11-07 15:35:36 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 42,3  replyHeader:: 42,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:35:36 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 45ms
2016-11-07 15:35:36 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 43,4  replyHeader:: 43,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:35:36 INFO  RpcRetryingCaller:142 - Call exception, tries=19, retries=35, started=212887 ms ago, cancelled=false, msg=
2016-11-07 15:35:56 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 44,3  replyHeader:: 44,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:35:56 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 187ms
2016-11-07 15:35:56 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 45,4  replyHeader:: 45,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:35:56 INFO  RpcRetryingCaller:142 - Call exception, tries=20, retries=35, started=233201 ms ago, cancelled=false, msg=
2016-11-07 15:36:17 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 46,3  replyHeader:: 46,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:36:17 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 115ms
2016-11-07 15:36:17 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 47,4  replyHeader:: 47,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:36:17 INFO  RpcRetryingCaller:142 - Call exception, tries=21, retries=35, started=253524 ms ago, cancelled=false, msg=
2016-11-07 15:36:37 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 48,3  replyHeader:: 48,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:36:37 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 121ms
2016-11-07 15:36:37 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 49,4  replyHeader:: 49,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:36:37 INFO  RpcRetryingCaller:142 - Call exception, tries=22, retries=35, started=273868 ms ago, cancelled=false, msg=
2016-11-07 15:36:57 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 50,3  replyHeader:: 50,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:36:57 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 67ms
2016-11-07 15:36:57 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 51,4  replyHeader:: 51,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:36:57 INFO  RpcRetryingCaller:142 - Call exception, tries=23, retries=35, started=294029 ms ago, cancelled=false, msg=
2016-11-07 15:37:18 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 52,3  replyHeader:: 52,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:37:18 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 43ms
2016-11-07 15:37:18 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 53,4  replyHeader:: 53,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:37:18 INFO  RpcRetryingCaller:142 - Call exception, tries=24, retries=35, started=314332 ms ago, cancelled=false, msg=
2016-11-07 15:37:38 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 54,3  replyHeader:: 54,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:37:38 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 79ms
2016-11-07 15:37:38 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 55,4  replyHeader:: 55,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:37:38 INFO  RpcRetryingCaller:142 - Call exception, tries=25, retries=35, started=334581 ms ago, cancelled=false, msg=
2016-11-07 15:37:58 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 56,3  replyHeader:: 56,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:37:58 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 118ms
2016-11-07 15:37:58 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 57,4  replyHeader:: 57,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:37:58 INFO  RpcRetryingCaller:142 - Call exception, tries=26, retries=35, started=354793 ms ago, cancelled=false, msg=
2016-11-07 15:38:18 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 58,3  replyHeader:: 58,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:38:18 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 180ms
2016-11-07 15:38:18 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 59,4  replyHeader:: 59,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:38:18 INFO  RpcRetryingCaller:142 - Call exception, tries=27, retries=35, started=375092 ms ago, cancelled=false, msg=
2016-11-07 15:38:39 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 60,3  replyHeader:: 60,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:38:39 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 64ms
2016-11-07 15:38:39 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 61,4  replyHeader:: 61,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:38:39 INFO  RpcRetryingCaller:142 - Call exception, tries=28, retries=35, started=395321 ms ago, cancelled=false, msg=
2016-11-07 15:38:59 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 62,3  replyHeader:: 62,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:38:59 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 63ms
2016-11-07 15:38:59 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 63,4  replyHeader:: 63,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:38:59 INFO  RpcRetryingCaller:142 - Call exception, tries=29, retries=35, started=415488 ms ago, cancelled=false, msg=
2016-11-07 15:39:19 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 64,3  replyHeader:: 64,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:39:19 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 164ms
2016-11-07 15:39:19 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 65,4  replyHeader:: 65,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:39:19 INFO  RpcRetryingCaller:142 - Call exception, tries=30, retries=35, started=435727 ms ago, cancelled=false, msg=
2016-11-07 15:39:39 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 66,3  replyHeader:: 66,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:39:39 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 63ms
2016-11-07 15:39:40 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 67,4  replyHeader:: 67,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:39:40 INFO  RpcRetryingCaller:142 - Call exception, tries=31, retries=35, started=456258 ms ago, cancelled=false, msg=
2016-11-07 15:40:00 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 68,3  replyHeader:: 68,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:40:00 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 186ms
2016-11-07 15:40:00 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 69,4  replyHeader:: 69,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:40:00 INFO  RpcRetryingCaller:142 - Call exception, tries=32, retries=35, started=476964 ms ago, cancelled=false, msg=
2016-11-07 15:40:20 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 70,3  replyHeader:: 70,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:40:20 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 38ms
2016-11-07 15:40:21 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 71,4  replyHeader:: 71,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:40:21 INFO  RpcRetryingCaller:142 - Call exception, tries=33, retries=35, started=497229 ms ago, cancelled=false, msg=
2016-11-07 15:40:41 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 72,3  replyHeader:: 72,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:40:41 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 51ms
2016-11-07 15:40:41 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 73,4  replyHeader:: 73,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:40:41 INFO  RpcRetryingCaller:142 - Call exception, tries=34, retries=35, started=517438 ms ago, cancelled=false, msg=
2016-11-07 15:40:41 ERROR InstrumentLoader:114 - Error connecting to HBase Serverorg.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=35, exceptions:
Mon Nov 07 15:32:04 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:32:04 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:32:04 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:32:05 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:32:05 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:32:06 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:32:09 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:32:13 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:32:23 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:32:33 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:32:44 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:32:54 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:33:14 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:33:35 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:33:55 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:34:15 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:34:35 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:34:56 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:35:16 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:35:36 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:35:56 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:36:17 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:36:37 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:36:57 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:37:18 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:37:38 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:37:58 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:38:18 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:38:39 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:38:59 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:39:19 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:39:40 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:40:00 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:40:21 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:40:41 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d


Process finished with exit code 0

The container is contactable as Zookeeper is running in the same container.
Thanks very much for your help.
Oliver

-----Original Message-----
From: Ted Yu [mailto:yuzhihong@gmail.com]
Sent: 07 November 2016 15:05
To: user@hbase.apache.org
Subject: Re: Can connect to HBase via Java API but can't create table

Can you show more of the UnknownHostException ?

Could this be related to the firewall on the Docker container ?

Cheers

On Mon, Nov 7, 2016 at 6:49 AM, Oliver Buckley-Salmon < oliver.buckley-salmon@db.com> wrote:

> Hi
>
> I am trying to create a table in HBase using the Java API, I can
> connect to Zookeeper
>
> 2016-11-06 15:18:36 INFO  RecoverableZooKeeper:120 - Process
> identifier=hconnection-0x382db087 connecting to ZooKeeper ensemble=
> 138.68.147.208:2181
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09
> GMT
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client environment:host.name
> =olivers-air.default
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> environment:java.version=1.8.0_45
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> environment:java.vendor=Oracle Corporation
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> environment:java.home=/
> Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> environment:java.class.path=/Library/Java/JavaVirtualMachines/jdk1.8.0
> _ 45.jdk/Contents/Home/jre/lib/charsets.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> deploy.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> 45.jdk/Contents/Home/jre/lib/ext/cldrdata.jar:/Library/
> Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/
> lib/ext/dnsns.jar:/Library/Java/JavaVirtualMachines/jdk1.
> 8.0_45.jdk/Contents/Home/jre/lib/ext/jfxrt.jar:/Library/
> Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/
> lib/ext/localedata.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> 45.jdk/Contents/Home/jre/lib/ext/nashorn.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> ext/sunec.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> 45.jdk/Contents/Home/jre/lib/ext/sunjce_provider.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> ext/sunpkcs11.jar:/Library/Java/JavaVirtualMachines/jdk1.
> 8.0_45.jdk/Contents/Home/jre/lib/ext/zipfs.jar:/Library/
> Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/
> lib/javaws.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> 45.jdk/Contents/Home/jre/lib/jce.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> jfr.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> 45.jdk/Contents/Home/jre/lib/jfxswt.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> jsse.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> 45.jdk/Contents/Home/jre/lib/management-agent.jar:/Library/
> Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/
> lib/plugin.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> 45.jdk/Contents/Home/jre/lib/resources.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> rt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> 45.jdk/Contents/Home/lib/ant-javafx.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/dt.
> jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/li
> b/ javafx-mx.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> 45.jdk/Contents/Home/lib/jconsole.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/
> packager.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> 45.jdk/Contents/Home/lib/sa-jdi.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/tools.jar:/Users
> /
> oliverbuckley-salmon/IdeaProjects/sandpit/database/target/classes:/Use
> rs/
> oliverbuckley-salmon/IdeaProjects/sandpit/domain/target/classes:/Users
> / oliverbuckley-salmon/.m2/repository/com/google/code/
> gson/gson/2.6.2/gson-2.6.2.jar:/Users/oliverbuckley-
> salmon/.m2/repository/org/apache/hbase/hbase-client/1.2.
> 3/hbase-client-1.2.3.jar:/Users/oliverbuckley-salmon/.
> m2/repository/org/apache/hbase/hbase-annotations/1.2.3/
> hbase-annotations-1.2.3.jar:/Users/oliverbuckley-salmon/.
> m2/repository/com/github/stephenc/findbugs/findbugs-
> annotations/1.3.9-1/findbugs-annotations-1.3.9-1.jar:/
> Users/oliverbuckley-salmon/.m2/repository/org/apache/
> hbase/hbase-common/1.2.3/hbase-common-1.2.3.jar:/Users/
> oliverbuckley-salmon/.m2/repository/commons-collections/commons-
> collections/3.2.2/commons-collections-3.2.2.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/mortbay/jetty/
> jetty-util/6.1.26/jetty-util-6.1.26.jar:/Users/oliverbuckley-salmon/.m
> 2/
> repository/org/apache/hbase/hbase-protocol/1.2.3/hbase-
> protocol-1.2.3.jar:/Users/oliverbuckley-salmon/.m2/
> repository/commons-codec/commons-codec/1.9/commons-codec-1.9.jar:/User
> s/
> oliverbuckley-salmon/.m2/repository/commons-io/commons-
> io/2.4/commons-io-2.4.jar:/Users/oliverbuckley-salmon/.
> m2/repository/commons-lang/commons-lang/2.6/commons-lang-
> 2.6.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-
> logging/commons-logging/1.2/commons-logging-1.2.jar:/
> Users/oliverbuckley-salmon/.m2/repository/com/google/
> guava/guava/12.0.1/guava-12.0.1.jar:/Users/oliverbuckley-
> salmon/.m2/repository/com/google/protobuf/protobuf-java/
> 2.5.0/protobuf-java-2.5.0.jar:/Users/oliverbuckley-salmon/.
> m2/repository/io/netty/netty-all/4.0.23.Final/netty-all-4.
> 0.23.Final.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/
> zookeeper/zookeeper/3.4.6/zookeeper-3.4.6.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/slf4j/slf4j-
> api/1.6.1/slf4j-api-1.6.1.jar:/Users/oliverbuckley-salmon/.
> m2/repository/org/slf4j/slf4j-log4j12/1.6.1/slf4j-log4j12-1.
> 6.1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> apache/htrace/htrace-core/3.1.0-incubating/htrace-core-3.1.
> 0-incubating.jar:/Users/oliverbuckley-salmon/.m2/repository/org/codeha
> us/ jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.
> 13.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.
> 9.13.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> jruby/jcodings/jcodings/1.0.8/jcodings-1.0.8.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/jruby/joni/
> joni/2.1.2/joni-2.1.2.jar:/Users/oliverbuckley-salmon/.
> m2/repository/com/yammer/metrics/metrics-core/2.2.0/
> metrics-core-2.2.0.jar:/Users/oliverbuckley-salmon/.m2/
> repository/org/apache/hadoop/hadoop-auth/2.5.1/hadoop-auth-
> 2.5.1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/
> httpcomponents/httpclient/4.2.5/httpclient-4.2.5.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/apache/
> httpcomponents/httpcore/4.2.4/httpcore-4.2.4.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/apache/directory/server/apache
> ds-
> kerberos-codec/2.0.0-M15/apacheds-kerberos-codec-2.0.0-
> M15.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> apache/directory/server/apacheds-i18n/2.0.0-M15/
> apacheds-i18n-2.0.0-M15.jar:/Users/oliverbuckley-salmon/.
> m2/repository/org/apache/directory/api/api-asn1-api/1.
> 0.0-M20/api-asn1-api-1.0.0-M20.jar:/Users/oliverbuckley-
> salmon/.m2/repository/org/apache/directory/api/api-util/
> 1.0.0-M20/api-util-1.0.0-M20.jar:/Users/oliverbuckley-
> salmon/.m2/repository/org/apache/hadoop/hadoop-common/2.
> 5.1/hadoop-common-2.5.1.jar:/Users/oliverbuckley-salmon/.
> m2/repository/org/apache/hadoop/hadoop-annotations/2.5.
> 1/hadoop-annotations-2.5.1.jar:/Users/oliverbuckley-
> salmon/.m2/repository/commons-cli/commons-cli/1.2/commons-
> cli-1.2.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/comm
> ons/ commons-math3/3.1.1/commons-math3-3.1.1.jar:/Users/
> oliverbuckley-salmon/.m2/repository/xmlenc/xmlenc/0.52/
> xmlenc-0.52.jar:/Users/oliverbuckley-salmon/.m2/
> repository/commons-httpclient/commons-httpclient/3.1/
> commons-httpclient-3.1.jar:/Users/oliverbuckley-salmon/.
> m2/repository/commons-net/commons-net/3.1/commons-net-3.
> 1.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-
> el/commons-el/1.0/commons-el-1.0.jar:/Users/oliverbuckley-
> salmon/.m2/repository/commons-configuration/commons-
> configuration/1.6/commons-configuration-1.6.jar:/Users/
> oliverbuckley-salmon/.m2/repository/commons-digester/
> commons-digester/1.8/commons-digester-1.8.jar:/Users/
> oliverbuckley-salmon/.m2/repository/commons-beanutils/
> commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar:/
> Users/oliverbuckley-salmon/.m2/repository/commons-
> beanutils/commons-beanutils-core/1.8.0/commons-beanutils-
> core-1.8.0.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/a
> vro/
> avro/1.7.4/avro-1.7.4.jar:/Users/oliverbuckley-salmon/.m2/repository/c
> om/ thoughtworks/paranamer/paranamer/2.3/paranamer-2.3.
> jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> xerial/snappy/snappy-java/1.0.4.1/snappy-java-1.0.4.1.jar:/
> Users/oliverbuckley-salmon/.m2/repository/com/jcraft/jsch/
> 0.1.42/jsch-0.1.42.jar:/Users/oliverbuckley-salmon/.m2/
> repository/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar:/Use
> rs/ oliverbuckley-salmon/.m2/repository/org/apache/commons/
> commons-compress/1.4.1/commons-compress-1.4.1.jar:/
> Users/oliverbuckley-salmon/.m2/repository/org/tukaani/xz/
> 1.0/xz-1.0.jar:/Users/oliverbuckley-salmon/.m2/
> repository/org/apache/hadoop/hadoop-mapreduce-client-core/
> 2.5.1/hadoop-mapreduce-client-core-2.5.1.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/apache/hadoop/
> hadoop-yarn-common/2.5.1/hadoop-yarn-common-2.5.1.jar:/
> Users/oliverbuckley-salmon/.m2/repository/org/apache/
> hadoop/hadoop-yarn-api/2.5.1/hadoop-yarn-api-2.5.1.jar:/
> Users/oliverbuckley-salmon/.m2/repository/javax/xml/bind/
> jaxb-api/2.2.2/jaxb-api-2.2.2.jar:/Users/oliverbuckley-
> salmon/.m2/repository/javax/xml/stream/stax-api/1.0-2/
> stax-api-1.0-2.jar:/Users/oliverbuckley-salmon/.m2/
> repository/javax/activation/activation/1.1/activation-1.1.
> jar:/Users/oliverbuckley-salmon/.m2/repository/io/
> netty/netty/3.6.2.Final/netty-3.6.2.Final.jar:/Users/
> oliverbuckley-salmon/.m2/repository/log4j/log4j/1.2.17/
> log4j-1.2.17.jar:/Users/oliverbuckley-salmon/.m2/repository/com/hazelc
> ast/ hazelcast-all/3.7.2/hazelcast-all-3.7.2.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/apache/curator/
> curator-framework/2.10.0/curator-framework-2.10.0.jar:/
> Users/oliverbuckley-salmon/.m2/repository/org/apache/
> curator/curator-client/2.10.0/curator-client-2.10.0.jar:/
> Users/oliverbuckley-salmon/.m2/repository/org/apache/
> curator/curator-x-discovery/2.10.0/curator-x-discovery-2.10.
> 0.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> apache/curator/curator-recipes/2.10.0/curator-recipes-2.10.0.jar:/User
> s/ oliverbuckley-salmon/.m2/repository/org/apache/curator/
> curator-test/2.10.0/curator-test-2.10.0.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/javassist/
> javassist/3.18.1-GA/javassist-3.18.1-GA.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/apache/commons/
> commons-math/2.2/commons-math-2.2.jar:/Users/oliverbuckley-
> salmon/.m2/repository/com/hazelcast/hazelcast-zookeeper/
> 3.6.1/hazelcast-zookeeper-3.6.1.jar:/Users/oliverbuckley-
> salmon/.m2/repository/joda-time/joda-time/2.9.4/joda-
> time-2.9.4.jar:/Applications/IntelliJ
> IDEA.app/Contents/lib/idea_rt.jar
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> environment:java.library.path=/Users/oliverbuckley-salmon/
> Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java
> / Extensions:/System/Library/Java/Extensions:/usr/lib/java:.
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> environment:java.io.tmpdir=/var/folders/sx/g9vbcw9d3j54gtj89n57g1fw000
> 0gn
> /T/
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> environment:java.compiler=<NA>
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> environment:os.name=Mac OS X
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> environment:os.arch=x86_64
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> environment:os.version=10.11.6
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> environment:user.name= oliverbuckley-salmon
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> environment:user.home=/Users/oliverbuckley-salmon
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> environment:user.dir=/Users/oliverbuckley-salmon/IdeaProjects/sandpit
> 2016-11-06 15:18:36 INFO  ZooKeeper:438 - Initiating client
> connection,
> connectString=138.68.147.208:2181 sessionTimeout=90000
> watcher=hconnection-0x382db0870x0, quorum=138.68.147.208:2181,
> baseZNode=/hbase
> 2016-11-06 15:18:37 INFO  ClientCnxn:975 - Opening socket connection
> to server 138.68.147.208/138.68.147.208:2181. Will not attempt to
> authenticate using SASL (unknown error)
> 2016-11-06 15:18:37 INFO  ClientCnxn:852 - Socket connection
> established to 138.68.147.208/138.68.147.208:2181, initiating session
> 2016-11-06 15:18:37 INFO  ClientCnxn:1235 - Session establishment
> complete on server 138.68.147.208/138.68.147.208:2181, sessionid =
> 0x158273e5275001d, negotiated timeout = 90000
>
> I can connect to HBase as I can see it in the debugger, but when I try
> to create a table it fails after 35 retries with
> org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException
>
> I can connect to HBase with the UI and can see the Master and Region
> servers.
>
> My code looks like this
> Configuration hBaseConfig =  HBaseConfiguration.create();
>             hBaseConfig.setInt("timeout", 120000);
>             hBaseConfig.set("hbase.master", hbaseHost + ":60000");
>             hBaseConfig.set("hbase.zookeeper.quorum",zookeeperHost);
>             hBaseConfig.set("hbase.zookeeper.property.clientPort",
> "2181");
>
>             logger.info("Trying to connect to HBase");
>             Connection connection = ConnectionFactory.
> createConnection(hBaseConfig);
>             Admin admin = connection.getAdmin();
>             logger.info("Connected to HBase");
>
>             logger.info("Trying to create tables");
>             createSchemaTables(admin);
>             logger.info("Tables created");
>
> CreateSchemaTables looks like this and the code fails and retries at
> admin.createTable(table); public static void createSchemaTables(Admin
> admin) throws IOException {
>
>
>
>         HTableDescriptor table = new HTableDescriptor(TableName.
> valueOf(tableName));
>         HColumnDescriptor cf = new HColumnDescriptor(columnFamily).
> setCompressionType(Algorithm.NONE);
>
>         table.addFamily(cf);
>
>         System.out.print("Creating table. ");
>         admin.createTable(table);
>         System.out.println(" Done.");
>
> The client is running on my Mac Air and Hbase is running in a Docker
> container (nerdammer/hbase) Digital Ocean.
>
> Does anyone have any idea why I can connect to HBase but not create tables?
>
> Thanks in advance for your help, Oliver
>
>
>
>
> ---
> This e-mail may contain confidential and/or privileged information. If
> you are not the intended recipient (or have received this e-mail in
> error) please notify the sender immediately and delete this e-mail.
> Any unauthorized copying, disclosure or distribution of the material
> in this e-mail is strictly forbidden.
>
> Please refer to https://www.db.com/disclosures for additional EU
> corporate and regulatory disclosures and to http://www.db.com/
> unitedkingdom/content/privacy.htm for information about privacy.
>


---
This e-mail may contain confidential and/or privileged information. If you are not the intended recipient (or have received this e-mail in error) please notify the sender immediately and delete this e-mail. Any unauthorized copying, disclosure or distribution of the material in this e-mail is strictly forbidden.

Please refer to https://www.db.com/disclosures for additional EU corporate and regulatory disclosures and to http://www.db.com/unitedkingdom/content/privacy.htm for information about privacy.


---
This e-mail may contain confidential and/or privileged information. If you are not the intended recipient (or have received this e-mail in error) please notify the sender immediately and delete this e-mail. Any unauthorized copying, disclosure or distribution of the material in this e-mail is strictly forbidden.

Please refer to https://www.db.com/disclosures for additional EU corporate and regulatory disclosures and to http://www.db.com/unitedkingdom/content/privacy.htm for information about privacy.

RE: Can connect to HBase via Java API but can't create table

Posted by Oliver Buckley-Salmon <ol...@db.com>.
Hi,
Here's the log on Debug
2016-11-07 15:32:01 INFO  InstrumentLoader:61 - Trying to connect to HBase
2016-11-07 15:32:01 DEBUG Groups:238 -  Creating new Groups object
2016-11-07 15:32:01 DEBUG NativeCodeLoader:46 - Trying to load the custom-built native-hadoop library...
2016-11-07 15:32:01 DEBUG NativeCodeLoader:55 - Failed to load native-hadoop with error: java.lang.UnsatisfiedLinkError: no hadoop in java.library.path
2016-11-07 15:32:01 DEBUG NativeCodeLoader:56 - java.library.path=/Users/oliverbuckley-salmon/Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java:.
2016-11-07 15:32:01 WARN  NativeCodeLoader:62 - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2016-11-07 15:32:01 DEBUG JniBasedUnixGroupsMappingWithFallback:40 - Falling back to shell based
2016-11-07 15:32:01 DEBUG JniBasedUnixGroupsMappingWithFallback:44 - Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping
2016-11-07 15:32:01 DEBUG Shell:320 - Failed to detect a valid hadoop home directory
java.io.IOException: HADOOP_HOME or hadoop.home.dir are not set.
                at org.apache.hadoop.util.Shell.checkHadoopHome(Shell.java:302)
                at org.apache.hadoop.util.Shell.<clinit>(Shell.java:327)
                at org.apache.hadoop.util.StringUtils.<clinit>(StringUtils.java:78)
                at org.apache.hadoop.security.Groups.parseStaticMapping(Groups.java:93)
                at org.apache.hadoop.security.Groups.<init>(Groups.java:77)
                at org.apache.hadoop.security.Groups.getUserToGroupsMappingService(Groups.java:240)
                at org.apache.hadoop.security.Groups.getUserToGroupsMappingService(Groups.java:225)
                at org.apache.hadoop.hbase.security.UserProvider.<clinit>(UserProvider.java:56)
                at org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:214)
                at org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:119)
                at com.example.projects.database.loaders.InstrumentLoader.main(InstrumentLoader.java:62)
                at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
                at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
                at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
                at java.lang.reflect.Method.invoke(Method.java:497)
                at com.intellij.rt.execution.application.AppMain.main(AppMain.java:147)
2016-11-07 15:32:01 DEBUG Shell:392 - setsid is not available on this machine. So not using it.
2016-11-07 15:32:01 DEBUG Shell:396 - setsid exited with exit code 0
2016-11-07 15:32:01 DEBUG Groups:80 - Group mapping impl=org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback; cacheTimeout=300000; warningDeltaMs=5000
2016-11-07 15:32:02 DEBUG MutableMetricsFactory:42 - field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginSuccess with annotation @org.apache.hadoop.metrics2.annotation.Metric(always=false, about=, sampleName=Ops, type=DEFAULT, value=[Rate of successful kerberos logins and latency (milliseconds)], valueName=Time)
2016-11-07 15:32:02 DEBUG MutableMetricsFactory:42 - field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginFailure with annotation @org.apache.hadoop.metrics2.annotation.Metric(always=false, about=, sampleName=Ops, type=DEFAULT, value=[Rate of failed kerberos logins and latency (milliseconds)], valueName=Time)
2016-11-07 15:32:02 DEBUG MutableMetricsFactory:42 - field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.getGroups with annotation @org.apache.hadoop.metrics2.annotation.Metric(always=false, about=, sampleName=Ops, type=DEFAULT, value=[GetGroups], valueName=Time)
2016-11-07 15:32:02 DEBUG MetricsSystemImpl:221 - UgiMetrics, User and group related metrics
2016-11-07 15:32:02 DEBUG KerberosName:88 - Kerberos krb5 configuration not found, setting default realm to empty
2016-11-07 15:32:02 DEBUG UserGroupInformation:195 - hadoop login
2016-11-07 15:32:02 DEBUG UserGroupInformation:144 - hadoop login commit
2016-11-07 15:32:02 DEBUG UserGroupInformation:174 - using local user:UnixPrincipal: oliverbuckley-salmon
2016-11-07 15:32:02 DEBUG UserGroupInformation:785 - UGI loginUser:oliverbuckley-salmon (auth:SIMPLE)
2016-11-07 15:32:02 INFO  RecoverableZooKeeper:120 - Process identifier=hconnection-0x43d7741f connecting to ZooKeeper ensemble=138.68.147.208:2181
2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT
2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:host.name=172.20.10.3
2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:java.version=1.8.0_45
2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:java.vendor=Oracle Corporation
2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:java.home=/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre
2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:java.class.path=/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/charsets.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/deploy.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/ext/cldrdata.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/ext/dnsns.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/ext/jfxrt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/ext/localedata.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/ext/nashorn.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/ext/sunec.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/ext/sunjce_provider.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/ext/sunpkcs11.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/ext/zipfs.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/javaws.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/jce.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/jfr.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/jfxswt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/jsse.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/management-agent.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/plugin.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/resources.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/rt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/ant-javafx.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/dt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/javafx-mx.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/jconsole.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/packager.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/sa-jdi.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/tools.jar:/Users/oliverbuckley-salmon/IdeaProjects/sandpit/database/target/classes:/Users/oliverbuckley-salmon/IdeaProjects/sandpit/domain/target/classes:/Users/oliverbuckley-salmon/.m2/repository/com/google/code/gson/gson/2.6.2/gson-2.6.2.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/hbase/hbase-client/1.2.3/hbase-client-1.2.3.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/hbase/hbase-annotations/1.2.3/hbase-annotations-1.2.3.jar:/Users/oliverbuckley-salmon/.m2/repository/com/github/stephenc/findbugs/findbugs-annotations/1.3.9-1/findbugs-annotations-1.3.9-1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/hbase/hbase-common/1.2.3/hbase-common-1.2.3.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar:/Users/oliverbuckley-salmon/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/hbase/hbase-protocol/1.2.3/hbase-protocol-1.2.3.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-codec/commons-codec/1.9/commons-codec-1.9.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-logging/commons-logging/1.2/commons-logging-1.2.jar:/Users/oliverbuckley-salmon/.m2/repository/com/google/guava/guava/12.0.1/guava-12.0.1.jar:/Users/oliverbuckley-salmon/.m2/repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar:/Users/oliverbuckley-salmon/.m2/repository/io/netty/netty-all/4.0.23.Final/netty-all-4.0.23.Final.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/zookeeper/zookeeper/3.4.6/zookeeper-3.4.6.jar:/Users/oliverbuckley-salmon/.m2/repository/org/slf4j/slf4j-api/1.6.1/slf4j-api-1.6.1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/slf4j/slf4j-log4j12/1.6.1/slf4j-log4j12-1.6.1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/htrace/htrace-core/3.1.0-incubating/htrace-core-3.1.0-incubating.jar:/Users/oliverbuckley-salmon/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.13.jar:/Users/oliverbuckley-salmon/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar:/Users/oliverbuckley-salmon/.m2/repository/org/jruby/jcodings/jcodings/1.0.8/jcodings-1.0.8.jar:/Users/oliverbuckley-salmon/.m2/repository/org/jruby/joni/joni/2.1.2/joni-2.1.2.jar:/Users/oliverbuckley-salmon/.m2/repository/com/yammer/metrics/metrics-core/2.2.0/metrics-core-2.2.0.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/hadoop/hadoop-auth/2.5.1/hadoop-auth-2.5.1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/httpcomponents/httpclient/4.2.5/httpclient-4.2.5.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/httpcomponents/httpcore/4.2.4/httpcore-4.2.4.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/directory/server/apacheds-kerberos-codec/2.0.0-M15/apacheds-kerberos-codec-2.0.0-M15.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/directory/server/apacheds-i18n/2.0.0-M15/apacheds-i18n-2.0.0-M15.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/directory/api/api-asn1-api/1.0.0-M20/api-asn1-api-1.0.0-M20.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/directory/api/api-util/1.0.0-M20/api-util-1.0.0-M20.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/hadoop/hadoop-common/2.5.1/hadoop-common-2.5.1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/hadoop/hadoop-annotations/2.5.1/hadoop-annotations-2.5.1.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/commons/commons-math3/3.1.1/commons-math3-3.1.1.jar:/Users/oliverbuckley-salmon/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-net/commons-net/3.1/commons-net-3.1.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-el/commons-el/1.0/commons-el-1.0.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-beanutils/commons-beanutils-core/1.8.0/commons-beanutils-core-1.8.0.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/avro/avro/1.7.4/avro-1.7.4.jar:/Users/oliverbuckley-salmon/.m2/repository/com/thoughtworks/paranamer/paranamer/2.3/paranamer-2.3.jar:/Users/oliverbuckley-salmon/.m2/repository/org/xerial/snappy/snappy-java/1.0.4.1/snappy-java-1.0.4.1.jar:/Users/oliverbuckley-salmon/.m2/repository/com/jcraft/jsch/0.1.42/jsch-0.1.42.jar:/Users/oliverbuckley-salmon/.m2/repository/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/commons/commons-compress/1.4.1/commons-compress-1.4.1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/tukaani/xz/1.0/xz-1.0.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.5.1/hadoop-mapreduce-client-core-2.5.1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/hadoop/hadoop-yarn-common/2.5.1/hadoop-yarn-common-2.5.1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/hadoop/hadoop-yarn-api/2.5.1/hadoop-yarn-api-2.5.1.jar:/Users/oliverbuckley-salmon/.m2/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar:/Users/oliverbuckley-salmon/.m2/repository/javax/xml/stream/stax-api/1.0-2/stax-api-1.0-2.jar:/Users/oliverbuckley-salmon/.m2/repository/javax/activation/activation/1.1/activation-1.1.jar:/Users/oliverbuckley-salmon/.m2/repository/io/netty/netty/3.6.2.Final/netty-3.6.2.Final.jar:/Users/oliverbuckley-salmon/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar:/Users/oliverbuckley-salmon/.m2/repository/com/hazelcast/hazelcast-all/3.7.2/hazelcast-all-3.7.2.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/curator/curator-framework/2.10.0/curator-framework-2.10.0.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/curator/curator-client/2.10.0/curator-client-2.10.0.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/curator/curator-x-discovery/2.10.0/curator-x-discovery-2.10.0.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/curator/curator-recipes/2.10.0/curator-recipes-2.10.0.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/curator/curator-test/2.10.0/curator-test-2.10.0.jar:/Users/oliverbuckley-salmon/.m2/repository/org/javassist/javassist/3.18.1-GA/javassist-3.18.1-GA.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/commons/commons-math/2.2/commons-math-2.2.jar:/Users/oliverbuckley-salmon/.m2/repository/com/hazelcast/hazelcast-zookeeper/3.6.1/hazelcast-zookeeper-3.6.1.jar:/Users/oliverbuckley-salmon/.m2/repository/joda-time/joda-time/2.9.4/joda-time-2.9.4.jar:/Applications/IntelliJ IDEA.app/Contents/lib/idea_rt.jar
2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:java.library.path=/Users/oliverbuckley-salmon/Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java:.
2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:java.io.tmpdir=/var/folders/sx/g9vbcw9d3j54gtj89n57g1fw0000gn/T/
2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:java.compiler=<NA>
2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:os.name=Mac OS X
2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:os.arch=x86_64
2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:os.version=10.11.6
2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:user.name=oliverbuckley-salmon
2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:user.home=/Users/oliverbuckley-salmon
2016-11-07 15:32:02 INFO  ZooKeeper:100 - Client environment:user.dir=/Users/oliverbuckley-salmon/IdeaProjects/sandpit
2016-11-07 15:32:02 INFO  ZooKeeper:438 - Initiating client connection, connectString=138.68.147.208:2181 sessionTimeout=90000 watcher=hconnection-0x43d7741f0x0, quorum=138.68.147.208:2181, baseZNode=/hbase
2016-11-07 15:32:02 DEBUG ClientCnxn:102 - zookeeper.disableAutoWatchReset is false
2016-11-07 15:32:02 INFO  ClientCnxn:975 - Opening socket connection to server 138.68.147.208/138.68.147.208:2181. Will not attempt to authenticate using SASL (unknown error)
2016-11-07 15:32:02 INFO  ClientCnxn:852 - Socket connection established to 138.68.147.208/138.68.147.208:2181, initiating session
2016-11-07 15:32:02 DEBUG ClientCnxn:892 - Session establishment request sent on 138.68.147.208/138.68.147.208:2181
2016-11-07 15:32:03 INFO  ClientCnxn:1235 - Session establishment complete on server 138.68.147.208/138.68.147.208:2181, sessionid = 0x1583b2a4dbb000b, negotiated timeout = 90000
2016-11-07 15:32:03 DEBUG ZooKeeperWatcher:602 - hconnection-0x43d7741f0x0, quorum=138.68.147.208:2181, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null
2016-11-07 15:32:03 DEBUG ZooKeeperWatcher:686 - hconnection-0x43d7741f-0x1583b2a4dbb000b connected
2016-11-07 15:32:03 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 1,3  replyHeader:: 1,182,0  request:: '/hbase/hbaseid,F  response:: s{17,132,1478127149340,1478461382903,1,0,0,0,67,0,17}
2016-11-07 15:32:03 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 2,4  replyHeader:: 2,182,0  request:: '/hbase/hbaseid,F  response:: #ffffffff000146d61737465723a363030303040ffffffd533ffffffc7ffffffa430fffffffafffffff550425546a2439353634626535382d616531632d343734352d393638352d346564343830343638636232,s{17,132,1478127149340,1478461382903,1,0,0,0,67,0,17}
2016-11-07 15:32:03 DEBUG AbstractRpcClient:116 - Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f3f4916, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null
2016-11-07 15:32:03 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 3,4  replyHeader:: 3,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:32:03 INFO  InstrumentLoader:64 - Master Info Port: 60010
2016-11-07 15:32:03 INFO  InstrumentLoader:65 - Connected to HBase
2016-11-07 15:32:03 INFO  InstrumentLoader:67 - Trying to create tables
Creating table. 2016-11-07 15:32:03 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 4,3  replyHeader:: 4,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:32:03 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 5,4  replyHeader:: 5,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:32:04 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 6,3  replyHeader:: 6,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:32:04 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 7,4  replyHeader:: 7,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:32:04 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 8,3  replyHeader:: 8,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:32:04 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 9,4  replyHeader:: 9,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:32:05 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 10,3  replyHeader:: 10,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:32:05 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 11,4  replyHeader:: 11,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:32:05 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 12,3  replyHeader:: 12,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:32:05 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 13,4  replyHeader:: 13,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:32:06 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 14,3  replyHeader:: 14,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:32:06 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 15,4  replyHeader:: 15,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:32:09 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 16,3  replyHeader:: 16,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:32:09 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 17,4  replyHeader:: 17,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:32:13 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 18,3  replyHeader:: 18,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:32:13 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 19,4  replyHeader:: 19,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:32:23 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 20,3  replyHeader:: 20,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:32:23 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 280ms
2016-11-07 15:32:23 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 21,4  replyHeader:: 21,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:32:33 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 22,3  replyHeader:: 22,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:32:33 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 254ms
2016-11-07 15:32:33 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 23,4  replyHeader:: 23,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:32:44 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 24,3  replyHeader:: 24,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:32:44 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 261ms
2016-11-07 15:32:44 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 25,4  replyHeader:: 25,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:32:44 INFO  RpcRetryingCaller:142 - Call exception, tries=10, retries=35, started=40432 ms ago, cancelled=false, msg=
2016-11-07 15:32:54 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 26,3  replyHeader:: 26,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:32:54 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 121ms
2016-11-07 15:32:54 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 27,4  replyHeader:: 27,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:32:54 INFO  RpcRetryingCaller:142 - Call exception, tries=11, retries=35, started=50639 ms ago, cancelled=false, msg=
2016-11-07 15:33:14 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 28,3  replyHeader:: 28,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:33:14 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 82ms
2016-11-07 15:33:14 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 29,4  replyHeader:: 29,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:33:14 INFO  RpcRetryingCaller:142 - Call exception, tries=12, retries=35, started=70917 ms ago, cancelled=false, msg=
2016-11-07 15:33:34 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 30,3  replyHeader:: 30,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:33:34 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 100ms
2016-11-07 15:33:35 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 31,4  replyHeader:: 31,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:33:35 INFO  RpcRetryingCaller:142 - Call exception, tries=13, retries=35, started=91231 ms ago, cancelled=false, msg=
2016-11-07 15:33:55 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 32,3  replyHeader:: 32,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:33:55 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 49ms
2016-11-07 15:33:55 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 33,4  replyHeader:: 33,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:33:55 INFO  RpcRetryingCaller:142 - Call exception, tries=14, retries=35, started=111511 ms ago, cancelled=false, msg=
2016-11-07 15:34:15 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 34,3  replyHeader:: 34,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:34:15 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 62ms
2016-11-07 15:34:15 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 35,4  replyHeader:: 35,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:34:15 INFO  RpcRetryingCaller:142 - Call exception, tries=15, retries=35, started=131746 ms ago, cancelled=false, msg=
2016-11-07 15:34:35 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 36,3  replyHeader:: 36,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:34:35 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 96ms
2016-11-07 15:34:35 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 37,4  replyHeader:: 37,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:34:35 INFO  RpcRetryingCaller:142 - Call exception, tries=16, retries=35, started=152094 ms ago, cancelled=false, msg=
2016-11-07 15:34:56 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 38,3  replyHeader:: 38,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:34:56 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 77ms
2016-11-07 15:34:56 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 39,4  replyHeader:: 39,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:34:56 INFO  RpcRetryingCaller:142 - Call exception, tries=17, retries=35, started=172334 ms ago, cancelled=false, msg=
2016-11-07 15:35:16 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 40,3  replyHeader:: 40,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:35:16 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 177ms
2016-11-07 15:35:16 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 41,4  replyHeader:: 41,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:35:16 INFO  RpcRetryingCaller:142 - Call exception, tries=18, retries=35, started=192647 ms ago, cancelled=false, msg=
2016-11-07 15:35:36 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 42,3  replyHeader:: 42,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:35:36 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 45ms
2016-11-07 15:35:36 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 43,4  replyHeader:: 43,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:35:36 INFO  RpcRetryingCaller:142 - Call exception, tries=19, retries=35, started=212887 ms ago, cancelled=false, msg=
2016-11-07 15:35:56 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 44,3  replyHeader:: 44,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:35:56 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 187ms
2016-11-07 15:35:56 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 45,4  replyHeader:: 45,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:35:56 INFO  RpcRetryingCaller:142 - Call exception, tries=20, retries=35, started=233201 ms ago, cancelled=false, msg=
2016-11-07 15:36:17 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 46,3  replyHeader:: 46,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:36:17 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 115ms
2016-11-07 15:36:17 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 47,4  replyHeader:: 47,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:36:17 INFO  RpcRetryingCaller:142 - Call exception, tries=21, retries=35, started=253524 ms ago, cancelled=false, msg=
2016-11-07 15:36:37 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 48,3  replyHeader:: 48,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:36:37 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 121ms
2016-11-07 15:36:37 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 49,4  replyHeader:: 49,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:36:37 INFO  RpcRetryingCaller:142 - Call exception, tries=22, retries=35, started=273868 ms ago, cancelled=false, msg=
2016-11-07 15:36:57 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 50,3  replyHeader:: 50,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:36:57 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 67ms
2016-11-07 15:36:57 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 51,4  replyHeader:: 51,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:36:57 INFO  RpcRetryingCaller:142 - Call exception, tries=23, retries=35, started=294029 ms ago, cancelled=false, msg=
2016-11-07 15:37:18 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 52,3  replyHeader:: 52,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:37:18 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 43ms
2016-11-07 15:37:18 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 53,4  replyHeader:: 53,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:37:18 INFO  RpcRetryingCaller:142 - Call exception, tries=24, retries=35, started=314332 ms ago, cancelled=false, msg=
2016-11-07 15:37:38 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 54,3  replyHeader:: 54,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:37:38 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 79ms
2016-11-07 15:37:38 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 55,4  replyHeader:: 55,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:37:38 INFO  RpcRetryingCaller:142 - Call exception, tries=25, retries=35, started=334581 ms ago, cancelled=false, msg=
2016-11-07 15:37:58 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 56,3  replyHeader:: 56,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:37:58 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 118ms
2016-11-07 15:37:58 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 57,4  replyHeader:: 57,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:37:58 INFO  RpcRetryingCaller:142 - Call exception, tries=26, retries=35, started=354793 ms ago, cancelled=false, msg=
2016-11-07 15:38:18 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 58,3  replyHeader:: 58,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:38:18 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 180ms
2016-11-07 15:38:18 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 59,4  replyHeader:: 59,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:38:18 INFO  RpcRetryingCaller:142 - Call exception, tries=27, retries=35, started=375092 ms ago, cancelled=false, msg=
2016-11-07 15:38:39 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 60,3  replyHeader:: 60,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:38:39 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 64ms
2016-11-07 15:38:39 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 61,4  replyHeader:: 61,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:38:39 INFO  RpcRetryingCaller:142 - Call exception, tries=28, retries=35, started=395321 ms ago, cancelled=false, msg=
2016-11-07 15:38:59 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 62,3  replyHeader:: 62,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:38:59 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 63ms
2016-11-07 15:38:59 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 63,4  replyHeader:: 63,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:38:59 INFO  RpcRetryingCaller:142 - Call exception, tries=29, retries=35, started=415488 ms ago, cancelled=false, msg=
2016-11-07 15:39:19 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 64,3  replyHeader:: 64,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:39:19 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 164ms
2016-11-07 15:39:19 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 65,4  replyHeader:: 65,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:39:19 INFO  RpcRetryingCaller:142 - Call exception, tries=30, retries=35, started=435727 ms ago, cancelled=false, msg=
2016-11-07 15:39:39 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 66,3  replyHeader:: 66,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:39:39 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 63ms
2016-11-07 15:39:40 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 67,4  replyHeader:: 67,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:39:40 INFO  RpcRetryingCaller:142 - Call exception, tries=31, retries=35, started=456258 ms ago, cancelled=false, msg=
2016-11-07 15:40:00 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 68,3  replyHeader:: 68,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:40:00 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 186ms
2016-11-07 15:40:00 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 69,4  replyHeader:: 69,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:40:00 INFO  RpcRetryingCaller:142 - Call exception, tries=32, retries=35, started=476964 ms ago, cancelled=false, msg=
2016-11-07 15:40:20 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 70,3  replyHeader:: 70,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:40:20 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 38ms
2016-11-07 15:40:21 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 71,4  replyHeader:: 71,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:40:21 INFO  RpcRetryingCaller:142 - Call exception, tries=33, retries=35, started=497229 ms ago, cancelled=false, msg=
2016-11-07 15:40:41 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 72,3  replyHeader:: 72,182,0  request:: '/hbase,F  response:: s{3,3,1478127147545,1478127147545,0,20,0,0,0,16,149}
2016-11-07 15:40:41 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x1583b2a4dbb000b after 51ms
2016-11-07 15:40:41 DEBUG ClientCnxn:818 - Reading reply sessionid:0x1583b2a4dbb000b, packet:: clientPath:null serverPath:null finished:false header:: 73,4  replyHeader:: 73,182,0  request:: '/hbase/master,F  response:: #ffffffff000146d61737465723a3630303030ffffff9bffffffd56762ffffff8e522c1650425546a19ac61383236643534323263346410ffffffe0ffffffd4318fffffff8ffffffa5ffffffa9ffffffd9ffffff832b10018ffffffeaffffffd43,s{126,126,1478461382627,1478461382627,0,0,0,96892444867231745,62,0,126}
2016-11-07 15:40:41 INFO  RpcRetryingCaller:142 - Call exception, tries=34, retries=35, started=517438 ms ago, cancelled=false, msg=
2016-11-07 15:40:41 ERROR InstrumentLoader:114 - Error connecting to HBase Serverorg.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=35, exceptions:
Mon Nov 07 15:32:04 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:32:04 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:32:04 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:32:05 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:32:05 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:32:06 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:32:09 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:32:13 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:32:23 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:32:33 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:32:44 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:32:54 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:33:14 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:33:35 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:33:55 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:34:15 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:34:35 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:34:56 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:35:16 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:35:36 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:35:56 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:36:17 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:36:37 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:36:57 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:37:18 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:37:38 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:37:58 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:38:18 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:38:39 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:38:59 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:39:19 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:39:40 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:40:00 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:40:21 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d
Mon Nov 07 15:40:41 GMT 2016, RpcRetryingCaller{globalStartTime=1478532723784, pause=100, retries=35}, org.apache.hadoop.hbase.MasterNotRunningException: java.net.UnknownHostException: a826d5422c4d


Process finished with exit code 0

The container is contactable as Zookeeper is running in the same container.
Thanks very much for your help.
Oliver

-----Original Message-----
From: Ted Yu [mailto:yuzhihong@gmail.com]
Sent: 07 November 2016 15:05
To: user@hbase.apache.org
Subject: Re: Can connect to HBase via Java API but can't create table

Can you show more of the UnknownHostException ?

Could this be related to the firewall on the Docker container ?

Cheers

On Mon, Nov 7, 2016 at 6:49 AM, Oliver Buckley-Salmon < oliver.buckley-salmon@db.com> wrote:

> Hi
>
> I am trying to create a table in HBase using the Java API, I can
> connect to Zookeeper
>
> 2016-11-06 15:18:36 INFO  RecoverableZooKeeper:120 - Process
> identifier=hconnection-0x382db087 connecting to ZooKeeper ensemble=
> 138.68.147.208:2181
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09
> GMT
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client environment:host.name
> =olivers-air.default
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> environment:java.version=1.8.0_45
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> environment:java.vendor=Oracle Corporation
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> environment:java.home=/
> Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> environment:java.class.path=/Library/Java/JavaVirtualMachines/jdk1.8.0
> _ 45.jdk/Contents/Home/jre/lib/charsets.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> deploy.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> 45.jdk/Contents/Home/jre/lib/ext/cldrdata.jar:/Library/
> Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/
> lib/ext/dnsns.jar:/Library/Java/JavaVirtualMachines/jdk1.
> 8.0_45.jdk/Contents/Home/jre/lib/ext/jfxrt.jar:/Library/
> Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/
> lib/ext/localedata.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> 45.jdk/Contents/Home/jre/lib/ext/nashorn.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> ext/sunec.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> 45.jdk/Contents/Home/jre/lib/ext/sunjce_provider.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> ext/sunpkcs11.jar:/Library/Java/JavaVirtualMachines/jdk1.
> 8.0_45.jdk/Contents/Home/jre/lib/ext/zipfs.jar:/Library/
> Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/
> lib/javaws.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> 45.jdk/Contents/Home/jre/lib/jce.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> jfr.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> 45.jdk/Contents/Home/jre/lib/jfxswt.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> jsse.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> 45.jdk/Contents/Home/jre/lib/management-agent.jar:/Library/
> Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/
> lib/plugin.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> 45.jdk/Contents/Home/jre/lib/resources.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> rt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> 45.jdk/Contents/Home/lib/ant-javafx.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/dt.
> jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/li
> b/ javafx-mx.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> 45.jdk/Contents/Home/lib/jconsole.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/
> packager.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> 45.jdk/Contents/Home/lib/sa-jdi.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/tools.jar:/Users
> /
> oliverbuckley-salmon/IdeaProjects/sandpit/database/target/classes:/Use
> rs/
> oliverbuckley-salmon/IdeaProjects/sandpit/domain/target/classes:/Users
> / oliverbuckley-salmon/.m2/repository/com/google/code/
> gson/gson/2.6.2/gson-2.6.2.jar:/Users/oliverbuckley-
> salmon/.m2/repository/org/apache/hbase/hbase-client/1.2.
> 3/hbase-client-1.2.3.jar:/Users/oliverbuckley-salmon/.
> m2/repository/org/apache/hbase/hbase-annotations/1.2.3/
> hbase-annotations-1.2.3.jar:/Users/oliverbuckley-salmon/.
> m2/repository/com/github/stephenc/findbugs/findbugs-
> annotations/1.3.9-1/findbugs-annotations-1.3.9-1.jar:/
> Users/oliverbuckley-salmon/.m2/repository/org/apache/
> hbase/hbase-common/1.2.3/hbase-common-1.2.3.jar:/Users/
> oliverbuckley-salmon/.m2/repository/commons-collections/commons-
> collections/3.2.2/commons-collections-3.2.2.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/mortbay/jetty/
> jetty-util/6.1.26/jetty-util-6.1.26.jar:/Users/oliverbuckley-salmon/.m
> 2/
> repository/org/apache/hbase/hbase-protocol/1.2.3/hbase-
> protocol-1.2.3.jar:/Users/oliverbuckley-salmon/.m2/
> repository/commons-codec/commons-codec/1.9/commons-codec-1.9.jar:/User
> s/
> oliverbuckley-salmon/.m2/repository/commons-io/commons-
> io/2.4/commons-io-2.4.jar:/Users/oliverbuckley-salmon/.
> m2/repository/commons-lang/commons-lang/2.6/commons-lang-
> 2.6.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-
> logging/commons-logging/1.2/commons-logging-1.2.jar:/
> Users/oliverbuckley-salmon/.m2/repository/com/google/
> guava/guava/12.0.1/guava-12.0.1.jar:/Users/oliverbuckley-
> salmon/.m2/repository/com/google/protobuf/protobuf-java/
> 2.5.0/protobuf-java-2.5.0.jar:/Users/oliverbuckley-salmon/.
> m2/repository/io/netty/netty-all/4.0.23.Final/netty-all-4.
> 0.23.Final.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/
> zookeeper/zookeeper/3.4.6/zookeeper-3.4.6.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/slf4j/slf4j-
> api/1.6.1/slf4j-api-1.6.1.jar:/Users/oliverbuckley-salmon/.
> m2/repository/org/slf4j/slf4j-log4j12/1.6.1/slf4j-log4j12-1.
> 6.1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> apache/htrace/htrace-core/3.1.0-incubating/htrace-core-3.1.
> 0-incubating.jar:/Users/oliverbuckley-salmon/.m2/repository/org/codeha
> us/ jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.
> 13.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.
> 9.13.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> jruby/jcodings/jcodings/1.0.8/jcodings-1.0.8.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/jruby/joni/
> joni/2.1.2/joni-2.1.2.jar:/Users/oliverbuckley-salmon/.
> m2/repository/com/yammer/metrics/metrics-core/2.2.0/
> metrics-core-2.2.0.jar:/Users/oliverbuckley-salmon/.m2/
> repository/org/apache/hadoop/hadoop-auth/2.5.1/hadoop-auth-
> 2.5.1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/
> httpcomponents/httpclient/4.2.5/httpclient-4.2.5.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/apache/
> httpcomponents/httpcore/4.2.4/httpcore-4.2.4.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/apache/directory/server/apache
> ds-
> kerberos-codec/2.0.0-M15/apacheds-kerberos-codec-2.0.0-
> M15.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> apache/directory/server/apacheds-i18n/2.0.0-M15/
> apacheds-i18n-2.0.0-M15.jar:/Users/oliverbuckley-salmon/.
> m2/repository/org/apache/directory/api/api-asn1-api/1.
> 0.0-M20/api-asn1-api-1.0.0-M20.jar:/Users/oliverbuckley-
> salmon/.m2/repository/org/apache/directory/api/api-util/
> 1.0.0-M20/api-util-1.0.0-M20.jar:/Users/oliverbuckley-
> salmon/.m2/repository/org/apache/hadoop/hadoop-common/2.
> 5.1/hadoop-common-2.5.1.jar:/Users/oliverbuckley-salmon/.
> m2/repository/org/apache/hadoop/hadoop-annotations/2.5.
> 1/hadoop-annotations-2.5.1.jar:/Users/oliverbuckley-
> salmon/.m2/repository/commons-cli/commons-cli/1.2/commons-
> cli-1.2.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/comm
> ons/ commons-math3/3.1.1/commons-math3-3.1.1.jar:/Users/
> oliverbuckley-salmon/.m2/repository/xmlenc/xmlenc/0.52/
> xmlenc-0.52.jar:/Users/oliverbuckley-salmon/.m2/
> repository/commons-httpclient/commons-httpclient/3.1/
> commons-httpclient-3.1.jar:/Users/oliverbuckley-salmon/.
> m2/repository/commons-net/commons-net/3.1/commons-net-3.
> 1.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-
> el/commons-el/1.0/commons-el-1.0.jar:/Users/oliverbuckley-
> salmon/.m2/repository/commons-configuration/commons-
> configuration/1.6/commons-configuration-1.6.jar:/Users/
> oliverbuckley-salmon/.m2/repository/commons-digester/
> commons-digester/1.8/commons-digester-1.8.jar:/Users/
> oliverbuckley-salmon/.m2/repository/commons-beanutils/
> commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar:/
> Users/oliverbuckley-salmon/.m2/repository/commons-
> beanutils/commons-beanutils-core/1.8.0/commons-beanutils-
> core-1.8.0.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/a
> vro/
> avro/1.7.4/avro-1.7.4.jar:/Users/oliverbuckley-salmon/.m2/repository/c
> om/ thoughtworks/paranamer/paranamer/2.3/paranamer-2.3.
> jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> xerial/snappy/snappy-java/1.0.4.1/snappy-java-1.0.4.1.jar:/
> Users/oliverbuckley-salmon/.m2/repository/com/jcraft/jsch/
> 0.1.42/jsch-0.1.42.jar:/Users/oliverbuckley-salmon/.m2/
> repository/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar:/Use
> rs/ oliverbuckley-salmon/.m2/repository/org/apache/commons/
> commons-compress/1.4.1/commons-compress-1.4.1.jar:/
> Users/oliverbuckley-salmon/.m2/repository/org/tukaani/xz/
> 1.0/xz-1.0.jar:/Users/oliverbuckley-salmon/.m2/
> repository/org/apache/hadoop/hadoop-mapreduce-client-core/
> 2.5.1/hadoop-mapreduce-client-core-2.5.1.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/apache/hadoop/
> hadoop-yarn-common/2.5.1/hadoop-yarn-common-2.5.1.jar:/
> Users/oliverbuckley-salmon/.m2/repository/org/apache/
> hadoop/hadoop-yarn-api/2.5.1/hadoop-yarn-api-2.5.1.jar:/
> Users/oliverbuckley-salmon/.m2/repository/javax/xml/bind/
> jaxb-api/2.2.2/jaxb-api-2.2.2.jar:/Users/oliverbuckley-
> salmon/.m2/repository/javax/xml/stream/stax-api/1.0-2/
> stax-api-1.0-2.jar:/Users/oliverbuckley-salmon/.m2/
> repository/javax/activation/activation/1.1/activation-1.1.
> jar:/Users/oliverbuckley-salmon/.m2/repository/io/
> netty/netty/3.6.2.Final/netty-3.6.2.Final.jar:/Users/
> oliverbuckley-salmon/.m2/repository/log4j/log4j/1.2.17/
> log4j-1.2.17.jar:/Users/oliverbuckley-salmon/.m2/repository/com/hazelc
> ast/ hazelcast-all/3.7.2/hazelcast-all-3.7.2.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/apache/curator/
> curator-framework/2.10.0/curator-framework-2.10.0.jar:/
> Users/oliverbuckley-salmon/.m2/repository/org/apache/
> curator/curator-client/2.10.0/curator-client-2.10.0.jar:/
> Users/oliverbuckley-salmon/.m2/repository/org/apache/
> curator/curator-x-discovery/2.10.0/curator-x-discovery-2.10.
> 0.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> apache/curator/curator-recipes/2.10.0/curator-recipes-2.10.0.jar:/User
> s/ oliverbuckley-salmon/.m2/repository/org/apache/curator/
> curator-test/2.10.0/curator-test-2.10.0.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/javassist/
> javassist/3.18.1-GA/javassist-3.18.1-GA.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/apache/commons/
> commons-math/2.2/commons-math-2.2.jar:/Users/oliverbuckley-
> salmon/.m2/repository/com/hazelcast/hazelcast-zookeeper/
> 3.6.1/hazelcast-zookeeper-3.6.1.jar:/Users/oliverbuckley-
> salmon/.m2/repository/joda-time/joda-time/2.9.4/joda-
> time-2.9.4.jar:/Applications/IntelliJ
> IDEA.app/Contents/lib/idea_rt.jar
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> environment:java.library.path=/Users/oliverbuckley-salmon/
> Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java
> / Extensions:/System/Library/Java/Extensions:/usr/lib/java:.
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> environment:java.io.tmpdir=/var/folders/sx/g9vbcw9d3j54gtj89n57g1fw000
> 0gn
> /T/
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> environment:java.compiler=<NA>
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> environment:os.name=Mac OS X
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> environment:os.arch=x86_64
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> environment:os.version=10.11.6
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> environment:user.name= oliverbuckley-salmon
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> environment:user.home=/Users/oliverbuckley-salmon
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> environment:user.dir=/Users/oliverbuckley-salmon/IdeaProjects/sandpit
> 2016-11-06 15:18:36 INFO  ZooKeeper:438 - Initiating client
> connection,
> connectString=138.68.147.208:2181 sessionTimeout=90000
> watcher=hconnection-0x382db0870x0, quorum=138.68.147.208:2181,
> baseZNode=/hbase
> 2016-11-06 15:18:37 INFO  ClientCnxn:975 - Opening socket connection
> to server 138.68.147.208/138.68.147.208:2181. Will not attempt to
> authenticate using SASL (unknown error)
> 2016-11-06 15:18:37 INFO  ClientCnxn:852 - Socket connection
> established to 138.68.147.208/138.68.147.208:2181, initiating session
> 2016-11-06 15:18:37 INFO  ClientCnxn:1235 - Session establishment
> complete on server 138.68.147.208/138.68.147.208:2181, sessionid =
> 0x158273e5275001d, negotiated timeout = 90000
>
> I can connect to HBase as I can see it in the debugger, but when I try
> to create a table it fails after 35 retries with
> org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException
>
> I can connect to HBase with the UI and can see the Master and Region
> servers.
>
> My code looks like this
> Configuration hBaseConfig =  HBaseConfiguration.create();
>             hBaseConfig.setInt("timeout", 120000);
>             hBaseConfig.set("hbase.master", hbaseHost + ":60000");
>             hBaseConfig.set("hbase.zookeeper.quorum",zookeeperHost);
>             hBaseConfig.set("hbase.zookeeper.property.clientPort",
> "2181");
>
>             logger.info("Trying to connect to HBase");
>             Connection connection = ConnectionFactory.
> createConnection(hBaseConfig);
>             Admin admin = connection.getAdmin();
>             logger.info("Connected to HBase");
>
>             logger.info("Trying to create tables");
>             createSchemaTables(admin);
>             logger.info("Tables created");
>
> CreateSchemaTables looks like this and the code fails and retries at
> admin.createTable(table); public static void createSchemaTables(Admin
> admin) throws IOException {
>
>
>
>         HTableDescriptor table = new HTableDescriptor(TableName.
> valueOf(tableName));
>         HColumnDescriptor cf = new HColumnDescriptor(columnFamily).
> setCompressionType(Algorithm.NONE);
>
>         table.addFamily(cf);
>
>         System.out.print("Creating table. ");
>         admin.createTable(table);
>         System.out.println(" Done.");
>
> The client is running on my Mac Air and Hbase is running in a Docker
> container (nerdammer/hbase) Digital Ocean.
>
> Does anyone have any idea why I can connect to HBase but not create tables?
>
> Thanks in advance for your help, Oliver
>
>
>
>
> ---
> This e-mail may contain confidential and/or privileged information. If
> you are not the intended recipient (or have received this e-mail in
> error) please notify the sender immediately and delete this e-mail.
> Any unauthorized copying, disclosure or distribution of the material
> in this e-mail is strictly forbidden.
>
> Please refer to https://www.db.com/disclosures for additional EU
> corporate and regulatory disclosures and to http://www.db.com/
> unitedkingdom/content/privacy.htm for information about privacy.
>


---
This e-mail may contain confidential and/or privileged information. If you are not the intended recipient (or have received this e-mail in error) please notify the sender immediately and delete this e-mail. Any unauthorized copying, disclosure or distribution of the material in this e-mail is strictly forbidden.

Please refer to https://www.db.com/disclosures for additional EU corporate and regulatory disclosures and to http://www.db.com/unitedkingdom/content/privacy.htm for information about privacy.

Re: Can connect to HBase via Java API but can't create table

Posted by Ted Yu <yu...@gmail.com>.
Can you show more of the UnknownHostException ?

Could this be related to the firewall on the Docker container ?

Cheers

On Mon, Nov 7, 2016 at 6:49 AM, Oliver Buckley-Salmon <
oliver.buckley-salmon@db.com> wrote:

> Hi
>
> I am trying to create a table in HBase using the Java API, I can connect
> to Zookeeper
>
> 2016-11-06 15:18:36 INFO  RecoverableZooKeeper:120 - Process
> identifier=hconnection-0x382db087 connecting to ZooKeeper ensemble=
> 138.68.147.208:2181
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client environment:host.name
> =olivers-air.default
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> environment:java.version=1.8.0_45
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> environment:java.vendor=Oracle Corporation
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client environment:java.home=/
> Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> environment:java.class.path=/Library/Java/JavaVirtualMachines/jdk1.8.0_
> 45.jdk/Contents/Home/jre/lib/charsets.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> deploy.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> 45.jdk/Contents/Home/jre/lib/ext/cldrdata.jar:/Library/
> Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/
> lib/ext/dnsns.jar:/Library/Java/JavaVirtualMachines/jdk1.
> 8.0_45.jdk/Contents/Home/jre/lib/ext/jfxrt.jar:/Library/
> Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/
> lib/ext/localedata.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> 45.jdk/Contents/Home/jre/lib/ext/nashorn.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> ext/sunec.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> 45.jdk/Contents/Home/jre/lib/ext/sunjce_provider.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> ext/sunpkcs11.jar:/Library/Java/JavaVirtualMachines/jdk1.
> 8.0_45.jdk/Contents/Home/jre/lib/ext/zipfs.jar:/Library/
> Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/
> lib/javaws.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> 45.jdk/Contents/Home/jre/lib/jce.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> jfr.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> 45.jdk/Contents/Home/jre/lib/jfxswt.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> jsse.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> 45.jdk/Contents/Home/jre/lib/management-agent.jar:/Library/
> Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/
> lib/plugin.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> 45.jdk/Contents/Home/jre/lib/resources.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/lib/
> rt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> 45.jdk/Contents/Home/lib/ant-javafx.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/dt.
> jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/
> javafx-mx.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> 45.jdk/Contents/Home/lib/jconsole.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/
> packager.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_
> 45.jdk/Contents/Home/lib/sa-jdi.jar:/Library/Java/
> JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/lib/tools.jar:/Users/
> oliverbuckley-salmon/IdeaProjects/sandpit/database/target/classes:/Users/
> oliverbuckley-salmon/IdeaProjects/sandpit/domain/target/classes:/Users/
> oliverbuckley-salmon/.m2/repository/com/google/code/
> gson/gson/2.6.2/gson-2.6.2.jar:/Users/oliverbuckley-
> salmon/.m2/repository/org/apache/hbase/hbase-client/1.2.
> 3/hbase-client-1.2.3.jar:/Users/oliverbuckley-salmon/.
> m2/repository/org/apache/hbase/hbase-annotations/1.2.3/
> hbase-annotations-1.2.3.jar:/Users/oliverbuckley-salmon/.
> m2/repository/com/github/stephenc/findbugs/findbugs-
> annotations/1.3.9-1/findbugs-annotations-1.3.9-1.jar:/
> Users/oliverbuckley-salmon/.m2/repository/org/apache/
> hbase/hbase-common/1.2.3/hbase-common-1.2.3.jar:/Users/
> oliverbuckley-salmon/.m2/repository/commons-collections/commons-
> collections/3.2.2/commons-collections-3.2.2.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/mortbay/jetty/
> jetty-util/6.1.26/jetty-util-6.1.26.jar:/Users/oliverbuckley-salmon/.m2/
> repository/org/apache/hbase/hbase-protocol/1.2.3/hbase-
> protocol-1.2.3.jar:/Users/oliverbuckley-salmon/.m2/
> repository/commons-codec/commons-codec/1.9/commons-codec-1.9.jar:/Users/
> oliverbuckley-salmon/.m2/repository/commons-io/commons-
> io/2.4/commons-io-2.4.jar:/Users/oliverbuckley-salmon/.
> m2/repository/commons-lang/commons-lang/2.6/commons-lang-
> 2.6.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-
> logging/commons-logging/1.2/commons-logging-1.2.jar:/
> Users/oliverbuckley-salmon/.m2/repository/com/google/
> guava/guava/12.0.1/guava-12.0.1.jar:/Users/oliverbuckley-
> salmon/.m2/repository/com/google/protobuf/protobuf-java/
> 2.5.0/protobuf-java-2.5.0.jar:/Users/oliverbuckley-salmon/.
> m2/repository/io/netty/netty-all/4.0.23.Final/netty-all-4.
> 0.23.Final.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/
> zookeeper/zookeeper/3.4.6/zookeeper-3.4.6.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/slf4j/slf4j-
> api/1.6.1/slf4j-api-1.6.1.jar:/Users/oliverbuckley-salmon/.
> m2/repository/org/slf4j/slf4j-log4j12/1.6.1/slf4j-log4j12-1.
> 6.1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> apache/htrace/htrace-core/3.1.0-incubating/htrace-core-3.1.
> 0-incubating.jar:/Users/oliverbuckley-salmon/.m2/repository/org/codehaus/
> jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.
> 13.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.
> 9.13.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> jruby/jcodings/jcodings/1.0.8/jcodings-1.0.8.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/jruby/joni/
> joni/2.1.2/joni-2.1.2.jar:/Users/oliverbuckley-salmon/.
> m2/repository/com/yammer/metrics/metrics-core/2.2.0/
> metrics-core-2.2.0.jar:/Users/oliverbuckley-salmon/.m2/
> repository/org/apache/hadoop/hadoop-auth/2.5.1/hadoop-auth-
> 2.5.1.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/
> httpcomponents/httpclient/4.2.5/httpclient-4.2.5.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/apache/
> httpcomponents/httpcore/4.2.4/httpcore-4.2.4.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/apache/directory/server/apacheds-
> kerberos-codec/2.0.0-M15/apacheds-kerberos-codec-2.0.0-
> M15.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> apache/directory/server/apacheds-i18n/2.0.0-M15/
> apacheds-i18n-2.0.0-M15.jar:/Users/oliverbuckley-salmon/.
> m2/repository/org/apache/directory/api/api-asn1-api/1.
> 0.0-M20/api-asn1-api-1.0.0-M20.jar:/Users/oliverbuckley-
> salmon/.m2/repository/org/apache/directory/api/api-util/
> 1.0.0-M20/api-util-1.0.0-M20.jar:/Users/oliverbuckley-
> salmon/.m2/repository/org/apache/hadoop/hadoop-common/2.
> 5.1/hadoop-common-2.5.1.jar:/Users/oliverbuckley-salmon/.
> m2/repository/org/apache/hadoop/hadoop-annotations/2.5.
> 1/hadoop-annotations-2.5.1.jar:/Users/oliverbuckley-
> salmon/.m2/repository/commons-cli/commons-cli/1.2/commons-
> cli-1.2.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/commons/
> commons-math3/3.1.1/commons-math3-3.1.1.jar:/Users/
> oliverbuckley-salmon/.m2/repository/xmlenc/xmlenc/0.52/
> xmlenc-0.52.jar:/Users/oliverbuckley-salmon/.m2/
> repository/commons-httpclient/commons-httpclient/3.1/
> commons-httpclient-3.1.jar:/Users/oliverbuckley-salmon/.
> m2/repository/commons-net/commons-net/3.1/commons-net-3.
> 1.jar:/Users/oliverbuckley-salmon/.m2/repository/commons-
> el/commons-el/1.0/commons-el-1.0.jar:/Users/oliverbuckley-
> salmon/.m2/repository/commons-configuration/commons-
> configuration/1.6/commons-configuration-1.6.jar:/Users/
> oliverbuckley-salmon/.m2/repository/commons-digester/
> commons-digester/1.8/commons-digester-1.8.jar:/Users/
> oliverbuckley-salmon/.m2/repository/commons-beanutils/
> commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar:/
> Users/oliverbuckley-salmon/.m2/repository/commons-
> beanutils/commons-beanutils-core/1.8.0/commons-beanutils-
> core-1.8.0.jar:/Users/oliverbuckley-salmon/.m2/repository/org/apache/avro/
> avro/1.7.4/avro-1.7.4.jar:/Users/oliverbuckley-salmon/.m2/repository/com/
> thoughtworks/paranamer/paranamer/2.3/paranamer-2.3.
> jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> xerial/snappy/snappy-java/1.0.4.1/snappy-java-1.0.4.1.jar:/
> Users/oliverbuckley-salmon/.m2/repository/com/jcraft/jsch/
> 0.1.42/jsch-0.1.42.jar:/Users/oliverbuckley-salmon/.m2/
> repository/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/apache/commons/
> commons-compress/1.4.1/commons-compress-1.4.1.jar:/
> Users/oliverbuckley-salmon/.m2/repository/org/tukaani/xz/
> 1.0/xz-1.0.jar:/Users/oliverbuckley-salmon/.m2/
> repository/org/apache/hadoop/hadoop-mapreduce-client-core/
> 2.5.1/hadoop-mapreduce-client-core-2.5.1.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/apache/hadoop/
> hadoop-yarn-common/2.5.1/hadoop-yarn-common-2.5.1.jar:/
> Users/oliverbuckley-salmon/.m2/repository/org/apache/
> hadoop/hadoop-yarn-api/2.5.1/hadoop-yarn-api-2.5.1.jar:/
> Users/oliverbuckley-salmon/.m2/repository/javax/xml/bind/
> jaxb-api/2.2.2/jaxb-api-2.2.2.jar:/Users/oliverbuckley-
> salmon/.m2/repository/javax/xml/stream/stax-api/1.0-2/
> stax-api-1.0-2.jar:/Users/oliverbuckley-salmon/.m2/
> repository/javax/activation/activation/1.1/activation-1.1.
> jar:/Users/oliverbuckley-salmon/.m2/repository/io/
> netty/netty/3.6.2.Final/netty-3.6.2.Final.jar:/Users/
> oliverbuckley-salmon/.m2/repository/log4j/log4j/1.2.17/
> log4j-1.2.17.jar:/Users/oliverbuckley-salmon/.m2/repository/com/hazelcast/
> hazelcast-all/3.7.2/hazelcast-all-3.7.2.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/apache/curator/
> curator-framework/2.10.0/curator-framework-2.10.0.jar:/
> Users/oliverbuckley-salmon/.m2/repository/org/apache/
> curator/curator-client/2.10.0/curator-client-2.10.0.jar:/
> Users/oliverbuckley-salmon/.m2/repository/org/apache/
> curator/curator-x-discovery/2.10.0/curator-x-discovery-2.10.
> 0.jar:/Users/oliverbuckley-salmon/.m2/repository/org/
> apache/curator/curator-recipes/2.10.0/curator-recipes-2.10.0.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/apache/curator/
> curator-test/2.10.0/curator-test-2.10.0.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/javassist/
> javassist/3.18.1-GA/javassist-3.18.1-GA.jar:/Users/
> oliverbuckley-salmon/.m2/repository/org/apache/commons/
> commons-math/2.2/commons-math-2.2.jar:/Users/oliverbuckley-
> salmon/.m2/repository/com/hazelcast/hazelcast-zookeeper/
> 3.6.1/hazelcast-zookeeper-3.6.1.jar:/Users/oliverbuckley-
> salmon/.m2/repository/joda-time/joda-time/2.9.4/joda-
> time-2.9.4.jar:/Applications/IntelliJ IDEA.app/Contents/lib/idea_rt.jar
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> environment:java.library.path=/Users/oliverbuckley-salmon/
> Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java/
> Extensions:/System/Library/Java/Extensions:/usr/lib/java:.
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> environment:java.io.tmpdir=/var/folders/sx/g9vbcw9d3j54gtj89n57g1fw0000gn
> /T/
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> environment:java.compiler=<NA>
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client environment:os.name=Mac
> OS X
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client environment:os.arch=x86_64
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> environment:os.version=10.11.6
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client environment:user.name=
> oliverbuckley-salmon
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> environment:user.home=/Users/oliverbuckley-salmon
> 2016-11-06 15:18:36 INFO  ZooKeeper:100 - Client
> environment:user.dir=/Users/oliverbuckley-salmon/IdeaProjects/sandpit
> 2016-11-06 15:18:36 INFO  ZooKeeper:438 - Initiating client connection,
> connectString=138.68.147.208:2181 sessionTimeout=90000
> watcher=hconnection-0x382db0870x0, quorum=138.68.147.208:2181,
> baseZNode=/hbase
> 2016-11-06 15:18:37 INFO  ClientCnxn:975 - Opening socket connection to
> server 138.68.147.208/138.68.147.208:2181. Will not attempt to
> authenticate using SASL (unknown error)
> 2016-11-06 15:18:37 INFO  ClientCnxn:852 - Socket connection established
> to 138.68.147.208/138.68.147.208:2181, initiating session
> 2016-11-06 15:18:37 INFO  ClientCnxn:1235 - Session establishment complete
> on server 138.68.147.208/138.68.147.208:2181, sessionid =
> 0x158273e5275001d, negotiated timeout = 90000
>
> I can connect to HBase as I can see it in the debugger, but when I try to
> create a table it fails after 35 retries with
> org.apache.hadoop.hbase.MasterNotRunningException:
> java.net.UnknownHostException
>
> I can connect to HBase with the UI and can see the Master and Region
> servers.
>
> My code looks like this
> Configuration hBaseConfig =  HBaseConfiguration.create();
>             hBaseConfig.setInt("timeout", 120000);
>             hBaseConfig.set("hbase.master", hbaseHost + ":60000");
>             hBaseConfig.set("hbase.zookeeper.quorum",zookeeperHost);
>             hBaseConfig.set("hbase.zookeeper.property.clientPort",
> "2181");
>
>             logger.info("Trying to connect to HBase");
>             Connection connection = ConnectionFactory.
> createConnection(hBaseConfig);
>             Admin admin = connection.getAdmin();
>             logger.info("Connected to HBase");
>
>             logger.info("Trying to create tables");
>             createSchemaTables(admin);
>             logger.info("Tables created");
>
> CreateSchemaTables looks like this and the code fails and retries at
> admin.createTable(table);
> public static void createSchemaTables(Admin admin) throws IOException {
>
>
>
>         HTableDescriptor table = new HTableDescriptor(TableName.
> valueOf(tableName));
>         HColumnDescriptor cf = new HColumnDescriptor(columnFamily).
> setCompressionType(Algorithm.NONE);
>
>         table.addFamily(cf);
>
>         System.out.print("Creating table. ");
>         admin.createTable(table);
>         System.out.println(" Done.");
>
> The client is running on my Mac Air and Hbase is running in a Docker
> container (nerdammer/hbase) Digital Ocean.
>
> Does anyone have any idea why I can connect to HBase but not create tables?
>
> Thanks in advance for your help, Oliver
>
>
>
>
> ---
> This e-mail may contain confidential and/or privileged information. If you
> are not the intended recipient (or have received this e-mail in error)
> please notify the sender immediately and delete this e-mail. Any
> unauthorized copying, disclosure or distribution of the material in this
> e-mail is strictly forbidden.
>
> Please refer to https://www.db.com/disclosures for additional EU
> corporate and regulatory disclosures and to http://www.db.com/
> unitedkingdom/content/privacy.htm for information about privacy.
>