You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@drill.apache.org by Dor Ben Dov <do...@amdocs.com> on 2017/07/31 13:15:28 UTC
exception using drill with CDH 5.8.2
Hi,
I configured drill according to the documentation, which means using the web interface with the following:
{
"type": "hbase",
"config": {
"hbase.zookeeper.quorum": "10.238.64.198",
"hbase.zookeeper.property.clientPort": "2181"
},
"size.calculator.enabled": false,
"enabled": true
}
Trying to use drill with my CDH 5.8.2 and I am receiving the following exception : any ideas?
16:12:34.460 [2680d35f-0f4c-b31a-6476-6b7fc3388089:foreman] ERROR o.a.h.h.z.RecoverableZooKeeper - ZooKeeper exists failed after 4 attempts
16:12:34.461 [2680d35f-0f4c-b31a-6476-6b7fc3388089:foreman] ERROR o.a.h.h.zookeeper.ZooKeeperWatcher - hconnection-0x623090b50x0, quorum=10.238.64.198:2181, baseZNode=/hbase Received unexpected KeeperException, re-throwing exception
org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99) ~[zookeeper-3.4.6.jar:3.4.6-1569965]
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) ~[zookeeper-3.4.6.jar:3.4.6-1569965]
at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045) ~[zookeeper-3.4.6.jar:3.4.6-1569965]
at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.exists(RecoverableZooKeeper.java:221) ~[hbase-client-1.1.3.jar:1.1.3]
at org.apache.hadoop.hbase.zookeeper.ZKUtil.checkExists(ZKUtil.java:541) ~[hbase-client-1.1.3.jar:1.1.3]
at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.checkIfBaseNodeAvailable(ConnectionManager.java:896) [hbase-client-1.1.3.jar:1.1.3]
at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.access$400(ConnectionManager.java:546) [hbase-client-1.1.3.jar:1.1.3]
at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation$StubMaker.makeStubNoRetries(ConnectionManager.java:1484) [hbase-client-1.1.3.jar:1.1.3]
at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation$StubMaker.makeStub(ConnectionManager.java:1525) [hbase-client-1.1.3.jar:1.1.3]
at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation$MasterServiceStubMaker.makeStub(ConnectionManager.java:1554) [hbase-client-1.1.3.jar:1.1.3]
at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.getKeepAliveMasterService(ConnectionManager.java:1705) [hbase-client-1.1.3.jar:1.1.3]
at org.apache.hadoop.hbase.client.MasterCallable.prepare(MasterCallable.java:38) [hbase-client-1.1.3.jar:1.1.3]
at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:124) [hbase-client-1.1.3.jar:1.1.3]
at org.apache.hadoop.hbase.client.HBaseAdmin.executeCallable(HBaseAdmin.java:4036) [hbase-client-1.1.3.jar:1.1.3]
at org.apache.hadoop.hbase.client.HBaseAdmin.getTableDescriptor(HBaseAdmin.java:530) [hbase-client-1.1.3.jar:1.1.3]
at org.apache.drill.exec.store.hbase.DrillHBaseTable.<init>(DrillHBaseTable.java:42) [drill-storage-hbase-1.11.0.jar:1.11.0]
at org.apache.drill.exec.store.hbase.HBaseSchemaFactory$HBaseSchema.getTable(HBaseSchemaFactory.java:75) [drill-storage-hbase-1.11.0.jar:1.11.0]
at org.apache.calcite.jdbc.SimpleCalciteSchema.getTable(SimpleCalciteSchema.java:82) [calcite-core-1.4.0-drill-r21.jar:1.4.0-drill-r21]
at org.apache.calcite.prepare.CalciteCatalogReader.getTableFrom(CalciteCatalogReader.java:119) [calcite-core-1.4.0-drill-r21.jar:1.4.0-drill-r21]
at org.apache.calcite.prepare.CalciteCatalogReader.getTable(CalciteCatalogReader.java:102) [calcite-core-1.4.0-drill-r21.jar:1.4.0-drill-r21]
at org.apache.drill.exec.planner.sql.SqlConverter$DrillCalciteCatalogReader.getTable(SqlConverter.java:484) [drill-java-exec-1.11.0.jar:1.11.0]
at org.apache.drill.exec.planner.sql.SqlConverter$DrillCalciteCatalogReader.getTable(SqlConverter.java:429) [drill-java-exec-1.11.0.jar:1.11.0]
at org.apache.calcite.sql.validate.EmptyScope.getTableNamespace(EmptyScope.java:75) [calcite-core-1.4.0-drill-r21.jar:1.4.0-drill-r21]
at org.apache.calcite.sql.validate.DelegatingScope.getTableNamespace(DelegatingScope.java:124) [calcite-core-1.4.0-drill-r21.jar:1.4.0-drill-r21]
at org.apache.calcite.sql.validate.IdentifierNamespace.validateImpl(IdentifierNamespace.java:104) [calcite-core-1.4.0-drill-r21.jar:1.4.0-drill-r21]
at org.apache.calcite.sql.validate.AbstractNamespace.validate(AbstractNamespace.java:86) [calcite-core-1.4.0-drill-r21.jar:1.4.0-drill-r21]
at org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace(SqlValidatorImpl.java:883) [calcite-core-1.4.0-drill-r21.jar:1.4.0-drill-r21]
at org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery(SqlValidatorImpl.java:869) [calcite-core-1.4.0-drill-r21.jar:1.4.0-drill-r21]
at org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom(SqlValidatorImpl.java:2806) [calcite-core-1.4.0-drill-r21.jar:1.4.0-drill-r21]
at org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom(SqlValidatorImpl.java:2791) [calcite-core-1.4.0-drill-r21.jar:1.4.0-drill-r21]
at org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelect(SqlValidatorImpl.java:3014) [calcite-core-1.4.0-drill-r21.jar:1.4.0-drill-r21]
at org.apache.calcite.sql.validate.SelectNamespace.validateImpl(SelectNamespace.java:60) [calcite-core-1.4.0-drill-r21.jar:1.4.0-drill-r21]
at org.apache.calcite.sql.validate.AbstractNamespace.validate(AbstractNamespace.java:86) [calcite-core-1.4.0-drill-r21.jar:1.4.0-drill-r21]
at org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace(SqlValidatorImpl.java:883) [calcite-core-1.4.0-drill-r21.jar:1.4.0-drill-r21]
at org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery(SqlValidatorImpl.java:869) [calcite-core-1.4.0-drill-r21.jar:1.4.0-drill-r21]
at org.apache.calcite.sql.SqlSelect.validate(SqlSelect.java:210) [calcite-core-1.4.0-drill-r21.jar:1.4.0-drill-r21]
at org.apache.calcite.sql.validate.SqlValidatorImpl.validateScopedExpression(SqlValidatorImpl.java:843) [calcite-core-1.4.0-drill-r21.jar:1.4.0-drill-r21]
at org.apache.calcite.sql.validate.SqlValidatorImpl.validate(SqlValidatorImpl.java:557) [calcite-core-1.4.0-drill-r21.jar:1.4.0-drill-r21]
at org.apache.drill.exec.planner.sql.SqlConverter.validate(SqlConverter.java:170) [drill-java-exec-1.11.0.jar:1.11.0]
at org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.validateNode(DefaultSqlHandler.java:618) [drill-java-exec-1.11.0.jar:1.11.0]
at org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.validateAndConvert(DefaultSqlHandler.java:193) [drill-java-exec-1.11.0.jar:1.11.0]
at org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.getPlan(DefaultSqlHandler.java:165) [drill-java-exec-1.11.0.jar:1.11.0]
at org.apache.drill.exec.planner.sql.DrillSqlWorker.getQueryPlan(DrillSqlWorker.java:131) [drill-java-exec-1.11.0.jar:1.11.0]
at org.apache.drill.exec.planner.sql.DrillSqlWorker.getPlan(DrillSqlWorker.java:79) [drill-java-exec-1.11.0.jar:1.11.0]
at org.apache.drill.exec.work.foreman.Foreman.runSQL(Foreman.java:1050) [drill-java-exec-1.11.0.jar:1.11.0]
at org.apache.drill.exec.work.foreman.Foreman.run(Foreman.java:280) [drill-java-exec-1.11.0.jar:1.11.0]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_102]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_102]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_102]
Regards,
Dor
This message and the information contained herein is proprietary and confidential and subject to the Amdocs policy statement,
you may review at https://www.amdocs.com/about/email-disclaimer <https://www.amdocs.com/about/email-disclaimer>
Re: exception using drill with CDH 5.8.2
Posted by "bitblender.lists@gmail.com" <bi...@gmail.com>.
Hi Dor,
What do your ZK server logs say?
https://stackoverflow.com/questions/34066386/startin-hbase-shell-zookeeper-exists-but-fails seems to have some useful suggestions.
Karthik
On 2017-07-31 06:15, Dor Ben Dov <do...@amdocs.com> wrote:
> Hi,
>
> I configured drill according to the documentation, which means using the web interface with the following:
> {
> "type": "hbase",
> "config": {
> "hbase.zookeeper.quorum": "10.238.64.198",
> "hbase.zookeeper.property.clientPort": "2181"
> },
> "size.calculator.enabled": false,
> "enabled": true
> }
> Trying to use drill with my CDH 5.8.2 and I am receiving the following exception : any ideas?
> 16:12:34.460 [2680d35f-0f4c-b31a-6476-6b7fc3388089:foreman] ERROR o.a.h.h.z.RecoverableZooKeeper - ZooKeeper exists failed after 4 attempts
> 16:12:34.461 [2680d35f-0f4c-b31a-6476-6b7fc3388089:foreman] ERROR o.a.h.h.zookeeper.ZooKeeperWatcher - hconnection-0x623090b50x0, quorum=10.238.64.198:2181, baseZNode=/hbase Received unexpected KeeperException, re-throwing exception
> org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase
> at org.apache.zookeeper.KeeperException.create(KeeperException.java:99) ~[zookeeper-3.4.6.jar:3.4.6-1569965]
> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) ~[zookeeper-3.4.6.jar:3.4.6-1569965]
> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045) ~[zookeeper-3.4.6.jar:3.4.6-1569965]
> at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.exists(RecoverableZooKeeper.java:221) ~[hbase-client-1.1.3.jar:1.1.3]
> at org.apache.hadoop.hbase.zookeeper.ZKUtil.checkExists(ZKUtil.java:541) ~[hbase-client-1.1.3.jar:1.1.3]
> at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.checkIfBaseNodeAvailable(ConnectionManager.java:896) [hbase-client-1.1.3.jar:1.1.3]
> at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.access$400(ConnectionManager.java:546) [hbase-client-1.1.3.jar:1.1.3]
> at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation$StubMaker.makeStubNoRetries(ConnectionManager.java:1484) [hbase-client-1.1.3.jar:1.1.3]
> at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation$StubMaker.makeStub(ConnectionManager.java:1525) [hbase-client-1.1.3.jar:1.1.3]
> at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation$MasterServiceStubMaker.makeStub(ConnectionManager.java:1554) [hbase-client-1.1.3.jar:1.1.3]
> at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.getKeepAliveMasterService(ConnectionManager.java:1705) [hbase-client-1.1.3.jar:1.1.3]
> at org.apache.hadoop.hbase.client.MasterCallable.prepare(MasterCallable.java:38) [hbase-client-1.1.3.jar:1.1.3]
> at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:124) [hbase-client-1.1.3.jar:1.1.3]
> at org.apache.hadoop.hbase.client.HBaseAdmin.executeCallable(HBaseAdmin.java:4036) [hbase-client-1.1.3.jar:1.1.3]
> at org.apache.hadoop.hbase.client.HBaseAdmin.getTableDescriptor(HBaseAdmin.java:530) [hbase-client-1.1.3.jar:1.1.3]
> at org.apache.drill.exec.store.hbase.DrillHBaseTable.<init>(DrillHBaseTable.java:42) [drill-storage-hbase-1.11.0.jar:1.11.0]
> at org.apache.drill.exec.store.hbase.HBaseSchemaFactory$HBaseSchema.getTable(HBaseSchemaFactory.java:75) [drill-storage-hbase-1.11.0.jar:1.11.0]
> at org.apache.calcite.jdbc.SimpleCalciteSchema.getTable(SimpleCalciteSchema.java:82) [calcite-core-1.4.0-drill-r21.jar:1.4.0-drill-r21]
> at org.apache.calcite.prepare.CalciteCatalogReader.getTableFrom(CalciteCatalogReader.java:119) [calcite-core-1.4.0-drill-r21.jar:1.4.0-drill-r21]
> at org.apache.calcite.prepare.CalciteCatalogReader.getTable(CalciteCatalogReader.java:102) [calcite-core-1.4.0-drill-r21.jar:1.4.0-drill-r21]
> at org.apache.drill.exec.planner.sql.SqlConverter$DrillCalciteCatalogReader.getTable(SqlConverter.java:484) [drill-java-exec-1.11.0.jar:1.11.0]
> at org.apache.drill.exec.planner.sql.SqlConverter$DrillCalciteCatalogReader.getTable(SqlConverter.java:429) [drill-java-exec-1.11.0.jar:1.11.0]
> at org.apache.calcite.sql.validate.EmptyScope.getTableNamespace(EmptyScope.java:75) [calcite-core-1.4.0-drill-r21.jar:1.4.0-drill-r21]
> at org.apache.calcite.sql.validate.DelegatingScope.getTableNamespace(DelegatingScope.java:124) [calcite-core-1.4.0-drill-r21.jar:1.4.0-drill-r21]
> at org.apache.calcite.sql.validate.IdentifierNamespace.validateImpl(IdentifierNamespace.java:104) [calcite-core-1.4.0-drill-r21.jar:1.4.0-drill-r21]
> at org.apache.calcite.sql.validate.AbstractNamespace.validate(AbstractNamespace.java:86) [calcite-core-1.4.0-drill-r21.jar:1.4.0-drill-r21]
> at org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace(SqlValidatorImpl.java:883) [calcite-core-1.4.0-drill-r21.jar:1.4.0-drill-r21]
> at org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery(SqlValidatorImpl.java:869) [calcite-core-1.4.0-drill-r21.jar:1.4.0-drill-r21]
> at org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom(SqlValidatorImpl.java:2806) [calcite-core-1.4.0-drill-r21.jar:1.4.0-drill-r21]
> at org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom(SqlValidatorImpl.java:2791) [calcite-core-1.4.0-drill-r21.jar:1.4.0-drill-r21]
> at org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelect(SqlValidatorImpl.java:3014) [calcite-core-1.4.0-drill-r21.jar:1.4.0-drill-r21]
> at org.apache.calcite.sql.validate.SelectNamespace.validateImpl(SelectNamespace.java:60) [calcite-core-1.4.0-drill-r21.jar:1.4.0-drill-r21]
> at org.apache.calcite.sql.validate.AbstractNamespace.validate(AbstractNamespace.java:86) [calcite-core-1.4.0-drill-r21.jar:1.4.0-drill-r21]
> at org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace(SqlValidatorImpl.java:883) [calcite-core-1.4.0-drill-r21.jar:1.4.0-drill-r21]
> at org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery(SqlValidatorImpl.java:869) [calcite-core-1.4.0-drill-r21.jar:1.4.0-drill-r21]
> at org.apache.calcite.sql.SqlSelect.validate(SqlSelect.java:210) [calcite-core-1.4.0-drill-r21.jar:1.4.0-drill-r21]
> at org.apache.calcite.sql.validate.SqlValidatorImpl.validateScopedExpression(SqlValidatorImpl.java:843) [calcite-core-1.4.0-drill-r21.jar:1.4.0-drill-r21]
> at org.apache.calcite.sql.validate.SqlValidatorImpl.validate(SqlValidatorImpl.java:557) [calcite-core-1.4.0-drill-r21.jar:1.4.0-drill-r21]
> at org.apache.drill.exec.planner.sql.SqlConverter.validate(SqlConverter.java:170) [drill-java-exec-1.11.0.jar:1.11.0]
> at org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.validateNode(DefaultSqlHandler.java:618) [drill-java-exec-1.11.0.jar:1.11.0]
> at org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.validateAndConvert(DefaultSqlHandler.java:193) [drill-java-exec-1.11.0.jar:1.11.0]
> at org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.getPlan(DefaultSqlHandler.java:165) [drill-java-exec-1.11.0.jar:1.11.0]
> at org.apache.drill.exec.planner.sql.DrillSqlWorker.getQueryPlan(DrillSqlWorker.java:131) [drill-java-exec-1.11.0.jar:1.11.0]
> at org.apache.drill.exec.planner.sql.DrillSqlWorker.getPlan(DrillSqlWorker.java:79) [drill-java-exec-1.11.0.jar:1.11.0]
> at org.apache.drill.exec.work.foreman.Foreman.runSQL(Foreman.java:1050) [drill-java-exec-1.11.0.jar:1.11.0]
> at org.apache.drill.exec.work.foreman.Foreman.run(Foreman.java:280) [drill-java-exec-1.11.0.jar:1.11.0]
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_102]
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_102]
> at java.lang.Thread.run(Thread.java:745) [na:1.8.0_102]
>
>
> Regards,
> Dor
> This message and the information contained herein is proprietary and confidential and subject to the Amdocs policy statement,
>
> you may review at https://www.amdocs.com/about/email-disclaimer <https://www.amdocs.com/about/email-disclaimer>
>