You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@drill.apache.org by zhouyaoyong <zh...@xunlei.com> on 2015/05/06 04:52:21 UTC
Drill can't query hive tables
Hi,everyone,I come from China,
In Drill0.8 or Drill0.9, I can query from dfs, json and so on, But I can't
query from the hive tables,
The following is the relative logs,
Pleases help me ,thank you very much!
0: jdbc:drill:schema=dcdn> use hive.dcdn;
+------------+------------+
| ok | summary |
+------------+------------+
| true | Default schema changed to 'hive.dcdn' |
+------------+------------+
1 row selected (0.744 seconds)
0: jdbc:drill:schema=dcdn> show tables;
+--------------+------------+
| TABLE_SCHEMA | TABLE_NAME |
+--------------+------------+
| hive.dcdn | customers |
| hive.dcdn | customers2 |
+--------------+------------+
2 rows selected (7.03 seconds)
0: jdbc:drill:schema=dcdn> show tables;
+--------------+------------+
| TABLE_SCHEMA | TABLE_NAME |
+--------------+------------+
| hive.dcdn | customers |
| hive.dcdn | customers2 |
+--------------+------------+
2 rows selected (0.608 seconds)
0: jdbc:drill:schema=dcdn> describe customers2;
+-------------+------------+-------------+
| COLUMN_NAME | DATA_TYPE | IS_NULLABLE |
+-------------+------------+-------------+
| firstname | VARCHAR | YES |
| lastname | VARCHAR | YES |
| company | VARCHAR | YES |
| address | VARCHAR | YES |
| city | VARCHAR | YES |
| county | VARCHAR | YES |
| state | VARCHAR | YES |
| zip | VARCHAR | YES |
| phone | VARCHAR | YES |
| fax | VARCHAR | YES |
| email | VARCHAR | YES |
| web | VARCHAR | YES |
+-------------+------------+-------------+
12 rows selected (0.476 seconds)
0: jdbc:drill:schema=dcdn> select * from customers2 limit 3;
Error: exception while executing query: Failure while executing query.
(state=,code=0)
Query failed: SYSTEM ERROR: Unexpected exception during fragment
initialization: Internal error: Error while applying rule
DrillPushProjIntoScan, args
[rel#656:LogicalProject.NONE.ANY([]).[](input=rel#655:Subset#0.ENUMERABLE.AN
Y([]).[],firstname=$0,lastname=$1,company=$2,address=$3,city=$4,county=$5,st
ate=$6,zip=$7,phone=$8,fax=$9,email=$10,web=$11),
rel#647:EnumerableTableScan.ENUMERABLE.ANY([]).[](table=[hive, dcdn,
customers2])]
[5d437f7f-73a7-4870-b957-dd80efe4984d on hubvm0077:31010]
0: jdbc:drill:schema=dcdn> select count(*) from customers2;
Query failed: SYSTEM ERROR: Unexpected exception during fragment
initialization: Internal error: Error while applying rule
DrillPushProjIntoScan, args
[rel#676:LogicalProject.NONE.ANY([]).[](input=rel#675:Subset#0.ENUMERABLE.AN
Y([]).[],$f0=0),
rel#667:EnumerableTableScan.ENUMERABLE.ANY([]).[](table=[hive, dcdn,
customers2])]
[61be52da-abd1-44d6-bb56-488b374b5906 on hubvm0077:31010]
Error: exception while executing query: Failure while executing query.
(state=,code=0)
0: jdbc:drill:schema=dcdn>
The logs:
[61be52da-abd1-44d6-bb56-488b374b5906 on hubvm0077:31010]
org.apache.drill.common.exceptions.UserException: SYSTEM ERROR: Unexpected
exception during fragment initialization: Internal error: Error while
applying rule DrillPushProjIntoScan, args
[rel#676:LogicalProject.NONE.ANY([]).[](input=rel#675:Subset#0.ENUMERABLE.AN
Y([]).[],$f0=0),
rel#667:EnumerableTableScan.ENUMERABLE.ANY([]).[](table=[hive, dcdn,
customers2])]
[61be52da-abd1-44d6-bb56-488b374b5906 on hubvm0077:31010]
at
org.apache.drill.common.exceptions.UserException$Builder.build(UserException
.java:465) ~[drill-common-0.9.0-rebuffed.jar:0.9.0]
at
org.apache.drill.exec.work.foreman.Foreman$ForemanResult.close(Foreman.java:
620) [drill-java-exec-0.9.0-rebuffed.jar:0.9.0]
at
org.apache.drill.exec.work.foreman.Foreman$StateSwitch.processEvent(Foreman.
java:717) [drill-java-exec-0.9.0-rebuffed.jar:0.9.0]
at
org.apache.drill.exec.work.foreman.Foreman$StateSwitch.processEvent(Foreman.
java:659) [drill-java-exec-0.9.0-rebuffed.jar:0.9.0]
at
org.apache.drill.common.EventProcessor.sendEvent(EventProcessor.java:73)
[drill-common-0.9.0-rebuffed.jar:0.9.0]
at
org.apache.drill.exec.work.foreman.Foreman$StateSwitch.moveToState(Foreman.j
ava:661) [drill-java-exec-0.9.0-rebuffed.jar:0.9.0]
at
org.apache.drill.exec.work.foreman.Foreman.moveToState(Foreman.java:762)
[drill-java-exec-0.9.0-rebuffed.jar:0.9.0]
at org.apache.drill.exec.work.foreman.Foreman.run(Foreman.java:212)
[drill-java-exec-0.9.0-rebuffed.jar:0.9.0]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:11
45) [na:1.7.0_21]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:6
15) [na:1.7.0_21]
at java.lang.Thread.run(Thread.java:722) [na:1.7.0_21]
Caused by: org.apache.drill.exec.work.foreman.ForemanException: Unexpected
exception during fragment initialization: Internal error: Error while
applying rule DrillPushProjIntoScan, args
[rel#676:LogicalProject.NONE.ANY([]).[](input=rel#675:Subset#0.ENUMERABLE.AN
Y([]).[],$f0=0),
rel#667:EnumerableTableScan.ENUMERABLE.ANY([]).[](table=[hive, dcdn,
customers2])]
... 4 common frames omitted
Caused by: java.lang.AssertionError: Internal error: Error while applying
rule DrillPushProjIntoScan, args
[rel#676:LogicalProject.NONE.ANY([]).[](input=rel#675:Subset#0.ENUMERABLE.AN
Y([]).[],$f0=0),
rel#667:EnumerableTableScan.ENUMERABLE.ANY([]).[](table=[hive, dcdn,
customers2])]
at org.apache.calcite.util.Util.newInternal(Util.java:743)
~[calcite-core-1.1.0-drill-r2.jar:1.1.0-drill-r2]
at
org.apache.calcite.plan.volcano.VolcanoRuleCall.onMatch(VolcanoRuleCall.java
:251) ~[calcite-core-1.1.0-drill-r2.jar:1.1.0-drill-r2]
at
org.apache.calcite.plan.volcano.VolcanoPlanner.findBestExp(VolcanoPlanner.ja
va:795) ~[calcite-core-1.1.0-drill-r2.jar:1.1.0-drill-r2]
at
org.apache.calcite.tools.Programs$RuleSetProgram.run(Programs.java:303)
~[calcite-core-1.1.0-drill-r2.jar:1.1.0-drill-r2]
at
org.apache.calcite.prepare.PlannerImpl.transform(PlannerImpl.java:316)
~[calcite-core-1.1.0-drill-r2.jar:1.1.0-drill-r2]
at
org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.convertToDrel(D
efaultSqlHandler.java:241) ~[drill-java-exec-0.9.0-rebuffed.jar:0.9.0]
at
org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.getPlan(Default
SqlHandler.java:152) ~[drill-java-exec-0.9.0-rebuffed.jar:0.9.0]
at
org.apache.drill.exec.planner.sql.DrillSqlWorker.getPlan(DrillSqlWorker.java
:167) ~[drill-java-exec-0.9.0-rebuffed.jar:0.9.0]
at
org.apache.drill.exec.work.foreman.Foreman.runSQL(Foreman.java:773)
[drill-java-exec-0.9.0-rebuffed.jar:0.9.0]
at org.apache.drill.exec.work.foreman.Foreman.run(Foreman.java:203)
[drill-java-exec-0.9.0-rebuffed.jar:0.9.0]
... 3 common frames omitted
Caused by: org.apache.drill.common.exceptions.DrillRuntimeException:
java.io.IOException:
org.apache.drill.common.exceptions.ExecutionSetupException:
java.io.IOException: Failed on local exception: java.io.EOFException; Host
Details : local host is: "hubvm0077/10.10.159.97"; destination host is:
"hubvm0077":9000;
at
org.apache.drill.exec.planner.logical.DrillPushProjIntoScan.onMatch(DrillPus
hProjIntoScan.java:85) ~[drill-java-exec-0.9.0-rebuffed.jar:0.9.0]
at
org.apache.calcite.plan.volcano.VolcanoRuleCall.onMatch(VolcanoRuleCall.java
:228) ~[calcite-core-1.1.0-drill-r2.jar:1.1.0-drill-r2]
... 11 common frames omitted
Caused by: java.io.IOException:
org.apache.drill.common.exceptions.ExecutionSetupException:
java.io.IOException: Failed on local exception: java.io.EOFException; Host
Details : local host is: "hubvm0077/10.10.159.97"; destination host is:
"hubvm0077":9000;
at
org.apache.drill.exec.store.hive.HiveStoragePlugin.getPhysicalScan(HiveStora
gePlugin.java:80) ~[drill-storage-hive-core-0.9.0.jar:0.9.0]
at
org.apache.drill.exec.store.hive.HiveStoragePlugin.getPhysicalScan(HiveStora
gePlugin.java:41) ~[drill-storage-hive-core-0.9.0.jar:0.9.0]
at
org.apache.drill.exec.store.AbstractStoragePlugin.getPhysicalScan(AbstractSt
oragePlugin.java:53) ~[drill-java-exec-0.9.0-rebuffed.jar:0.9.0]
at
org.apache.drill.exec.planner.logical.DrillTable.getGroupScan(DrillTable.jav
a:72) ~[drill-java-exec-0.9.0-rebuffed.jar:0.9.0]
at
org.apache.drill.exec.planner.logical.DrillPushProjIntoScan.onMatch(DrillPus
hProjIntoScan.java:53) ~[drill-java-exec-0.9.0-rebuffed.jar:0.9.0]
... 12 common frames omitted
Caused by: org.apache.drill.common.exceptions.ExecutionSetupException:
java.io.IOException: Failed on local exception: java.io.EOFException; Host
Details : local host is: "hubvm0077/10.10.159.97"; destination host is:
"hubvm0077":9000;
at
org.apache.drill.exec.store.hive.HiveScan.getSplits(HiveScan.java:152)
~[drill-storage-hive-core-0.9.0.jar:0.9.0]
at
org.apache.drill.exec.store.hive.HiveScan.<init>(HiveScan.java:116)
~[drill-storage-hive-core-0.9.0.jar:0.9.0]
at
org.apache.drill.exec.store.hive.HiveStoragePlugin.getPhysicalScan(HiveStora
gePlugin.java:78) ~[drill-storage-hive-core-0.9.0.jar:0.9.0]
... 16 common frames omitted
Caused by: java.io.IOException: Failed on local exception:
java.io.EOFException; Host Details : local host is:
"hubvm0077/10.10.159.97"; destination host is: "hubvm0077":9000;
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:764)
~[hadoop-common-2.4.1.jar:na]
at org.apache.hadoop.ipc.Client.call(Client.java:1414)
~[hadoop-common-2.4.1.jar:na]
at org.apache.hadoop.ipc.Client.call(Client.java:1363)
~[hadoop-common-2.4.1.jar:na]
at
org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.jav
a:206) ~[hadoop-common-2.4.1.jar:na]
at com.sun.proxy.$Proxy107.getFileInfo(Unknown Source) ~[na:na]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
~[na:1.7.0_21]
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57
) ~[na:1.7.0_21]
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl
.java:43) ~[na:1.7.0_21]
at java.lang.reflect.Method.invoke(Method.java:601) ~[na:1.7.0_21]
at
org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocati
onHandler.java:190) ~[hadoop-common-2.4.1.jar:na]
at
org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHand
ler.java:103) ~[hadoop-common-2.4.1.jar:na]
at com.sun.proxy.$Proxy107.getFileInfo(Unknown Source) ~[na:na]
at
org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFile
Info(ClientNamenodeProtocolTranslatorPB.java:699)
~[hadoop-hdfs-2.4.1.jar:na]
at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1762)
~[hadoop-hdfs-2.4.1.jar:na]
at
org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem
.java:1124) ~[hadoop-hdfs-2.4.1.jar:na]
at
org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem
.java:1120) ~[hadoop-hdfs-2.4.1.jar:na]
at
org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.j
ava:81) ~[hadoop-common-2.4.1.jar:na]
at
org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSy
stem.java:1120) ~[hadoop-hdfs-2.4.1.jar:na]
at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1398)
~[hadoop-common-2.4.1.jar:na]
at
org.apache.drill.exec.store.hive.HiveScan.splitInput(HiveScan.java:174)
~[drill-storage-hive-core-0.9.0.jar:0.9.0]
at
org.apache.drill.exec.store.hive.HiveScan.getSplits(HiveScan.java:144)
~[drill-storage-hive-core-0.9.0.jar:0.9.0]
... 18 common frames omitted
java.io.EOFException: null
at java.io.DataInputStream.readInt(DataInputStream.java:392)
~[na:1.7.0_21]
at
org.apache.hadoop.ipc.Client$Connection.receiveRpcResponse(Client.java:1054)
~[hadoop-common-2.4.1.jar:na]
at org.apache.hadoop.ipc.Client$Connection.run(Client.java:949)
~[hadoop-common-2.4.1.jar:na]
[xldw@hubvm0077 log]$