You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@drill.apache.org by "Ramana Inukonda Nagaraj (JIRA)" <ji...@apache.org> on 2014/04/18 00:03:15 UTC
[jira] [Commented] (DRILL-541) hive-hbase tables query hangs
[ https://issues.apache.org/jira/browse/DRILL-541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13973471#comment-13973471 ]
Ramana Inukonda Nagaraj commented on DRILL-541:
-----------------------------------------------
Eventually failed. I had it running in the background/
org.apache.hadoop.hbase.client.NoServerForRegionException: Unable to find region for xyz,,99999999999999 after 14 tries.
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:1095) ~[hbase-0.94.11.jar:0.94.11]
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:1000) ~[hbase-0.94.11.jar:0.94.11]
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:1102) ~[hbase-0.94.11.jar:0.94.11]
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:1004) ~[hbase-0.94.11.jar:0.94.11]
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:961) ~[hbase-0.94.11.jar:0.94.11]
org.apache.hadoop.hbase.client.HTable.finishSetup(HTable.java:227) ~[hbase-0.94.11.jar:0.94.11]
org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:170) ~[hbase-0.94.11.jar:0.94.11]
org.apache.hadoop.hive.hbase.HiveHBaseTableInputFormat.getSplits(HiveHBaseTableInputFormat.java:443) ~[hive-hbase-handler-0.12.0.jar:0.12.0]
org.apache.drill.exec.store.hive.HiveScan.getSplits(HiveScan.java:120) ~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
org.apache.drill.exec.store.hive.HiveScan.<init>(HiveScan.java:98) ~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
org.apache.drill.exec.store.hive.HiveStoragePlugin.getPhysicalScan(HiveStoragePlugin.java:69) ~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
org.apache.drill.exec.store.hive.HiveStoragePlugin.getPhysicalScan(HiveStoragePlugin.java:35) ~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
org.apache.drill.exec.opt.BasicOptimizer$LogicalConverter.visitScan(BasicOptimizer.java:190) ~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
org.apache.drill.exec.opt.BasicOptimizer$LogicalConverter.visitScan(BasicOptimizer.java:112) ~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
org.apache.drill.common.logical.data.Scan.accept(Scan.java:59) ~[drill-common-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
org.apache.drill.exec.opt.BasicOptimizer$LogicalConverter.visitProject(BasicOptimizer.java:207) ~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
org.apache.drill.exec.opt.BasicOptimizer$LogicalConverter.visitProject(BasicOptimizer.java:112) ~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
org.apache.drill.common.logical.data.Project.accept(Project.java:66) ~[drill-common-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
org.apache.drill.exec.opt.BasicOptimizer$LogicalConverter.visitStore(BasicOptimizer.java:201) ~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
org.apache.drill.exec.opt.BasicOptimizer$LogicalConverter.visitStore(BasicOptimizer.java:112) ~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
org.apache.drill.common.logical.data.Store.accept(Store.java:54) ~[drill-common-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
org.apache.drill.exec.opt.BasicOptimizer.optimize(BasicOptimizer.java:86) ~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
org.apache.drill.exec.work.foreman.Foreman.convert(Foreman.java:373) [drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
org.apache.drill.exec.work.foreman.Foreman.runSQL(Foreman.java:358) [drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
org.apache.drill.exec.work.foreman.Foreman.run(Foreman.java:175) [drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_45]
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_45]
java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]
> hive-hbase tables query hangs
> -----------------------------
>
> Key: DRILL-541
> URL: https://issues.apache.org/jira/browse/DRILL-541
> Project: Apache Drill
> Issue Type: Bug
> Reporter: Ramana Inukonda Nagaraj
>
> [root@perfnode166 drilltests]# hive -e "desc extended hbase_table_1";
> Logging initialized using configuration in jar:file:/opt/mapr/hive/hive-0.12/lib/hive-common-0.12-mapr-1401-140130.jar!/hive-log4j.properties
> OK
> key int from deserializer
> value string from deserializer
>
> Detailed Table Information Table(tableName:hbase_table_1, dbName:default, owner:root, createTime:1397769348, lastAccessTime:0, retention:0, sd:StorageDescriptor(cols:[FieldSchema(name:key, type:int, comment:null), FieldSchema(name:value, type:string, comment:null)], location:maprfs:/user/hive/warehouse/hbase_table_1, inputFormat:org.apache.hadoop.hive.hbase.HiveHBaseTableInputFormat, outputFormat:org.apache.hadoop.hive.ql.io.HivePassThroughOutputFormat, compressed:false, numBuckets:-1, serdeInfo:SerDeInfo(name:null, serializationLib:org.apache.hadoop.hive.hbase.HBaseSerDe, parameters:{serialization.format=1, hbase.columns.mapping=:key,cf1:val}), bucketCols:[], sortCols:[], parameters:{}, skewedInfo:SkewedInfo(skewedColNames:[], skewedColValues:[], skewedColValueLocationMaps:{}), storedAsSubDirectories:false), partitionKeys:[], parameters:{hbase.table.name=xyz, transient_lastDdlTime=1397769348, storage_handler=org.apache.hadoop.hive.hbase.HBaseStorageHandler}, viewOriginalText:null, viewExpandedText:null, tableType:MANAGED_TABLE)
> Time taken: 1.947 seconds, Fetched: 4 row(s)
> Can be queried fine from hive.
> From drill the query hangs. I have lilith setup but I am not sure what kind of information you need from there.
--
This message was sent by Atlassian JIRA
(v6.2#6252)