You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@drill.apache.org by "Jacques Nadeau (JIRA)" <ji...@apache.org> on 2014/04/20 06:12:16 UTC
[jira] [Resolved] (DRILL-481) libthrift-0.8.0 causes drillbit to
fail while querying Hive tables
[ https://issues.apache.org/jira/browse/DRILL-481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jacques Nadeau resolved DRILL-481.
----------------------------------
Resolution: Fixed
Assignee: Steven Phillips
Resolved in 41dcf20
> libthrift-0.8.0 causes drillbit to fail while querying Hive tables
> ------------------------------------------------------------------
>
> Key: DRILL-481
> URL: https://issues.apache.org/jira/browse/DRILL-481
> Project: Apache Drill
> Issue Type: Bug
> Environment: Centos 6.4 + Maven 3.0.5
> Reporter: doodlegum
> Assignee: Steven Phillips
> Attachments: deps.txt
>
>
> When drill is built on any system, libthrift-0.8.0 and libthrift-0.9.0 both get pulled in as part of multiple projects. The attached deps.txt file shows dependency tree. When drillbit is started and a query against Hive table is fired, drillbit crashes with following NoSuchMethodError.
> Caused by: java.lang.NoSuchMethodError: org.apache.thrift.EncodingUtils.setBit(BIZ)B
> at org.apache.hadoop.hive.metastore.api.StorageDescriptor.setCompressedIsSet(StorageDescriptor.java:442)
> at org.apache.hadoop.hive.metastore.api.StorageDescriptor.<init>(StorageDescriptor.java:223)
> at org.apache.hadoop.hive.metastore.ObjectStore.convertToStorageDescriptor(ObjectStore.java:1019)
> at org.apache.hadoop.hive.metastore.ObjectStore.convertToStorageDescriptor(ObjectStore.java:1034)
> at org.apache.hadoop.hive.metastore.ObjectStore.convertToTable(ObjectStore.java:889)
> at org.apache.hadoop.hive.metastore.ObjectStore.getTable(ObjectStore.java:760)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at org.apache.hadoop.hive.metastore.RetryingRawStore.invoke(RetryingRawStore.java:124)
> at com.sun.proxy.$Proxy18.getTable(Unknown Source)
> at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table(HiveMetaStore.java:1371)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:103)
> at com.sun.proxy.$Proxy19.get_table(Unknown Source)
> at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTable(HiveMetaStoreClient.java:854)
> at org.apache.drill.exec.store.hive.schema.HiveSchemaFactory$TableLoader.load(HiveSchemaFactory.java:144)
> at org.apache.drill.exec.store.hive.schema.HiveSchemaFactory$TableLoader.load(HiveSchemaFactory.java:131)
> at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3599)
> at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2379)
> at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2342)
> at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2257)
> ... 35 more
> It turns out the $DRIL_HOME/lib directory contains libthrift-0.8.0.jar which doesn't have setBit method in EncodingUtils.java but it is present in 0.9.0.
> https://github.com/apache/thrift/blob/0.8.x/lib/java/src/org/apache/thrift/EncodingUtils.java
> https://github.com/apache/thrift/blob/0.9.x/lib/java/src/org/apache/thrift/EncodingUtils.java
> Only 0.9.0 should be included in Drill's distribution tarball if possible
--
This message was sent by Atlassian JIRA
(v6.2#6252)