You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Aaron Steers (JIRA)" <ji...@apache.org> on 2016/07/13 23:44:20 UTC
[jira] [Commented] (SPARK-2605) Drop Hive Table If Exists Throw out
Error by Spark
[ https://issues.apache.org/jira/browse/SPARK-2605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376011#comment-15376011 ]
Aaron Steers commented on SPARK-2605:
-------------------------------------
I am also receiving this (false positive) error and it is mucking up our logs. As a workaround, is there any way to disable the Hive logging altogether and perhaps re-enable after the command is completed? I'm running hundreds of these operations, and the excessive ERROR entries are making it more difficult to quickly digest my Spark application's output.
> Drop Hive Table If Exists Throw out Error by Spark
> --------------------------------------------------
>
> Key: SPARK-2605
> URL: https://issues.apache.org/jira/browse/SPARK-2605
> Project: Spark
> Issue Type: Bug
> Environment: Spark(1.0.1), Hive(0.13.1)
> Reporter: Haimei Li
>
> I have Hive, MySQL and Spark. MySQL is Hive metastore_db. I follow this guide to configurate it (http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH4/4.2.0/CDH4-Installation-Guide/cdh4ig_topic_18_4.html). It is ok for me to do drop table command under hive shell environment. But when I enter into spark-shell env, I use hiveContext.hql("DROP TABLE IF EXISTS hivetesting"). And then, I get following error:
> ERROR Hive: NoSuchObjectException(message:default.hivetesting table not found)
> at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$get_table_result$get_table_resultStandardScheme.read(ThriftHiveMetastore.java:27129)
> at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$get_table_result$get_table_resultStandardScheme.read(ThriftHiveMetastore.java:27097)
> at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$get_table_result.read(ThriftHiveMetastore.java:27028)
> at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:78)
> at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_get_table(ThriftHiveMetastore.java:936)
> at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.get_table(ThriftHiveMetastore.java:922)
> at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTable(HiveMetaStoreClient.java:854)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:89)
> at com.sun.proxy.$Proxy11.getTable(Unknown Source)
> at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:950)
> ......
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org