You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2020/03/11 06:26:00 UTC
[jira] [Commented] (SPARK-31084) spark on k8s Exception "Database
xxx not found" when hive MetaStoreClient lost connection
[ https://issues.apache.org/jira/browse/SPARK-31084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17056684#comment-17056684 ]
Hyukjin Kwon commented on SPARK-31084:
--------------------------------------
Please ask questions into mailing list, and avoid just copying and paste the logs or exception message
> spark on k8s Exception "Database xxx not found" when hive MetaStoreClient lost connection
> -----------------------------------------------------------------------------------------
>
> Key: SPARK-31084
> URL: https://issues.apache.org/jira/browse/SPARK-31084
> Project: Spark
> Issue Type: Question
> Components: Kubernetes
> Affects Versions: 2.4.4
> Environment: spark 2.4.4
>
>
>
> Reporter: liuxiuyuan
> Priority: Major
>
> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke:184 | MetaStoreClient lost connection. Attempting to reconnect.org.apache.thrift.transport.TTransportException: java.net.SocketException: Connection reset
> 06-03-2020 12:56:09 CST stage1 INFO - Caused by: java.net.SocketException: Connection reset
> 06-03-2020 12:56:09 CST stage1 INFO -
> 06-03-2020 12:56:09 CST stage1 INFO - at java.net.SocketInputStream.read(SocketInputStream.java:210)
> 06-03-2020 12:56:09 CST stage1 INFO -
> 06-03-2020 12:56:09 CST stage1 INFO - at java.net.SocketInputStream.read(SocketInputStream.java:141)
> 06-03-2020 12:56:09 CST stage1 INFO -
> 06-03-2020 12:56:09 CST stage1 INFO - at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
> 06-03-2020 12:56:09 CST stage1 INFO -
> 06-03-2020 12:56:09 CST stage1 INFO - at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
> 06-03-2020 12:56:09 CST stage1 INFO -
> 06-03-2020 12:56:09 CST stage1 INFO - at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
> 06-03-2020 12:56:09 CST stage1 INFO -
> 06-03-2020 12:56:09 CST stage1 INFO - at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
> 06-03-2020 12:56:09 CST stage1 INFO -
> 06-03-2020 12:56:09 CST stage1 INFO - ... 70 more
> 06-03-2020 12:56:09 CST stage1 INFO - 2020-03-06 04:56:06 [INFO] -- org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open:376 | Trying to connect to metastore with URI thrift://hive-metastore-server:9083
> 06-03-2020 12:56:09 CST stage1 INFO -
> 06-03-2020 12:56:09 CST stage1 INFO - 2020-03-06 04:56:06 [INFO] -- org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open:472 | Connected to metastore.
> 06-03-2020 12:56:09 CST stage1 INFO -
> 06-03-2020 12:56:09 CST stage1 INFO - 2020-03-06 04:56:14 [WARN] -- org.apache.spark.internal.Logging$class.logWarning:87 | Kubernetes client has been closed (this is expected if the application is shutting down.)
> 06-03-2020 12:56:09 CST stage1 INFO - 2020-03-06 04:56:14 [WARN] -- org.apache.spark.internal.Logging$class.logWarning:87 | Kubernetes client has been closed (this is expected if the application is shutting down.)
> 06-03-2020 12:56:09 CST stage1 INFO -
> 06-03-2020 12:56:09 CST stage1 INFO - Exception in thread "main" org.apache.spark.sql.catalyst.analysis.NoSuchDatabaseException: Database 'xxx' not found;
> 06-03-2020 12:56:09 CST stage1 INFO -
> 06-03-2020 12:56:09 CST stage1 INFO - at org.apache.spark.sql.catalyst.catalog.SessionCatalog.org$apache$spark$sql$catalyst$catalog$SessionCatalog$$requireDbExists(SessionCatalog.scala:178)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org