You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "David Mollitor (Jira)" <ji...@apache.org> on 2019/11/07 20:06:00 UTC
[jira] [Commented] (HIVE-22469) Lower Metastore DB Connection Pool
Size in QTests
[ https://issues.apache.org/jira/browse/HIVE-22469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16969530#comment-16969530 ]
David Mollitor commented on HIVE-22469:
---------------------------------------
Example...
{code:none}
2019-11-06T11:23:23,325 DEBUG [Heartbeater-2] txn.TxnHandler: Going to rollback
2019-11-06T11:23:23,325 WARN [Heartbeater-2] pool.ProxyConnection: HikariPool-2 - Connection org.apache.derby.impl.jdbc.EmbedConnection@1601499507 (XID = 12138), (SESSIONID = 71), (DATABASE = /home/hiveptest/35.193.82.55-hiveptest-2/apache-github-source-source/itests/qtest/target/tmp/junit_metastore_db), (DRDAID = null) marked as broken because of SQLSTATE(08003), ErrorCode(40000)
java.sql.SQLNonTransientConnectionException: No current connection.
at org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source) ~[derby-10.14.1.0.jar:?]
at org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source) ~[derby-10.14.1.0.jar:?]
at org.apache.derby.impl.jdbc.Util.generateCsSQLException(Unknown Source) ~[derby-10.14.1.0.jar:?]
at org.apache.derby.impl.jdbc.Util.generateCsSQLException(Unknown Source) ~[derby-10.14.1.0.jar:?]
at org.apache.derby.impl.jdbc.Util.noCurrentConnection(Unknown Source) ~[derby-10.14.1.0.jar:?]
at org.apache.derby.impl.jdbc.EmbedConnection.checkIfClosed(Unknown Source) ~[derby-10.14.1.0.jar:?]
at org.apache.derby.impl.jdbc.EmbedConnection.setupContextStack(Unknown Source) ~[derby-10.14.1.0.jar:?]
at org.apache.derby.impl.jdbc.EmbedConnection.rollback(Unknown Source) ~[derby-10.14.1.0.jar:?]
at com.zaxxer.hikari.pool.ProxyConnection.rollback(ProxyConnection.java:362) ~[HikariCP-2.6.1.jar:?]
at com.zaxxer.hikari.pool.HikariProxyConnection.rollback(HikariProxyConnection.java) ~[HikariCP-2.6.1.jar:?]
{code}
> Lower Metastore DB Connection Pool Size in QTests
> -------------------------------------------------
>
> Key: HIVE-22469
> URL: https://issues.apache.org/jira/browse/HIVE-22469
> Project: Hive
> Issue Type: Improvement
> Components: Test, Tests
> Affects Versions: 3.2.0
> Reporter: David Mollitor
> Assignee: David Mollitor
> Priority: Minor
> Attachments: HIVE-22469.1.patch, HIVE-22469.2.patch
>
>
> Hive Metastore uses the 'HikariCP' database connection pool. The default number of connections to the database is 10. For the Qtests, connecting to a local DerbyDB, there need not be more than 2 connections. Anymore simply adds undo overhead and by looking at the QTest logs, I see a bunch of 'connection refused' from HikariCP. It may be the case that the standalone DB does not support that many concurrent connections anyway.
> [https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-MetaStore]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)