You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Peter Vary (Jira)" <ji...@apache.org> on 2019/12/04 13:07:00 UTC

[jira] [Commented] (HIVE-22580) Flakyness in TestDbTxnManager2

    [ https://issues.apache.org/jira/browse/HIVE-22580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16987840#comment-16987840 ] 

Peter Vary commented on HIVE-22580:
-----------------------------------


My theory is that the previous test ends, and the heartbeating thread is interrupted inside of the derby call. MetaStoreDirectSql.ensureDbInit() catches the InterruptedException (this happens only with EmbeddedMetaStore), and never rethrows it. So the heartbeater never interrupted, and RetryingMetaStoreClient retries the heartbeat. This recreates/reinitializes the   txnDb, see:
{code}
2019-12-03T20:18:49,221  INFO [Heartbeater-1] txn.TxnHandler: Hacking in canned values for transaction manager
{code}
This log line is printed just before {code}TxnDbUtil.prepDb(conf);{code} is executed, so the heartbeater thread starts to recreate the txnDb related tables.
The main thread finishes the previous test case, and runs setup for the next test. This also drops, and starts the txnDb related tables. But sees that the first table is already there and so decided that the tables are already there:
{code}
2019-12-03T20:18:49,235  INFO [main] txn.TxnDbUtil: Txn tables already exist, returning
{code}
The problem is that not all of the tables are there. So when it wants to read the NEXT_TXN_ID it fails, since the first thread (heartbeater) is not there.

So the issue is twofold:
* Need a fix how MetaStoreDirectSql.ensureDbInit() handles InterruptedException - this is kinda risky, might worth another jira to understand the sideeffects of this.
* Need to synchronize TxnDbUtil.prepDb(), so no concurrent table creation happens

> Flakyness in TestDbTxnManager2
> ------------------------------
>
>                 Key: HIVE-22580
>                 URL: https://issues.apache.org/jira/browse/HIVE-22580
>             Project: Hive
>          Issue Type: Test
>            Reporter: Peter Vary
>            Assignee: Peter Vary
>            Priority: Minor
>
> Different TestDbTxnManager2 tests are failing intermittently with:
> {code}
> 2019-12-03T20:18:49,269 DEBUG [main] pool.PoolBase: HikariPool-1 - Reset (autoCommit) on connection org.apache.derby.impl.jdbc.EmbedConnection@912054991 (XID = 347), (SESSIONID = 7), (DATABASE = memory:/data/jenkins/workspace/hive-TestDbTxnManager2/hive/ql/target/tmp/junit_metastore_db), (DRDAID = null) 
> 2019-12-03T20:18:49,270 ERROR [main] metastore.RetryingHMSHandler: MetaException(message:Unable to select from transaction database java.sql.SQLSyntaxErrorException: Table/View 'NEXT_TXN_ID' does not exist.
> 	at org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
> 	at org.apache.derby.impl.jdbc.Util.generateCsSQLException(Unknown Source)
> 	at org.apache.derby.impl.jdbc.TransactionResourceImpl.wrapInSQLException(Unknown Source)
> 	at org.apache.derby.impl.jdbc.TransactionResourceImpl.handleException(Unknown Source)
> 	at org.apache.derby.impl.jdbc.EmbedConnection.handleException(Unknown Source)
> 	at org.apache.derby.impl.jdbc.ConnectionChild.handleException(Unknown Source)
> 	at org.apache.derby.impl.jdbc.EmbedStatement.execute(Unknown Source)
> 	at org.apache.derby.impl.jdbc.EmbedStatement.executeQuery(Unknown Source)
> 	at com.zaxxer.hikari.pool.ProxyStatement.executeQuery(ProxyStatement.java:108)
> 	at com.zaxxer.hikari.pool.HikariProxyStatement.executeQuery(HikariProxyStatement.java)
> 	at org.apache.hadoop.hive.metastore.txn.TxnHandler.openTxns(TxnHandler.java:604)
> 	at org.apache.hadoop.hive.metastore.txn.TxnHandler.openTxns(TxnHandler.java:560)
> 	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.open_txns(HiveMetaStore.java:8095)
> 	at sun.reflect.GeneratedMethodAccessor47.invoke(Unknown Source)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:498)
> 	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:147)
> 	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:108)
> 	at com.sun.proxy.$Proxy38.open_txns(Unknown Source)
> 	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.openTxnsIntr(HiveMetaStoreClient.java:3139)
> 	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.openTxn(HiveMetaStoreClient.java:3103)
> 	at sun.reflect.GeneratedMethodAccessor46.invoke(Unknown Source)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:498)
> 	at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:212)
> 	at com.sun.proxy.$Proxy39.openTxn(Unknown Source)
> 	at org.apache.hadoop.hive.ql.lockmgr.DbTxnManager.openTxn(DbTxnManager.java:250)
> 	at org.apache.hadoop.hive.ql.lockmgr.DbTxnManager.openTxn(DbTxnManager.java:234)
> 	at org.apache.hadoop.hive.ql.Driver.openTransaction(Driver.java:915)
> 	at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:640)
> 	at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1504)
> 	at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1564)
> 	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1387)
> 	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1376)
> 	at org.apache.hadoop.hive.ql.lockmgr.TestDbTxnManager2.dropTable(TestDbTxnManager2.java:974)
> 	at org.apache.hadoop.hive.ql.lockmgr.TestDbTxnManager2.testLockBlockedBy(TestDbTxnManager2.java:396)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:498)
> 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
> 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
> 	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> 	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> 	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
> 	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
> 	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
> 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
> 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
> 	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
> 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
> 	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
> 	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
> 	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
> 	at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
> 	at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
> 	at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273)
> 	at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
> 	at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159)
> 	at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:379)
> 	at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:340)
> 	at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:125)
> 	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:413)
> Caused by: ERROR 42X05: Table/View 'NEXT_TXN_ID' does not exist.
> 	at org.apache.derby.iapi.error.StandardException.newException(Unknown Source)
> 	at org.apache.derby.iapi.error.StandardException.newException(Unknown Source)
> 	at org.apache.derby.impl.sql.compile.FromBaseTable.bindTableDescriptor(Unknown Source)
> 	at org.apache.derby.impl.sql.compile.FromBaseTable.bindNonVTITables(Unknown Source)
> 	at org.apache.derby.impl.sql.compile.FromList.bindTables(Unknown Source)
> 	at org.apache.derby.impl.sql.compile.SelectNode.bindNonVTITables(Unknown Source)
> 	at org.apache.derby.impl.sql.compile.DMLStatementNode.bindTables(Unknown Source)
> 	at org.apache.derby.impl.sql.compile.DMLStatementNode.bind(Unknown Source)
> 	at org.apache.derby.impl.sql.compile.CursorNode.bindStatement(Unknown Source)
> 	at org.apache.derby.impl.sql.GenericStatement.prepMinion(Unknown Source)
> 	at org.apache.derby.impl.sql.GenericStatement.prepare(Unknown Source)
> 	at org.apache.derby.impl.sql.conn.GenericLanguageConnectionContext.prepareInternalStatement(Unknown Source)
> 	... 59 more
> )
> 	at org.apache.hadoop.hive.metastore.txn.TxnHandler.openTxns(TxnHandler.java:570)
> 	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.open_txns(HiveMetaStore.java:8095)
> 	at sun.reflect.GeneratedMethodAccessor47.invoke(Unknown Source)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:498)
> 	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:147)
> 	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:108)
> 	at com.sun.proxy.$Proxy38.open_txns(Unknown Source)
> 	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.openTxnsIntr(HiveMetaStoreClient.java:3139)
> 	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.openTxn(HiveMetaStoreClient.java:3103)
> 	at sun.reflect.GeneratedMethodAccessor46.invoke(Unknown Source)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:498)
> 	at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:212)
> 	at com.sun.proxy.$Proxy39.openTxn(Unknown Source)
> 	at org.apache.hadoop.hive.ql.lockmgr.DbTxnManager.openTxn(DbTxnManager.java:250)
> 	at org.apache.hadoop.hive.ql.lockmgr.DbTxnManager.openTxn(DbTxnManager.java:234)
> 	at org.apache.hadoop.hive.ql.Driver.openTransaction(Driver.java:915)
> 	at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:640)
> 	at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1504)
> 	at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1564)
> 	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1387)
> 	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1376)
> 	at org.apache.hadoop.hive.ql.lockmgr.TestDbTxnManager2.dropTable(TestDbTxnManager2.java:974)
> 	at org.apache.hadoop.hive.ql.lockmgr.TestDbTxnManager2.testLockBlockedBy(TestDbTxnManager2.java:396)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:498)
> 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
> 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
> 	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> 	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> 	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
> 	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
> 	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
> 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
> 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
> 	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
> 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
> 	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
> 	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
> 	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
> 	at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
> 	at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
> 	at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273)
> 	at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
> 	at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159)
> 	at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:379)
> 	at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:340)
> 	at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:125)
> 	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:413)
> {code}
> Before this failure we are seeing this:
> {code}
> 2019-12-03T20:18:49,180  WARN [Heartbeater-1] pool.ProxyConnection: HikariPool-3 - Connection org.apache.derby.impl.jdbc.EmbedConnection@1077215639 (XID = 389), (SESSIONID = 49), (DATABASE = memory:/data/jenkins/workspace/hive-TestDbTxnManager2/hive/ql/target/tmp/junit_metastore_db), (DRDAID = null)  marked as broken because of SQLSTATE(08000), ErrorCode(40000)
> java.sql.SQLNonTransientConnectionException: Connection closed by unknown interrupt.
> 	at org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source) ~[derby-10.14.2.0.jar:?]
> 	at org.apache.derby.impl.jdbc.Util.generateCsSQLException(Unknown Source) ~[derby-10.14.2.0.jar:?]
> 	at org.apache.derby.impl.jdbc.TransactionResourceImpl.wrapInSQLException(Unknown Source) ~[derby-10.14.2.0.jar:?]
> 	at org.apache.derby.impl.jdbc.TransactionResourceImpl.handleException(Unknown Source) ~[derby-10.14.2.0.jar:?]
> 	at org.apache.derby.impl.jdbc.EmbedConnection.handleException(Unknown Source) ~[derby-10.14.2.0.jar:?]
> 	at org.apache.derby.impl.jdbc.ConnectionChild.handleException(Unknown Source) ~[derby-10.14.2.0.jar:?]
> 	at org.apache.derby.impl.jdbc.EmbedResultSet.closeOnTransactionError(Unknown Source) ~[derby-10.14.2.0.jar:?]
> 	at org.apache.derby.impl.jdbc.EmbedResultSet.movePosition(Unknown Source) ~[derby-10.14.2.0.jar:?]
> 	at org.apache.derby.impl.jdbc.EmbedResultSet.next(Unknown Source) ~[derby-10.14.2.0.jar:?]
> 	at com.zaxxer.hikari.pool.HikariProxyResultSet.next(HikariProxyResultSet.java) ~[HikariCP-2.6.1.jar:?]
> 	at org.datanucleus.store.rdbms.query.ForwardQueryResult.initialise(ForwardQueryResult.java:99) ~[datanucleus-rdbms-4.1.19.jar:?]
> 	at org.datanucleus.store.rdbms.query.JDOQLQuery.performExecute(JDOQLQuery.java:703) ~[datanucleus-rdbms-4.1.19.jar:?]
> 	at org.datanucleus.store.query.Query.executeQuery(Query.java:1855) ~[datanucleus-core-4.1.17.jar:?]
> 	at org.datanucleus.store.query.Query.executeWithArray(Query.java:1744) ~[datanucleus-core-4.1.17.jar:?]
> 	at org.datanucleus.store.query.Query.execute(Query.java:1726) ~[datanucleus-core-4.1.17.jar:?]
> 	at org.datanucleus.api.jdo.JDOQuery.executeInternal(JDOQuery.java:374) ~[datanucleus-api-jdo-4.2.4.jar:?]
> 	at org.datanucleus.api.jdo.JDOQuery.execute(JDOQuery.java:216) ~[datanucleus-api-jdo-4.2.4.jar:?]
> 	at org.apache.hadoop.hive.metastore.MetaStoreDirectSql.ensureDbInit(MetaStoreDirectSql.java:246) ~[hive-standalone-metastore-3.1.2000.7.1.0.0-SNAPSHOT.jar:3.1.2000.7.1.0.0-SNAPSHOT]
> 	at org.apache.hadoop.hive.metastore.MetaStoreDirectSql.<init>(MetaStoreDirectSql.java:188) ~[hive-standalone-metastore-3.1.2000.7.1.0.0-SNAPSHOT.jar:3.1.2000.7.1.0.0-SNAPSHOT]
> 	at org.apache.hadoop.hive.metastore.ObjectStore.initializeHelper(ObjectStore.java:513) ~[hive-standalone-metastore-3.1.2000.7.1.0.0-SNAPSHOT.jar:3.1.2000.7.1.0.0-SNAPSHOT]
> 	at org.apache.hadoop.hive.metastore.ObjectStore.initialize(ObjectStore.java:432) ~[hive-standalone-metastore-3.1.2000.7.1.0.0-SNAPSHOT.jar:3.1.2000.7.1.0.0-SNAPSHOT]
> 	at org.apache.hadoop.hive.metastore.ObjectStore.setConf(ObjectStore.java:385) ~[hive-standalone-metastore-3.1.2000.7.1.0.0-SNAPSHOT.jar:3.1.2000.7.1.0.0-SNAPSHOT]
> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:77) ~[hadoop-common-3.1.1.7.1.0.0-SNAPSHOT.jar:?]
> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:137) ~[hadoop-common-3.1.1.7.1.0.0-SNAPSHOT.jar:?]
> 	at org.apache.hadoop.hive.metastore.RawStoreProxy.<init>(RawStoreProxy.java:59) ~[hive-standalone-metastore-3.1.2000.7.1.0.0-SNAPSHOT.jar:3.1.2000.7.1.0.0-SNAPSHOT]
> 	at org.apache.hadoop.hive.metastore.RawStoreProxy.getProxy(RawStoreProxy.java:67) ~[hive-standalone-metastore-3.1.2000.7.1.0.0-SNAPSHOT.jar:3.1.2000.7.1.0.0-SNAPSHOT]
> 	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.newRawStoreForConf(HiveMetaStore.java:781) ~[hive-standalone-metastore-3.1.2000.7.1.0.0-SNAPSHOT.jar:3.1.2000.7.1.0.0-SNAPSHOT]
> 	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMSForConf(HiveMetaStore.java:749) ~[hive-standalone-metastore-3.1.2000.7.1.0.0-SNAPSHOT.jar:3.1.2000.7.1.0.0-SNAPSHOT]
> 	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:743) ~[hive-standalone-metastore-3.1.2000.7.1.0.0-SNAPSHOT.jar:3.1.2000.7.1.0.0-SNAPSHOT]
> 	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:605) ~[hive-standalone-metastore-3.1.2000.7.1.0.0-SNAPSHOT.jar:3.1.2000.7.1.0.0-SNAPSHOT]
> 	at sun.reflect.GeneratedMethodAccessor87.invoke(Unknown Source) ~[?:?]
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_202]
> 	at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_202]
> 	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:147) ~[hive-standalone-metastore-3.1.2000.7.1.0.0-SNAPSHOT.jar:3.1.2000.7.1.0.0-SNAPSHOT]
> 	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:108) ~[hive-standalone-metastore-3.1.2000.7.1.0.0-SNAPSHOT.jar:3.1.2000.7.1.0.0-SNAPSHOT]
> 	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:80) ~[hive-standalone-metastore-3.1.2000.7.1.0.0-SNAPSHOT.jar:3.1.2000.7.1.0.0-SNAPSHOT]
> 	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:93) ~[hive-standalone-metastore-3.1.2000.7.1.0.0-SNAPSHOT.jar:3.1.2000.7.1.0.0-SNAPSHOT]
> 	at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:9820) ~[hive-standalone-metastore-3.1.2000.7.1.0.0-SNAPSHOT.jar:3.1.2000.7.1.0.0-SNAPSHOT]
> 	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:172) ~[hive-standalone-metastore-3.1.2000.7.1.0.0-SNAPSHOT.jar:3.1.2000.7.1.0.0-SNAPSHOT]
> 	at org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.<init>(SessionHiveMetaStoreClient.java:112) ~[classes/:?]
> 	at sun.reflect.GeneratedConstructorAccessor281.newInstance(Unknown Source) ~[?:?]
> 	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) ~[?:1.8.0_202]
> 	at java.lang.reflect.Constructor.newInstance(Constructor.java:423) ~[?:1.8.0_202]
> 	at org.apache.hadoop.hive.metastore.utils.JavaUtils.newInstance(JavaUtils.java:84) ~[hive-standalone-metastore-3.1.2000.7.1.0.0-SNAPSHOT.jar:3.1.2000.7.1.0.0-SNAPSHOT]
> 	at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:95) ~[hive-standalone-metastore-3.1.2000.7.1.0.0-SNAPSHOT.jar:3.1.2000.7.1.0.0-SNAPSHOT]
> 	at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:148) ~[hive-standalone-metastore-3.1.2000.7.1.0.0-SNAPSHOT.jar:3.1.2000.7.1.0.0-SNAPSHOT]
> 	at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:119) ~[hive-standalone-metastore-3.1.2000.7.1.0.0-SNAPSHOT.jar:3.1.2000.7.1.0.0-SNAPSHOT]
> 	at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:4842) ~[classes/:?]
> 	at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:4910) ~[classes/:?]
> 	at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:4890) ~[classes/:?]
> 	at org.apache.hadoop.hive.ql.lockmgr.DbTxnManager.getMS(DbTxnManager.java:192) ~[classes/:?]
> 	at org.apache.hadoop.hive.ql.lockmgr.DbTxnManager.heartbeat(DbTxnManager.java:632) ~[classes/:?]
> 	at org.apache.hadoop.hive.ql.lockmgr.DbTxnManager$Heartbeater.lambda$run$0(DbTxnManager.java:1038) ~[classes/:?]
> 	at java.security.AccessController.doPrivileged(Native Method) [?:1.8.0_202]
> 	at javax.security.auth.Subject.doAs(Subject.java:422) [?:1.8.0_202]
> 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1876) [hadoop-common-3.1.1.7.1.0.0-SNAPSHOT.jar:?]
> 	at org.apache.hadoop.hive.ql.lockmgr.DbTxnManager$Heartbeater.run(DbTxnManager.java:1037) [classes/:?]
> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_202]
> 	at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [?:1.8.0_202]
> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) [?:1.8.0_202]
> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) [?:1.8.0_202]
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_202]
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_202]
> 	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_202]
> Caused by: org.apache.derby.iapi.error.StandardException: Connection closed by unknown interrupt.
> 	at org.apache.derby.iapi.error.StandardException.newException(Unknown Source) ~[derby-10.14.2.0.jar:?]
> 	at org.apache.derby.iapi.error.StandardException.newException(Unknown Source) ~[derby-10.14.2.0.jar:?]
> 	at org.apache.derby.iapi.util.InterruptStatus.setInterrupted(Unknown Source) ~[derby-10.14.2.0.jar:?]
> 	at org.apache.derby.iapi.util.InterruptStatus.throwIf(Unknown Source) ~[derby-10.14.2.0.jar:?]
> 	at org.apache.derby.impl.sql.execute.BasicNoPutResultSetImpl.checkCancellationFlag(Unknown Source) ~[derby-10.14.2.0.jar:?]
> 	at org.apache.derby.impl.sql.execute.BulkTableScanResultSet.getNextRowCore(Unknown Source) ~[derby-10.14.2.0.jar:?]
> 	at org.apache.derby.impl.sql.execute.ProjectRestrictResultSet.getNextRowCore(Unknown Source) ~[derby-10.14.2.0.jar:?]
> 	at org.apache.derby.impl.sql.execute.BasicNoPutResultSetImpl.getNextRow(Unknown Source) ~[derby-10.14.2.0.jar:?]
> 	... 57 more
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)