You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Vihang Karajgaonkar (JIRA)" <ji...@apache.org> on 2018/04/09 20:26:00 UTC

[jira] [Created] (HIVE-19136) DbNotifications clean up throws NPE on mysql databases

Vihang Karajgaonkar created HIVE-19136:
------------------------------------------

             Summary: DbNotifications clean up throws NPE on mysql databases
                 Key: HIVE-19136
                 URL: https://issues.apache.org/jira/browse/HIVE-19136
             Project: Hive
          Issue Type: Bug
          Components: Metastore
    Affects Versions: 3.0.0
            Reporter: Vihang Karajgaonkar
            Assignee: Vihang Karajgaonkar


I see following stack trace in HMS logs when db notification cleaner thread tries to clean the old notification.

{noformat}
Exception in thread "CleanerThread" javax.jdo.JDODataStoreException: Transaction failed to commit
	at org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:543)
	at org.datanucleus.api.jdo.JDOTransaction.rollback(JDOTransaction.java:189)
	at org.apache.hadoop.hive.metastore.ObjectStore.rollbackTransaction(ObjectStore.java:790)
	at org.apache.hadoop.hive.metastore.ObjectStore.rollbackAndCleanup(ObjectStore.java:10425)
	at org.apache.hadoop.hive.metastore.ObjectStore.cleanNotificationEvents(ObjectStore.java:9258)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:97)
	at com.sun.proxy.$Proxy22.cleanNotificationEvents(Unknown Source)
	at org.apache.hive.hcatalog.listener.DbNotificationListener$CleanerThread.run(DbNotificationListener.java:737)
NestedThrowablesStackTrace:
Unexpected exception encountered during query.
org.datanucleus.exceptions.NucleusDataStoreException: Unexpected exception encountered during query.
	at org.datanucleus.store.rdbms.ConnectionFactoryImpl$ManagedConnectionImpl.close(ConnectionFactoryImpl.java:569)
	at org.datanucleus.store.connection.ConnectionManagerImpl$2.transactionRolledBack(ConnectionManagerImpl.java:400)
	at org.datanucleus.TransactionImpl.internalRollback(TransactionImpl.java:534)
	at org.datanucleus.TransactionImpl.rollback(TransactionImpl.java:451)
	at org.datanucleus.api.jdo.JDOTransaction.rollback(JDOTransaction.java:185)
	at org.apache.hadoop.hive.metastore.ObjectStore.rollbackTransaction(ObjectStore.java:790)
	at org.apache.hadoop.hive.metastore.ObjectStore.rollbackAndCleanup(ObjectStore.java:10425)
	at org.apache.hadoop.hive.metastore.ObjectStore.cleanNotificationEvents(ObjectStore.java:9258)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:97)
	at com.sun.proxy.$Proxy22.cleanNotificationEvents(Unknown Source)
	at org.apache.hive.hcatalog.listener.DbNotificationListener$CleanerThread.run(DbNotificationListener.java:737)
Caused by: java.sql.SQLException: Unexpected exception encountered during query.
	at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:963)
	at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:896)
	at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:885)
	at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:860)
	at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2582)
	at com.mysql.jdbc.ConnectionImpl.rollbackNoChecks(ConnectionImpl.java:4698)
	at com.mysql.jdbc.ConnectionImpl.rollback(ConnectionImpl.java:4590)
	at com.zaxxer.hikari.pool.ProxyConnection.close(ProxyConnection.java:233)
	at org.datanucleus.store.rdbms.ConnectionFactoryImpl$ManagedConnectionImpl.close(ConnectionFactoryImpl.java:557)
	... 14 more
Caused by: java.lang.NullPointerException
	at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2545)
	... 18 more
Nested Throwables StackTrace:
java.sql.SQLException: Unexpected exception encountered during query.
	at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:963)
	at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:896)
	at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:885)
	at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:860)
	at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2582)
	at com.mysql.jdbc.ConnectionImpl.rollbackNoChecks(ConnectionImpl.java:4698)
	at com.mysql.jdbc.ConnectionImpl.rollback(ConnectionImpl.java:4590)
	at com.zaxxer.hikari.pool.ProxyConnection.close(ProxyConnection.java:233)
	at org.datanucleus.store.rdbms.ConnectionFactoryImpl$ManagedConnectionImpl.close(ConnectionFactoryImpl.java:557)
	at org.datanucleus.store.connection.ConnectionManagerImpl$2.transactionRolledBack(ConnectionManagerImpl.java:400)
	at org.datanucleus.TransactionImpl.internalRollback(TransactionImpl.java:534)
	at org.datanucleus.TransactionImpl.rollback(TransactionImpl.java:451)
	at org.datanucleus.api.jdo.JDOTransaction.rollback(JDOTransaction.java:185)
	at org.apache.hadoop.hive.metastore.ObjectStore.rollbackTransaction(ObjectStore.java:790)
	at org.apache.hadoop.hive.metastore.ObjectStore.rollbackAndCleanup(ObjectStore.java:10425)
	at org.apache.hadoop.hive.metastore.ObjectStore.cleanNotificationEvents(ObjectStore.java:9258)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:97)
	at com.sun.proxy.$Proxy22.cleanNotificationEvents(Unknown Source)
	at org.apache.hive.hcatalog.listener.DbNotificationListener$CleanerThread.run(DbNotificationListener.java:737)
Caused by: java.lang.NullPointerException
	at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2545)
	... 18 more
{noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)