You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "zhangbutao (Jira)" <ji...@apache.org> on 2022/04/27 09:09:00 UTC
[jira] [Updated] (HIVE-26180) Change MySQLConnectorProvider driver from mariadb to mysql
[ https://issues.apache.org/jira/browse/HIVE-26180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
zhangbutao updated HIVE-26180:
------------------------------
Description:
I test with example {_}dataconnector_mysql.q{_}. When I execute _show tables_ from remote database, it failed with WARN log:
{code:java}
2022-04-27T16:52:34,696 WARN [Metastore-Handler-Pool: Thread-48] jdbc.AbstractJDBCConnectorProvider: Driver class not found in classpath:org.mariadb.jdbc.Driver
2022-04-27T16:52:34,698 WARN [Metastore-Handler-Pool: Thread-48] metastore.HMSHandler: Unexpected exception while getting table(s) in remote database db_mysql
org.apache.hadoop.hive.metastore.api.MetaException: Could not instantiate a provider for database db_mysql{code}
And so I add _mariadb-java-client-2.5.0.jar_ to hive lib, It is ok to show tables from remote database, but this leads to failure on native database:
{code:java}
2022-04-27T17:01:38,763 ERROR [Metastore-Handler-Pool: Thread-43] Datastore.Schema: An exception was thrown while adding/validating class(es) : Table "columns_v2" has been specified with a primary-key to include column "CD_ID" but this column is not found in the table. Please check your <primary-key> column specification.
Table "columns_v2" has been specified with a primary-key to include column "CD_ID" but this column is not found in the table. Please check your <primary-key> column specification.
org.datanucleus.exceptions.NucleusUserException: Table "columns_v2" has been specified with a primary-key to include column "CD_ID" but this column is not found in the table. Please check your <primary-key> column specification.
at org.datanucleus.store.rdbms.table.ElementContainerTable.applyUserPrimaryKeySpecification(ElementContainerTable.java:225)
at org.datanucleus.store.rdbms.table.CollectionTable.initialize(CollectionTable.java:235)
at org.datanucleus.store.rdbms.RDBMSStoreManager$ClassAdder.initializeClassTables(RDBMSStoreManager.java:3318)
at org.datanucleus.store.rdbms.RDBMSStoreManager$ClassAdder.run(RDBMSStoreManager.java:2938)
at org.datanucleus.store.rdbms.AbstractSchemaTransaction.execute(AbstractSchemaTransaction.java:118)
{code}
If I change MySQLConnectorProvider driver from mariadb to mysql, It's good to both remote mysql database and native database.
> Change MySQLConnectorProvider driver from mariadb to mysql
> ----------------------------------------------------------
>
> Key: HIVE-26180
> URL: https://issues.apache.org/jira/browse/HIVE-26180
> Project: Hive
> Issue Type: Bug
> Components: StorageHandler
> Affects Versions: 4.0.0-alpha-1, 4.0.0-alpha-2
> Reporter: zhangbutao
> Assignee: zhangbutao
> Priority: Major
>
> I test with example {_}dataconnector_mysql.q{_}. When I execute _show tables_ from remote database, it failed with WARN log:
>
> {code:java}
> 2022-04-27T16:52:34,696 WARN [Metastore-Handler-Pool: Thread-48] jdbc.AbstractJDBCConnectorProvider: Driver class not found in classpath:org.mariadb.jdbc.Driver
> 2022-04-27T16:52:34,698 WARN [Metastore-Handler-Pool: Thread-48] metastore.HMSHandler: Unexpected exception while getting table(s) in remote database db_mysql
> org.apache.hadoop.hive.metastore.api.MetaException: Could not instantiate a provider for database db_mysql{code}
>
> And so I add _mariadb-java-client-2.5.0.jar_ to hive lib, It is ok to show tables from remote database, but this leads to failure on native database:
> {code:java}
> 2022-04-27T17:01:38,763 ERROR [Metastore-Handler-Pool: Thread-43] Datastore.Schema: An exception was thrown while adding/validating class(es) : Table "columns_v2" has been specified with a primary-key to include column "CD_ID" but this column is not found in the table. Please check your <primary-key> column specification.
> Table "columns_v2" has been specified with a primary-key to include column "CD_ID" but this column is not found in the table. Please check your <primary-key> column specification.
> org.datanucleus.exceptions.NucleusUserException: Table "columns_v2" has been specified with a primary-key to include column "CD_ID" but this column is not found in the table. Please check your <primary-key> column specification.
> at org.datanucleus.store.rdbms.table.ElementContainerTable.applyUserPrimaryKeySpecification(ElementContainerTable.java:225)
> at org.datanucleus.store.rdbms.table.CollectionTable.initialize(CollectionTable.java:235)
> at org.datanucleus.store.rdbms.RDBMSStoreManager$ClassAdder.initializeClassTables(RDBMSStoreManager.java:3318)
> at org.datanucleus.store.rdbms.RDBMSStoreManager$ClassAdder.run(RDBMSStoreManager.java:2938)
> at org.datanucleus.store.rdbms.AbstractSchemaTransaction.execute(AbstractSchemaTransaction.java:118)
> {code}
>
> If I change MySQLConnectorProvider driver from mariadb to mysql, It's good to both remote mysql database and native database.
>
--
This message was sent by Atlassian Jira
(v8.20.7#820007)