You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Carsten Steckel (JIRA)" <ji...@apache.org> on 2018/11/06 15:58:00 UTC
[jira] [Updated] (HIVE-20872) Creating information_schema and sys
schema via schematool fails with parser error
[ https://issues.apache.org/jira/browse/HIVE-20872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Carsten Steckel updated HIVE-20872:
-----------------------------------
Description:
it took quite some time to figure out how to install the "information_schema" and "sys" schemas (thanks to https://issues.apache.org/jira/browse/HIVE-16941) into a hive 3.1.0/3.1.1 on hdfs/hadoop 2.9.1 and I am still unsure if it is the proper way of doing it.
when I execute:
{noformat}
hive@hive-server ~> schematool -metaDbType derby -dbType hive -initSchema -url jdbc:hive2://localhost:10000/default -driver org.apache.hive.jdbc.HiveDriver"
{noformat}
I receive an error (from --verbose log):
{noformat}
[...]
Error: Error while compiling statement: FAILED: SemanticException org.apache.hadoop.hive.ql.metadata.InvalidTableException: Table not found _dummy_table (state=42000,code=40000)
org.apache.hadoop.hive.metastore.HiveMetaException: Schema initialization FAILED! Metastore state would be inconsistent !!
[...]
{noformat}
It seems to be the last statement during setup of the sys-schema causes the issue. When executing it manually:
{noformat}
0: jdbc:hive2://localhost:10000> CREATE OR REPLACE VIEW `VERSION` AS SELECT 1 AS `VER_ID`, '3.1.0' AS `SCHEMA_VERSION`, 'Hive release version 3.1.0' AS `VERSION_COMMENT`;
Error: Error while compiling statement: FAILED: SemanticException org.apache.hadoop.hive.ql.metadata.InvalidTableException: Table not found _dummy_table (state=42000,code=40000)
{noformat}
I have tried to switch the metastore_db from derby embedded to derby server to postgresql and made sure the changed metadatabases each worked, but setting up the information_schema and sys schemas always delivers the same error.
Executing only the select part without the create view works:
{noformat}
0: jdbc:hive2://localhost:10000> SELECT 1 AS `VER_ID`, '3.1.0' AS `SCHEMA_VERSION`, 'Hive release version 3.1.0' AS `VERSION_COMMENT`;
+---------+-----------------+-----------------------------+
| ver_id | schema_version | version_comment |
+---------+-----------------+-----------------------------+
| 1 | 3.1.0 | Hive release version 3.1.0 |
+---------+-----------------+-----------------------------+
1 row selected (0.595 seconds)
{noformat}
It seems to be related to: HIVE-19444
was:
it took quite some time to figure out how to install the "information_schema" and "sys" schemas (thanks to https://issues.apache.org/jira/browse/HIVE-16941) into a hive 3.1.0/3.1.1 on hdfs/hadoop 2.9.1 and I am still unsure if it is the proper way of doing it.
when I execute:
{noformat}
hive@hive-server ~> schematool -metaDbType derby -dbType hive -initSchema -url jdbc:hive2://localhost:10000/default -driver org.apache.hive.jdbc.HiveDriver"
{noformat}
I receive a (from --verbose log):
{noformat}
[...]
Error: Error while compiling statement: FAILED: SemanticException org.apache.hadoop.hive.ql.metadata.InvalidTableException: Table not found _dummy_table (state=42000,code=40000)
org.apache.hadoop.hive.metastore.HiveMetaException: Schema initialization FAILED! Metastore state would be inconsistent !!
[...]
{noformat}
It seems to the last statement during setup of the sys-schema causes the issue. When executing it manually:
{noformat}
0: jdbc:hive2://localhost:10000> CREATE OR REPLACE VIEW `VERSION` AS SELECT 1 AS `VER_ID`, '3.1.0' AS `SCHEMA_VERSION`, 'Hive release version 3.1.0' AS `VERSION_COMMENT`;
Error: Error while compiling statement: FAILED: SemanticException org.apache.hadoop.hive.ql.metadata.InvalidTableException: Table not found _dummy_table (state=42000,code=40000)
{noformat}
I have tried to switch the metastore_db from derby embedded to derby server to postgresql and made sure the changed metadatabases each worked, but setting up the information_schema and sys schemas always delivers the same error.
Executing only the select part without the create view works:
{noformat}
0: jdbc:hive2://localhost:10000> SELECT 1 AS `VER_ID`, '3.1.0' AS `SCHEMA_VERSION`, 'Hive release version 3.1.0' AS `VERSION_COMMENT`;
+---------+-----------------+-----------------------------+
| ver_id | schema_version | version_comment |
+---------+-----------------+-----------------------------+
| 1 | 3.1.0 | Hive release version 3.1.0 |
+---------+-----------------+-----------------------------+
1 row selected (0.595 seconds)
{noformat}
It seems to be related to: HIVE-19444
> Creating information_schema and sys schema via schematool fails with parser error
> ---------------------------------------------------------------------------------
>
> Key: HIVE-20872
> URL: https://issues.apache.org/jira/browse/HIVE-20872
> Project: Hive
> Issue Type: Bug
> Components: Hive, HiveServer2, Metastore, SQL
> Affects Versions: 3.1.0, 3.1.1
> Environment: Apache Hive (version 3.1.1)
> Hive JDBC (version 3.1.1)
> metastore on derby embedded, derby server, postgres server
> Apache Hadoop (version 2.9.1)
> Reporter: Carsten Steckel
> Priority: Critical
>
> it took quite some time to figure out how to install the "information_schema" and "sys" schemas (thanks to https://issues.apache.org/jira/browse/HIVE-16941) into a hive 3.1.0/3.1.1 on hdfs/hadoop 2.9.1 and I am still unsure if it is the proper way of doing it.
> when I execute:
>
> {noformat}
> hive@hive-server ~> schematool -metaDbType derby -dbType hive -initSchema -url jdbc:hive2://localhost:10000/default -driver org.apache.hive.jdbc.HiveDriver"
> {noformat}
> I receive an error (from --verbose log):
>
> {noformat}
> [...]
> Error: Error while compiling statement: FAILED: SemanticException org.apache.hadoop.hive.ql.metadata.InvalidTableException: Table not found _dummy_table (state=42000,code=40000)
> org.apache.hadoop.hive.metastore.HiveMetaException: Schema initialization FAILED! Metastore state would be inconsistent !!
> [...]
> {noformat}
>
> It seems to be the last statement during setup of the sys-schema causes the issue. When executing it manually:
>
>
> {noformat}
> 0: jdbc:hive2://localhost:10000> CREATE OR REPLACE VIEW `VERSION` AS SELECT 1 AS `VER_ID`, '3.1.0' AS `SCHEMA_VERSION`, 'Hive release version 3.1.0' AS `VERSION_COMMENT`;
> Error: Error while compiling statement: FAILED: SemanticException org.apache.hadoop.hive.ql.metadata.InvalidTableException: Table not found _dummy_table (state=42000,code=40000)
> {noformat}
>
> I have tried to switch the metastore_db from derby embedded to derby server to postgresql and made sure the changed metadatabases each worked, but setting up the information_schema and sys schemas always delivers the same error.
> Executing only the select part without the create view works:
>
> {noformat}
> 0: jdbc:hive2://localhost:10000> SELECT 1 AS `VER_ID`, '3.1.0' AS `SCHEMA_VERSION`, 'Hive release version 3.1.0' AS `VERSION_COMMENT`;
> +---------+-----------------+-----------------------------+
> | ver_id | schema_version | version_comment |
> +---------+-----------------+-----------------------------+
> | 1 | 3.1.0 | Hive release version 3.1.0 |
> +---------+-----------------+-----------------------------+
> 1 row selected (0.595 seconds)
> {noformat}
> It seems to be related to: HIVE-19444
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)