WG: issue during install of INFORMATION_SCHEMA and SYS on hadoop 2.9.1 hive 3.1.0

[Carsten Steckel <ca...@denken-machen-fertig.de>]

Dear all,

it took quite some time to figure out how to install the "information_schema" and "sys" schemas (thanks to https://issues.apache.org/jira/browse/HIVE-16941) into a hive 3.1.0 on hdfs/hadoop 2.9.1 and I am still unsure if it is the proper way of doing it.

when I execute:
hive@hive-server ~> schematool -metaDbType derby -dbType hive -initSchema -url jdbc:hive2://localhost:10000/default -driver org.apache.hive.jdbc.HiveDriver"

I receive a (from --verbose log):
[...]
Error: Error while compiling statement: FAILED: SemanticException org.apache.hadoop.hive.ql.metadata.InvalidTableException: Table not found _dummy_table (state=42000,code=40000)
org.apache.hadoop.hive.metastore.HiveMetaException: Schema initialization FAILED! Metastore state would be inconsistent !!
[...]

It seems to the last statement during setup of the sys-schema causes the issue. When executing it manually:

0: jdbc:hive2://localhost:10000> CREATE OR REPLACE VIEW `VERSION` AS SELECT 1 AS `VER_ID`, '3.1.0' AS `SCHEMA_VERSION`, 'Hive release version 3.1.0' AS `VERSION_COMMENT`;
Error: Error while compiling statement: FAILED: SemanticException org.apache.hadoop.hive.ql.metadata.InvalidTableException: Table not found _dummy_table (state=42000,code=40000)

I have tried to switch the metastore_db from derby embedded to derby server to postgresql and made sure the changed metadatabases each worked, but setting up the information_schema and sys schemas always delivers the same error.

Do I have to enable a property to allow the _dummy_table? As the created view selects without from clause?

Executing only the select part without the create view works:
0: jdbc:hive2://localhost:10000> SELECT 1 AS `VER_ID`, '3.1.0' AS `SCHEMA_VERSION`, 'Hive release version 3.1.0' AS `VERSION_COMMENT`;
+---------+-----------------+-----------------------------+
| ver_id  | schema_version  |       version_comment       |
+---------+-----------------+-----------------------------+
| 1       | 3.1.0           | Hive release version 3.1.0  |
+---------+-----------------+-----------------------------+
1 row selected (0.595 seconds)

Thanks for your hints.

Carsten