You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by GitBox <gi...@apache.org> on 2021/05/03 02:45:40 UTC
[GitHub] [iceberg] jackye1995 opened a new pull request #2549: Hive: add iceberg-aws to Hive runtime
jackye1995 opened a new pull request #2549:
URL: https://github.com/apache/iceberg/pull/2549
@pvary @yyanyy adding the AWS module to the Hie runtime jar. Verified with EMR 6.3.0 (Hive 3.1.2) that I can create external Glue type table and query successfully:
```
0: jdbc:hive2://localhost:10000> CREATE EXTERNAL TABLE db10.sample234
. . . . . . . . . . . . . . . .> STORED BY 'org.apache.iceberg.mr.hive.HiveIcebergStorageHandler'
. . . . . . . . . . . . . . . .> TBLPROPERTIES ('iceberg.catalog'='glue');
INFO : Compiling command(queryId=hive_20210503024236_8bdfc3e3-6b80-4731-a5d8-0e7f15026254): CREATE EXTERNAL TABLE db10.sample234
STORED BY 'org.apache.iceberg.mr.hive.HiveIcebergStorageHandler'
TBLPROPERTIES ('iceberg.catalog'='glue')
INFO : Concurrency mode is disabled, not creating a lock manager
INFO : Semantic Analysis Completed (retrial = false)
INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
INFO : Completed compiling command(queryId=hive_20210503024236_8bdfc3e3-6b80-4731-a5d8-0e7f15026254); Time taken: 0.024 seconds
INFO : Concurrency mode is disabled, not creating a lock manager
INFO : Executing command(queryId=hive_20210503024236_8bdfc3e3-6b80-4731-a5d8-0e7f15026254): CREATE EXTERNAL TABLE db10.sample234
STORED BY 'org.apache.iceberg.mr.hive.HiveIcebergStorageHandler'
TBLPROPERTIES ('iceberg.catalog'='glue')
INFO : Starting task [Stage-0:DDL] in serial mode
INFO : Completed executing command(queryId=hive_20210503024236_8bdfc3e3-6b80-4731-a5d8-0e7f15026254); Time taken: 0.633 seconds
INFO : OK
INFO : Concurrency mode is disabled, not creating a lock manager
No rows affected (0.671 seconds)
0: jdbc:hive2://localhost:10000> SELECT * FROM db10.sample234;
INFO : Compiling command(queryId=hive_20210503024254_f93f118a-3172-4224-a498-3d291c7a578d): SELECT * FROM db10.sample234
INFO : Concurrency mode is disabled, not creating a lock manager
INFO : Semantic Analysis Completed (retrial = false)
INFO : Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:sample234.id, type:bigint, comment:null), FieldSchema(name:sample234.data, type:string, comment:null), FieldSchema(name:sample234.category, type:string, comment:null)], properties:null)
INFO : Completed compiling command(queryId=hive_20210503024254_f93f118a-3172-4224-a498-3d291c7a578d); Time taken: 0.665 seconds
INFO : Concurrency mode is disabled, not creating a lock manager
INFO : Executing command(queryId=hive_20210503024254_f93f118a-3172-4224-a498-3d291c7a578d): SELECT * FROM db10.sample234
INFO : Completed executing command(queryId=hive_20210503024254_f93f118a-3172-4224-a498-3d291c7a578d); Time taken: 0.001 seconds
INFO : OK
INFO : Concurrency mode is disabled, not creating a lock manager
+---------------+-----------------+---------------------+
| sample234.id | sample234.data | sample234.category |
+---------------+-----------------+---------------------+
| 1 | a | c1 |
| 2 | b | c2 |
| 3 | c | c1 |
| 1 | a | c1 |
| 2 | b | c2 |
| 3 | c | c1 |
+---------------+-----------------+---------------------+
6 rows selected (2.107 seconds)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] yyanyy merged pull request #2549: Hive: add iceberg-aws to Hive runtime
Posted by GitBox <gi...@apache.org>.
yyanyy merged pull request #2549:
URL: https://github.com/apache/iceberg/pull/2549
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org