You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by GitBox <gi...@apache.org> on 2021/06/15 16:21:03 UTC

[GitHub] [iceberg] WesternStar edited a comment on issue #2696: Can't seem to read from glue iceberg table in EMR Hive

WesternStar edited a comment on issue #2696:
URL: https://github.com/apache/iceberg/issues/2696#issuecomment-861639310


   I was using java 11 and only java 8 was correct to use on emr
   However still having a couple of issues here that I'm working through.
   ```
   Hive Session ID = 6bc6ce9f-83e2-4f4a-bff0-c884f8aceb6d
   hive> add jar /lib/hive/auxlib/iceberg-hive-runtime-master-j8.jar
       > ;
   Added [/lib/hive/auxlib/iceberg-hive-runtime-master-j8.jar] to class path
   Added resources: [/lib/hive/auxlib/iceberg-hive-runtime-master-j8.jar]
   hive> list jars;
   /lib/hive/auxlib/iceberg-hive-runtime-master-j8.jar
   hive> SET iceberg.engine.hive.enabled=true;
   hive> SET hive.vectorized.execution.enabled=false;
   hive> SET iceberg.catalog.glue.catalog-impl=org.apache.iceberg.aws.glue.GlueCatalog;
   hive> SET iceberg.catalog.glue.warehouse=s3://XXXXXXX/amcnair/testing/iceberg/fix/;
   hive> SET iceberg.catalog.glue.lock-impl=org.apache.iceberg.aws.glue.DynamoLockManager;
   hive> SET iceberg.catalog.glue.lock.table=IcebergTestingAmcnair;
   hive> CREATE EXTERNAL TABLE iceberg_db.sample
       > STORED BY 'org.apache.iceberg.mr.hive.HiveIcebergStorageHandler'
       > TBLPROPERTIES ('iceberg.catalog'='glue','engine.hive.enabled'='true' );
   SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
   SLF4J: Defaulting to no-operation (NOP) logger implementation
   SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
   FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. AlreadyExistsException(message:Table sample already exists.)
   hive> select * from iceberg_db.sample
       > ;
   FAILED: SemanticException Unable to fetch table sample. StorageDescriptor cannot be null for table: sample (Service: null; Status Code: 0; Error Code: null; Request ID: null; Proxy: null)
   hive> CREATE EXTERNAL TABLE iceberg_db.ext_sample
       > STORED BY 'org.apache.iceberg.mr.hive.HiveIcebergStorageHandler'
       > TBLPROPERTIES ('iceberg.catalog'='glue','engine.hive.enabled'='true' );
   FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. java.lang.RuntimeException: MetaException(message:org.apache.hadoop.hive.serde2.SerDeException Please provide an existing table or a valid schema)
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org