You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "ryu3065 (via GitHub)" <gi...@apache.org> on 2023/05/03 10:15:15 UTC
[GitHub] [iceberg] ryu3065 opened a new issue, #7512: When i using Iceberg, How can I use Glue catalog in EMR 6.10.0 without catalog name
ryu3065 opened a new issue, #7512:
URL: https://github.com/apache/iceberg/issues/7512
### Query engine
EMR 6.10.0
apply spark options
'spark.sql.extensions': 'org.apache.iceberg.spark.extensions.IcebergSparkSessionExtensions',
'spark.sql.catalog.spark_iceberg': 'org.apache.iceberg.spark.SparkCatalog',
'spark.sql.catalog.spark_iceberg.catalog-impl': 'org.apache.iceberg.aws.glue.GlueCatalog',
'spark.sql.catalog.spark_iceberg.warehouse': '{S3_bucket_location}/spark_iceberg/',
'spark.sql.catalog.spark_iceberg.io-impl': 'org.apache.iceberg.aws.s3.S3FileIO',
'spark.sql.catalog.spark_iceberg.lock-impl': 'org.apache.iceberg.aws.dynamodb.DynamoDbLockManager',
'spark.sql.catalog.spark_iceberg.lock.table': 'bdp-emr-iceberg-lock',
### Question
How can I use Glue catalog with Iceberg in EMR 6.10.0 and reference tables in the format of `{database}.{tables}` like Athena without using a custom catalog name?
I want to use `{database}.{table}` not `{catalog}.{database}.{table}`
ex) select * from spark_sql.db.tbl1 -> select * from db.tbl1
plz help :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] ryu3065 closed issue #7512: How can I use Glue catalog in EMR 6.10.0 without catalog name
Posted by "ryu3065 (via GitHub)" <gi...@apache.org>.
ryu3065 closed issue #7512: How can I use Glue catalog in EMR 6.10.0 without catalog name
URL: https://github.com/apache/iceberg/issues/7512
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] ryu3065 commented on issue #7512: How can I use Glue catalog in EMR 6.10.0 without catalog name
Posted by "ryu3065 (via GitHub)" <gi...@apache.org>.
ryu3065 commented on issue #7512:
URL: https://github.com/apache/iceberg/issues/7512#issuecomment-1571676182
@akshayakp97
Hi :)
I facing another problem.. Could you plz help me?
(https://github.com/apache/iceberg/issues/7748)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] ryu3065 commented on issue #7512: How can I use Glue catalog in EMR 6.10.0 without catalog name
Posted by "ryu3065 (via GitHub)" <gi...@apache.org>.
ryu3065 commented on issue #7512:
URL: https://github.com/apache/iceberg/issues/7512#issuecomment-1567663013
@akshayakp97
Oh! It works well. Thank you so much :)
Have a nice day.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] akshayakp97 commented on issue #7512: How can I use Glue catalog in EMR 6.10.0 without catalog name
Posted by "akshayakp97 (via GitHub)" <gi...@apache.org>.
akshayakp97 commented on issue #7512:
URL: https://github.com/apache/iceberg/issues/7512#issuecomment-1563593060
Hi!
I use the Spark's built-in catalog -
```
"spark.sql.extensions":"org.apache.iceberg.spark.extensions.IcebergSparkSessionExtensions",
"spark.sql.catalog.spark_catalog":"org.apache.iceberg.spark.SparkSessionCatalog",
"spark.sql.catalog.spark_catalog.io-impl":"org.apache.iceberg.aws.s3.S3FileIO",
"spark.sql.catalog.spark_catalog.catalog-impl":"org.apache.iceberg.aws.glue.GlueCatalog",
```
And, then I can do ``select * from db.tbl1``
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org