You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "d125q (via GitHub)" <gi...@apache.org> on 2024/01/21 11:17:08 UTC
[I] When using GlueCatalog, Iceberg table comment is not added to Glue table [iceberg]
d125q opened a new issue, #9542:
URL: https://github.com/apache/iceberg/issues/9542
### Apache Iceberg version
1.4.3 (latest release)
### Query engine
Spark
### Please describe the bug 🐞
Assume `glue_catalog` is configured to use GlueCatalog. Now, execute something along the lines of:
```python
df = spark.createDataFrame(
[
("foo", 23),
("bar", 41),
("baz", 27),
],
"name: string, age: int"
)
df = df.select(
F.col("name").alias("name", metadata={"comment": "Name column comment"}),
F.col("age").alias("age", metadata={"comment": "Age column comment"})
)
(
df
.writeTo("glue_catalog.glue_database.glue_table")
.tableProperty("comment", "Table comment")
.createOrReplace()
)
```
The column comments are indeed added to the Glue table, but the table comment itself is not. (Glue calls it a table _description_, but anyway.)
Looking at [IcebergToGlueConverter](https://github.com/apache/iceberg/blob/e32df0ce08086758c44e9174c582638068244073/aws/src/main/java/org/apache/iceberg/aws/glue/IcebergToGlueConverter.java#L53), I see the [code responsible for adding the column comments](https://github.com/apache/iceberg/blob/e32df0ce08086758c44e9174c582638068244073/aws/src/main/java/org/apache/iceberg/aws/glue/IcebergToGlueConverter.java#L320), but I see nothing of the like for table comments.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] When using GlueCatalog, Iceberg table comment is not added to Glue table [iceberg]
Posted by "d125q (via GitHub)" <gi...@apache.org>.
d125q commented on issue #9542:
URL: https://github.com/apache/iceberg/issues/9542#issuecomment-1902598142
Sorry, I missed #9530 from yesterday.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] When using GlueCatalog, Iceberg table comment is not added to Glue table [iceberg]
Posted by "d125q (via GitHub)" <gi...@apache.org>.
d125q closed issue #9542: When using GlueCatalog, Iceberg table comment is not added to Glue table
URL: https://github.com/apache/iceberg/issues/9542
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org