You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by GitBox <gi...@apache.org> on 2022/08/25 19:53:30 UTC
[GitHub] [iceberg] jasondavindev opened a new issue, #5637: Unsupported partition transform
jasondavindev opened a new issue, #5637:
URL: https://github.com/apache/iceberg/issues/5637
### Apache Iceberg version
0.14.0 (latest release)
### Query engine
Athena
### Please describe the bug 🐞
In the below scenarios Athena returns `GENERIC_INTERNAL_ERROR: Unsupported partition transform: 1000`
- Write dataset using overwrite mode
- Changes table partition fields
I have a table partitioned by the `date` column and after I changed the partition field to `months(date)` Athena cannot query the table returning `GENERIC_INTERNAL_ERROR: Unsupported partition transform: 1000: date: void(7)`
I'm using
Iceberg 0.14.0
Spark 3.2.1 - AWS EMR Containers release 6.6.0 with provided Iceberg jar
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] singhpk234 commented on issue #5637: Unsupported partition transform
Posted by GitBox <gi...@apache.org>.
singhpk234 commented on issue #5637:
URL: https://github.com/apache/iceberg/issues/5637#issuecomment-1228115991
As per this doc, Athena only supports Iceberg V2 Tables. : https://docs.aws.amazon.com/athena/latest/ug/querying-iceberg.html
"_**Iceberg v2 tables – Athena only creates and operates on Iceberg v2 tables. For the difference between v1 and v2 tables, see [Format version changes](https://iceberg.apache.org/spec/#appendix-e-format-version-changes) in the Apache Iceberg documentation.**_"
By default iceberg table creates tables in v1 format :
https://github.com/apache/iceberg/blob/1526c1f663b2359de01183160b1236cd4eee04bf/core/src/main/java/org/apache/iceberg/TableMetadata.java#L51
Can you please try updating table format verison to 2 in table properties
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] jasondavindev closed issue #5637: Unsupported partition transform
Posted by GitBox <gi...@apache.org>.
jasondavindev closed issue #5637: Unsupported partition transform
URL: https://github.com/apache/iceberg/issues/5637
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org