You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "rdblue (via GitHub)" <gi...@apache.org> on 2023/07/04 22:31:11 UTC
[GitHub] [iceberg] rdblue commented on issue #7979: Pyiceberg StaticTable use the last metadata json URL when the full path is not provided
rdblue commented on issue #7979:
URL: https://github.com/apache/iceberg/issues/7979#issuecomment-1620797933
I think the current behavior of `StaticTable` is what we want to encourage. If you want to find the "latest" using some file-level operation then that's up to you. But a static table should always be given a fully qualified location for the metadata file. We don't want to confuse people or introduce incorrect behavior by guessing which metadata file is correct.
That said, we could possibly have a method to "recover" table metadata by guessing. That way you could get the same result, but it is clear that you're doing something that is dangerous.
```python
io = ArrowFileIO(**config)
metadata_location = recover_metadata("s3://bucket/path/to/table", io)
table = StaticTable.from_metadata(metadata_location, config)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org