You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@opendal.apache.org by "rebasedming (via GitHub)" <gi...@apache.org> on 2024/05/07 16:42:10 UTC
[I] Bug: `visiting not set metadata: version, maybe a bug` when creating an object store over a partitioned directory [opendal]
rebasedming opened a new issue, #4581:
URL: https://github.com/apache/opendal/issues/4581
I am using opendal `0.46.0` and object_store_opendal `0.43.1`.
I am creating an `Operator` over S3, which I then turn into an `OpendalStore` so that it's compatible with `object_store` and `DataFusion`. Then, I create a `DataFusion` `ListingTable` over the object store.
When I pass a specific file i.e. `s3://bucket/file.parquet` the ListingTable works fine. But when I pass a directory of partitioned files i.e `s3:://bucket/partitioned/` I get the error `visiting not set metadata: version, maybe a bug`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Bug: `visiting not set metadata: version, maybe a bug` when creating an object store over a partitioned directory [opendal]
Posted by "Xuanwo (via GitHub)" <gi...@apache.org>.
Xuanwo closed issue #4581: Bug: `visiting not set metadata: version, maybe a bug` when creating an object store over a partitioned directory
URL: https://github.com/apache/opendal/issues/4581
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Bug: `visiting not set metadata: version, maybe a bug` when creating an object store over a partitioned directory [opendal]
Posted by "Xuanwo (via GitHub)" <gi...@apache.org>.
Xuanwo commented on issue #4581:
URL: https://github.com/apache/opendal/issues/4581#issuecomment-2098897841
I feel the assertion from opendal is too aggressive. Perhaps we could leave those fields as `None` if they're not set.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org