You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@opendal.apache.org by "damooo (via GitHub)" <gi...@apache.org> on 2023/04/16 17:26:04 UTC
[GitHub] [incubator-opendal] damooo opened a new issue, #2013: Support for custom object metadata
damooo opened a new issue, #2013:
URL: https://github.com/apache/incubator-opendal/issues/2013
Many cloud backends supports attaching custom metadata as key-value pairs to an object. That is a great way to attach some metadata to an object in concurrency-safe transactional way with out much fuss at application layer. It would be great if opendal propagates that support.
SeeAlso:
- s3: [https://docs.aws.amazon.com/AmazonS3/latest/userguide/UsingMetadata.html](Using object metadata)
- gcs: [https://cloud.google.com/storage/docs/metadata](Object metadata]
- etc.
These all services have different custom header coonventions for custom kv metadata. We can normalize at opendal args layer, and propagate as per convention.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-opendal] damooo commented on issue #2013: Support for custom object metadata
Posted by "damooo (via GitHub)" <gi...@apache.org>.
damooo commented on issue #2013:
URL: https://github.com/apache/incubator-opendal/issues/2013#issuecomment-1510541161
And also hdfs: <https://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-hdfs/ExtendedAttributes.html>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-opendal] Xuanwo commented on issue #2013: Support for custom object metadata
Posted by "Xuanwo (via GitHub)" <gi...@apache.org>.
Xuanwo commented on issue #2013:
URL: https://github.com/apache/incubator-opendal/issues/2013#issuecomment-1511730533
Great idea! This is exactly what I would like to incorporate into OpenDAL.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-opendal] damooo commented on issue #2013: Support for custom object metadata
Posted by "damooo (via GitHub)" <gi...@apache.org>.
damooo commented on issue #2013:
URL: https://github.com/apache/incubator-opendal/issues/2013#issuecomment-1510539012
Most modern filesystems like `ext2`, `ext3`, `ext4`, `NTFS`, `zfs`, etc support extended file attributes. Rust has popular [`xattr`](https://crates.io/crates/xattr) to handle them in os/fs agnostic way.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Support for custom object metadata [incubator-opendal]
Posted by "jokester (via GitHub)" <gi...@apache.org>.
jokester commented on issue #2013:
URL: https://github.com/apache/incubator-opendal/issues/2013#issuecomment-1751911121
I'm not sure this can be available for all services, but even partial support would help much.
An important use of S3 or GCS is to host static files for web, it just feels incomplete when we can't set a `contentType` for a new file.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Support for custom object metadata [incubator-opendal]
Posted by "Xuanwo (via GitHub)" <gi...@apache.org>.
Xuanwo commented on issue #2013:
URL: https://github.com/apache/incubator-opendal/issues/2013#issuecomment-1751912973
> it just feels incomplete when we can't set a `contentType` for a new file.
This feature has already been supported. You can use the following code to set content type for a file:
```rust
let bs = b"hello, world!".to_vec();
let _ = op
.write_with("path/to/file", bs)
.content_type("text/plain")
.await?;
```
And this issue is mainly about custom object metadata, for example, `x-amz-meta-abc` for s3.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Support for custom object metadata [incubator-opendal]
Posted by "jokester (via GitHub)" <gi...@apache.org>.
jokester commented on issue #2013:
URL: https://github.com/apache/incubator-opendal/issues/2013#issuecomment-1751915351
> This feature has already been supported
Thanks & sorry I didn't know that. I only checked python bindings.
I will look deeper first, starting from whether that's available in python 👍🏽
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org