You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "matthias-Q (via GitHub)" <gi...@apache.org> on 2024/10/09 16:01:44 UTC
[I] How to use object_store AmazonS3 list() [arrow-rs]
matthias-Q opened a new issue, #6533:
URL: https://github.com/apache/arrow-rs/issues/6533
**Which part is this question about**
I want to list files in a S3 bucket
**Describe your question**
I have prepared the connection to the S3 bucket using:
```rust
let storage_container_key = object_store::aws::AmazonS3Builder::from_env()
.with_bucket_name("my_bucket")
.build()
.expect(""),
);
let key_prefix = &object_store::path::Path::from(key);
let stream = storage_container_key.list(Some(key_prefix));
```
How can I access the stream? Documentation is not helping here. I think this needs an code example.
Thanks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] How to use object_store AmazonS3 list() [arrow-rs]
Posted by "joseph-isaacs (via GitHub)" <gi...@apache.org>.
joseph-isaacs commented on issue #6533:
URL: https://github.com/apache/arrow-rs/issues/6533#issuecomment-2402758409
What about `stream.into_stream()` and then use futures crate?
For example `stream.into_stream().collect::<Vec<_>>()` gives a vec of all items as a future.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] How to use object_store AmazonS3 list() [arrow-rs]
Posted by "tustvold (via GitHub)" <gi...@apache.org>.
tustvold commented on issue #6533:
URL: https://github.com/apache/arrow-rs/issues/6533#issuecomment-2403305021
Perhaps https://docs.rs/object_store/latest/object_store/#list-objects
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] How to use object_store AmazonS3 list() [arrow-rs]
Posted by "matthias-Q (via GitHub)" <gi...@apache.org>.
matthias-Q commented on issue #6533:
URL: https://github.com/apache/arrow-rs/issues/6533#issuecomment-2405384095
Ah well, I was looking in the API reference. Thanks that helped alot.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] How to use object_store AmazonS3 list() [arrow-rs]
Posted by "joseph-isaacs (via GitHub)" <gi...@apache.org>.
joseph-isaacs commented on issue #6533:
URL: https://github.com/apache/arrow-rs/issues/6533#issuecomment-2402865687
Did you include the futures crate.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] How to use object_store AmazonS3 list() [arrow-rs]
Posted by "matthias-Q (via GitHub)" <gi...@apache.org>.
matthias-Q commented on issue #6533:
URL: https://github.com/apache/arrow-rs/issues/6533#issuecomment-2402785905
stream does not have the method `into_stream()`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] How to use object_store AmazonS3 list() [arrow-rs]
Posted by "matthias-Q (via GitHub)" <gi...@apache.org>.
matthias-Q closed issue #6533: How to use object_store AmazonS3 list()
URL: https://github.com/apache/arrow-rs/issues/6533
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org