You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "universalmind303 (via GitHub)" <gi...@apache.org> on 2023/09/19 21:24:30 UTC
[GitHub] [arrow-rs] universalmind303 opened a new issue, #4839: object-store: http shouldn't perform range requests unless `accept-ranges: bytes` header is present
universalmind303 opened a new issue, #4839:
URL: https://github.com/apache/arrow-rs/issues/4839
**Describe the bug**
if you have a remote file `https://somewhere.com/file.parquet` and your server does not support ranges as specified by the `accept-ranges: bytes` header, the object store should not try to perform range scans.
**To Reproduce**
```rust
#[tokio::main]
async fn main() {
let http = HttpBuilder::new().with_url("https://not.arealwebsite.com/file.parquet");
let store = http.build().unwrap();
let path = Path::default();
let mut options = GetOptions::default();
let some_range = 100..2000;
options.range = Some(some_range);
let data = store.get_opts(&path, options).await.unwrap();
}
```
**Expected behavior**
the range is ignored as the server doesn't specify it can handle it.
**Additional context**
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] object-store: http shouldn't perform range requests unless `accept-ranges: bytes` header is present [arrow-rs]
Posted by "tustvold (via GitHub)" <gi...@apache.org>.
tustvold commented on issue #4839:
URL: https://github.com/apache/arrow-rs/issues/4839#issuecomment-1768075051
`label_issue.py` automatically added labels {'object-store'} from #4841
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-rs] tustvold closed issue #4839: object-store: http shouldn't perform range requests unless `accept-ranges: bytes` header is present
Posted by "tustvold (via GitHub)" <gi...@apache.org>.
tustvold closed issue #4839: object-store: http shouldn't perform range requests unless `accept-ranges: bytes` header is present
URL: https://github.com/apache/arrow-rs/issues/4839
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] object-store: http shouldn't perform range requests unless `accept-ranges: bytes` header is present [arrow-rs]
Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on issue #4839:
URL: https://github.com/apache/arrow-rs/issues/4839#issuecomment-2741683469
Migrating from arrow-rs issue [#4839](https://github.com/apache/arrow-rs/issues/4839)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-rs] tustvold commented on issue #4839: object-store: http shouldn't perform range requests unless `accept-ranges: bytes` header is present
Posted by "tustvold (via GitHub)" <gi...@apache.org>.
tustvold commented on issue #4839:
URL: https://github.com/apache/arrow-rs/issues/4839#issuecomment-1726625515
> performed the full request at that point though
We will have read the response headers but not streamed the majority of the request body
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-rs] tustvold commented on issue #4839: object-store: http shouldn't perform range requests unless `accept-ranges: bytes` header is present
Posted by "tustvold (via GitHub)" <gi...@apache.org>.
tustvold commented on issue #4839:
URL: https://github.com/apache/arrow-rs/issues/4839#issuecomment-1726535789
The RFC would suggest this is not a requirement - https://www.rfc-editor.org/rfc/rfc9110#section-14.3
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-rs] universalmind303 commented on issue #4839: object-store: http shouldn't perform range requests unless `accept-ranges: bytes` header is present
Posted by "universalmind303 (via GitHub)" <gi...@apache.org>.
universalmind303 commented on issue #4839:
URL: https://github.com/apache/arrow-rs/issues/4839#issuecomment-1726619119
Hmm. If we'd error on a 200, wouldn't we have still performed the full request at that point though?
... But i guess there's no good way to actually **_know_** if a server supports it without actually trying to perform the request.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org