You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "cboettig (via GitHub)" <gi...@apache.org> on 2023/02/01 05:25:22 UTC

[GitHub] [arrow] cboettig commented on pull request #33918: GH-33904: [R] improve behavior of s3_bucket

cboettig commented on PR #33918:
URL: https://github.com/apache/arrow/pull/33918#issuecomment-1411487681

   Thanks for the discussion!  @amoeba I definitely agree with your point about higher-level function and breaking changes.  How is region guessing handled in arrow's other client interfaces (e.g. python?)  Is region resolution in the C++ level available with something other than FileSystem$from_uri?
   
   It seems to me that natural way forward here would be to access the region from a HEAD request, which seems to be the recommended mechanism at least on the REST API.  Doing this through the SDK is probably the preferable to a REST call, though I'm fuzzy on those details, maybe [this](https://sdk.amazonaws.com/cpp/api/LATEST/aws-cpp-sdk-s3/html/class_aws_1_1_s3_1_1_s3_request.html))
   
   
   
   ```r
   scheme = "https"
   endpoint_override = "s3.amazonaws.com"
   bucket = "ursa-labs-r-test"
   
   resp <- httr::HEAD(glue::glue("{scheme}://{endpoint_override}/{bucket}"))
   region <- resp$headers$`x-amz-bucket-region`
   ```
   
   It looks like the SDK is already built to handle those endpoint parameters appropriately (i.e. passed in, or inferred from a config file on env vars), which is obviously the right way to do it, not what I've sketched above.  Can you tell if there is a function in the AWS S3 C++ SDK that does this, just inspecting the bucket header to determine the region?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org