[jira] [Updated] (ARROW-17201) [R] Cannot override environmental variables setting AWS S3 region

["Nicola Crane (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/ARROW-17201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Nicola Crane updated ARROW-17201:
---------------------------------
        Parent: ARROW-18180
    Issue Type: Sub-task  (was: Improvement)

> [R] Cannot override environmental variables setting AWS S3 region
> -----------------------------------------------------------------
>
>                 Key: ARROW-17201
>                 URL: https://issues.apache.org/jira/browse/ARROW-17201
>             Project: Apache Arrow
>          Issue Type: Sub-task
>          Components: R
>    Affects Versions: 8.0.1
>            Reporter: Carl Boettiger
>            Priority: Major
>
> If a user has set the AWS_DEFAULT_REGION, there is no way we can override that setting (especially to a null value) in a one-off call.  Consider the following example.  This fails:
> {code:java}
> library(arrow)
> Sys.setenv(AWS_DEFAULT_REGION="data")
> noaa <- s3_bucket("neon4cast-drivers/",
>                   endpoint_override = "data.ecoforecast.org",
>                   anonymous = TRUE) {code}
> If the env var is not set or unset, this succeeds.  However, attempting to override the region does not help:
> {code:java}
> noaa <- s3_bucket("neon4cast-drivers/",
>                   endpoint_override = "data.ecoforecast.org",
>                   region = "us-east-1",
>                   anonymous = TRUE) {code}
> (nor does it help to set the region to "", or NULL. – note this is a MINIO host and so region is not needed anyway).  
> Relatedly, one might expect that AWS_S3_ENDPOINT could be used instead of setting `endpoint_override`, but this does not seem to work either (lemme know if you want that in a separate issue thread).  At least on the plus side, the above code does not fail if AWS_S3_ENDPOINT is set to some other value than given in endpoint_override, so that is nice). 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)