[jira] [Created] (ARROW-17201) Cannot override environmental variables setting region

["Carl Boettiger (Jira)" <ji...@apache.org>]

Carl Boettiger created ARROW-17201:
--------------------------------------

             Summary: Cannot override environmental variables setting region
                 Key: ARROW-17201
                 URL: https://issues.apache.org/jira/browse/ARROW-17201
             Project: Apache Arrow
          Issue Type: Improvement
          Components: R
    Affects Versions: 8.0.1
            Reporter: Carl Boettiger


If a user has set the AWS_DEFAULT_REGION, there is no way we can override that setting (especially to a null value) in a one-off call.  Consider the following example.  This fails:


{code:java}
library(arrow)
Sys.setenv(AWS_DEFAULT_REGION="data")

noaa <- s3_bucket("neon4cast-drivers/",
                  endpoint_override = "data.ecoforecast.org",
                  anonymous = TRUE) {code}
If the env var is not set or unset, this succeeds.  However, attempting to override the region does not help:


{code:java}
noaa <- s3_bucket("neon4cast-drivers/",
                  endpoint_override = "data.ecoforecast.org",
                  region = "us-east-1",
                  anonymous = TRUE) {code}
(nor does it help to set the region to "", or NULL. – note this is a MINIO host and so region is not needed anyway).  

Relatedly, one might expect that AWS_S3_ENDPOINT could be used instead of setting `endpoint_override`, but this does not seem to work either (lemme know if you want that in a separate issue thread).  At least on the plus side, the above code does not fail if AWS_S3_ENDPOINT is set to some other value than given in endpoint_override, so that is nice). 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)