[jira] [Created] (ARROW-17985) Opaque error code ([code: 100]), when not setting region

["Vedant Roy (Jira)" <ji...@apache.org>]

Vedant Roy created ARROW-17985:
----------------------------------

             Summary: Opaque error code ([code: 100]), when not setting region
                 Key: ARROW-17985
                 URL: https://issues.apache.org/jira/browse/ARROW-17985
             Project: Apache Arrow
          Issue Type: Bug
          Components: Python
            Reporter: Vedant Roy


A few odd things are going on with the Python bindings:
 # Statefulness. I ran the following code:

{code:java}
import os
import pyarrow.fs as arrow_fs
def fs_():
    s3_fs = arrow_fs.S3FileSystem(
        access_key="<token>",
        secret_key="<token>",
        endpoint_override="<cloudflare r2 url>",
    )
    return s3_fs
fs = fs_()
print(fs.get_file_info("data"))
{code}
and it worked on one machine but not the other. Only setting
{code:java}
region="auto"
{code}
 allowed the code to work consistently on both computers.
Furthermore, the error message is very opaque:

{code:java}
Traceback (most recent call last):
  File "cluster_scripts/test_s3.py", line 51, in <module>
    print(fs.get_file_info("data"))
  File "pyarrow/_fs.pyx", line 439, in pyarrow._fs.FileSystem.get_file_info
  File "pyarrow/error.pxi", line 143, in pyarrow.lib.pyarrow_internal_check_status
  File "pyarrow/error.pxi", line 114, in pyarrow.lib.check_status
OSError: When getting information for bucket 'data': AWS Error [code 100]: No response body.
{code}

Googling this error gives no information whatsoever. I managed to figure out the issue by switching from Cloudflare to S3, and when the issue was still going on, I explicitly set a region, but the experience was pretty painful.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)