[jira] [Comment Edited] (ARROW-14930) [C++][Python] FileNotFound with Scality accessed through S3 APIs

["Luis Morales (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/ARROW-14930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17456461#comment-17456461 ] 

Luis Morales edited comment on ARROW-14930 at 12/9/21, 2:14 PM:
----------------------------------------------------------------

The product i'm using is scality (scality.com). They have a public docker image that is basically their S3 Connector (they call it zenko cloud server).

 

You can find the image here:

 

[https://hub.docker.com/r/zenko/cloudserver/]

 

i'm using this docker run (with ssl activated, the docker generates its own self-certificate and ca each time you run it):

 

docker run -v <local_data_folder>:/usr/src/app/localData -v <local_metadata_folder>:/usr/src/app/localMetadata -p 8000:8000 -e SSL=TRUE -e ENDPOINT=s3.scality.test -e LOG_LEVEL=trace -e REMOTE_MANAGEMENT_DISABLE=1 zenko/cloudserver

 

The endpoint is needed when using SSL.

I'll tell scality support guys to have a look at this too.


was (Author: JIRAUSER281000):
The product i'm using is scality (scality.com). They have a public docker image that is basically their S3 Connector (they called it zeno cloud server).

 

You can find the image here:

 

[https://hub.docker.com/r/zenko/cloudserver/]

 

i'm using this docker run (with ssl activated, the docker generates its own self-certificate and ca each time you run it):

 

docker run -v <local_data_folder>:/usr/src/app/localData -v <local_metadata_folder>:/usr/src/app/localMetadata -p 8000:8000 -e SSL=TRUE -e ENDPOINT=s3.scality.test -e LOG_LEVEL=trace -e REMOTE_MANAGEMENT_DISABLE=1 zenko/cloudserver

 

The endpoint is needed when using SSL.

I'll tell scality support guys to have a look at this too.

> [C++][Python] FileNotFound with Scality accessed through S3 APIs
> ----------------------------------------------------------------
>
>                 Key: ARROW-14930
>                 URL: https://issues.apache.org/jira/browse/ARROW-14930
>             Project: Apache Arrow
>          Issue Type: Bug
>          Components: C++, Python
>    Affects Versions: 6.0.1
>         Environment: linux + python 3.8
>            Reporter: Luis Morales
>            Priority: Major
>              Labels: s3
>             Fix For: 6.0.2
>
>
> When using dataset.Dataset with S3FileSystem with compatible S3 object sotrage, get an FileNotFoundError.
>  
> My code:
>  
> scality = fs.S3FileSystem(access_key='accessKey1', secret_key='verySecretKey1', endpoint_override="http://localhost:8000", region="")
> data = ds.dataset("dasynth/parquet/taxies/2019_june/", format="parquet", partitioning="hive", filesystem=scality)



--
This message was sent by Atlassian Jira
(v8.20.1#820001)