[jira] [Commented] (ARROW-4208) [CI/Python] Have automatized tests for S3

["Rok Mihevc (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/ARROW-4208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16929826#comment-16929826 ] 

Rok Mihevc commented on ARROW-4208:
-----------------------------------

With #[5200|https://github.com/apache/arrow/pull/5200] we get minio server in pytest via fixture. It will work run in docker images, travis and appveyor.
So far we have one [test|https://github.com/apache/arrow/blob/59f1e148d5c0fa13b7964f85f13011532ff515ed/python/pyarrow/tests/test_parquet.py#L1797] in python.

Do we want to add other tests now? Do we have regression examples?

> [CI/Python] Have automatized tests for S3
> -----------------------------------------
>
>                 Key: ARROW-4208
>                 URL: https://issues.apache.org/jira/browse/ARROW-4208
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: Continuous Integration, Python
>            Reporter: Krisztian Szucs
>            Assignee: Rok Mihevc
>            Priority: Major
>              Labels: filesystem, pull-request-available, s3
>             Fix For: 1.0.0
>
>
> Currently We don't run S3 integration tests regularly. 
> Possible solutions:
> - mock it within python/pytest
> - simply run the s3 tests with an S3 credential provided
> - create a hdfs-integration like docker-compose setup and run an S3 mock server (e.g.: https://github.com/adobe/S3Mock, https://github.com/jubos/fake-s3, https://github.com/gaul/s3proxy, https://github.com/jserver/mock-s3)
> For more see discussion https://github.com/apache/arrow/pull/3286



--
This message was sent by Atlassian Jira
(v8.3.2#803003)