[jira] [Created] (ARROW-13957) [C++] Make Windows S3FileSystem/Minio tests more reliable

["David Li (Jira)" <ji...@apache.org>]

David Li created ARROW-13957:
--------------------------------

             Summary: [C++] Make Windows S3FileSystem/Minio tests more reliable
                 Key: ARROW-13957
                 URL: https://issues.apache.org/jira/browse/ARROW-13957
             Project: Apache Arrow
          Issue Type: Improvement
          Components: C++
            Reporter: David Li


[Example log|https://ci.appveyor.com/project/ApacheSoftwareFoundation/arrow/builds/40696885/job/5t25hl7biwxdipe9]
{noformat}
[ RUN      ] TestS3FS.FileSystemFromUri
WARNING: maximum file descriptor limit 0 is too low for production servers. At least 4096 is recommended. Fix with "ulimit -n 4096"
C:/projects/arrow/cpp/src/arrow/filesystem/s3fs_test.cc(387): error: Failed
'OutcomeToStatus(client_->CreateBucket(req))' failed with IOError: AWS Error [code 130]: Your previous request to create the named bucket succeeded and you already own it.
C:/projects/arrow/cpp/src/arrow/util/io_util.cc:1523: When trying to delete temporary directory: IOError: Cannot delete directory entry 'C:/Users/appveyor/AppData/Local/Temp/1/s3fs-test-s6295hb6/.minio.sys/tmp/3cb9aaa7-6716-4c53-a30e-c2348f122148': . Detail: [Windows error 145] The directory is not empty.
[  FAILED  ] TestS3FS.FileSystemFromUri (7172 ms)
[ RUN      ] TestS3FS.CustomRetryStrategy
WARNING: maximum file descriptor limit 0 is too low for production servers. At least 4096 is recommended. Fix with "ulimit -n 4096"
C:/projects/arrow/cpp/src/arrow/util/io_util.cc:1523: When trying to delete temporary directory: IOError: Cannot delete directory entry 'C:/Users/appveyor/AppData/Local/Temp/1/s3fs-test-wm32qa0y/.minio.sys': . Detail: [Windows error 145] The directory is not empty.
[       OK ] TestS3FS.CustomRetryStrategy (814 ms)
[----------] 23 tests from TestS3FS (51710 ms total) {noformat}
The tests are quite slow, and it seems in part because the bucket is being recreated/deleted on every test; also because some things seem to be eventually consistent(?) so we aren't cleaning files up properly.

It would also be nice here if the error from CreateBucket contained the bucket name.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)