You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "David Li (Jira)" <ji...@apache.org> on 2021/05/25 15:49:00 UTC
[jira] [Commented] (ARROW-12557) [Python][C++] S3FileSystem with
proxy_options is very slow on Windows
[ https://issues.apache.org/jira/browse/ARROW-12557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17351151#comment-17351151 ]
David Li commented on ARROW-12557:
----------------------------------
FWIW, I think this might be the same as ARROW-12810 - so it may be faster now. (test_s3_proxy_options IIRC stood out to me as a very slow test in that PR as well, but setting the env var described there fixed that.)
> [Python][C++] S3FileSystem with proxy_options is very slow on Windows
> ---------------------------------------------------------------------
>
> Key: ARROW-12557
> URL: https://issues.apache.org/jira/browse/ARROW-12557
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++, Python
> Affects Versions: 4.0.0
> Reporter: Ian Cook
> Priority: Major
>
> When running {{pytest}} with pyarrow 4.0.0 on a Windows 10 VM, I noticed that the {{test_s3_proxy_options}} test takes an extraordinarily long time to finish. This is mostly because each call to {{S3FileSystem}} with {{proxy_options}} takes about a minute to finish.
> FYI [~sahil1105]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)