You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Carlos O'Ryan (Jira)" <ji...@apache.org> on 2021/10/13 15:09:00 UTC

[jira] [Created] (ARROW-14311) The arrow-gcsfs-test is too slow

Carlos O'Ryan created ARROW-14311:
-------------------------------------

             Summary: The arrow-gcsfs-test is too slow
                 Key: ARROW-14311
                 URL: https://issues.apache.org/jira/browse/ARROW-14311
             Project: Apache Arrow
          Issue Type: Improvement
          Components: C++
            Reporter: Carlos O'Ryan


In some cases the test for {{arrow::fs::GcsFilesystem}} is very slow. There is no obvious reason for this problem, we should find it why and fix it. 

https://github.com/apache/arrow/pull/11375#issuecomment-942397629

{quote}
Hmm, gcfs_test is not hanging anymore but it's still taking a lot of time:
{code}
[ RUN      ] GcsFileSystem.FileSystemCompare
[       OK ] GcsFileSystem.FileSystemCompare (20025 ms)
{code}
{quote}

Ugh, that looks painful. On my workstation that particular test completes in milliseconds:

{code}
[ RUN      ] GcsFileSystem.FileSystemCompare
[       OK ] GcsFileSystem.FileSystemCompare (5 ms)
{code}

And the full test with with archery docker run ubuntu-cpp takes about 3 seconds:

{code}
54/85 Test #49: arrow-gcsfs-test ..........................   Passed    3.05 sec
{code}





--
This message was sent by Atlassian Jira
(v8.3.4#803005)