You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2021/05/17 18:42:12 UTC

[GitHub] [arrow] lidavidm commented on pull request #10348: ARROW-12810: [Python] Stop AWS SDK from looking for metadata service

lidavidm commented on pull request #10348:
URL: https://github.com/apache/arrow/pull/10348#issuecomment-842532124


   Before:
   ```
   ================================================== slowest 10 durations ===================================================
   159.74s call     pyarrow/tests/test_fs.py::test_s3_proxy_options
   15.99s call     pyarrow/tests/test_dataset.py::test_open_dataset_from_s3_with_filesystem_uri
   15.22s call     pyarrow/tests/test_fs.py::test_s3_real_aws_region_selection
   3.19s call     pyarrow/tests/test_fs.py::test_s3_real_aws
   3.12s call     pyarrow/tests/test_dataset.py::test_write_dataset_s3
   2.03s setup    pyarrow/tests/test_fs.py::test_open_input_stream[S3FileSystem-gzip-256-compress]
   2.02s call     pyarrow/tests/test_fs.py::test_filesystem_is_functional_after_pickling[S3FileSystem]
   2.02s setup    pyarrow/tests/test_dataset.py::test_open_dataset_from_uri_s3
   2.01s setup    pyarrow/tests/test_dataset.py::test_open_dataset_from_uri_s3_fsspec
   2.01s setup    pyarrow/tests/test_dataset.py::test_write_dataset_s3
   ```
   
   After:
   ```
   ================================================== slowest 10 durations ===================================================
   0.69s call     pyarrow/tests/test_fs.py::test_s3_real_aws_region_selection
   0.63s call     pyarrow/tests/test_fs.py::test_s3_options
   0.31s call     pyarrow/tests/parquet/test_dataset.py::test_read_multiple_files[True]
   0.27s setup    pyarrow/tests/test_dataset.py::test_make_fragment
   0.25s call     pyarrow/tests/test_dataset.py::test_open_dataset_from_uri_s3_fsspec
   0.22s setup    pyarrow/tests/test_dataset.py::test_open_dataset_from_uri_s3
   0.21s call     pyarrow/tests/parquet/test_dataset.py::test_read_partitioned_directory_s3fs[True]
   0.19s call     pyarrow/tests/test_dataset.py::test_union_dataset_from_other_datasets
   0.18s call     pyarrow/tests/parquet/test_dataset.py::test_read_partitioned_directory_s3fs[False]
   0.16s call     pyarrow/tests/parquet/test_dataset.py::test_read_multiple_files[False]
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org