You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2021/05/17 18:42:12 UTC
[GitHub] [arrow] lidavidm commented on pull request #10348: ARROW-12810: [Python] Stop AWS SDK from looking for metadata service
lidavidm commented on pull request #10348:
URL: https://github.com/apache/arrow/pull/10348#issuecomment-842532124
Before:
```
================================================== slowest 10 durations ===================================================
159.74s call pyarrow/tests/test_fs.py::test_s3_proxy_options
15.99s call pyarrow/tests/test_dataset.py::test_open_dataset_from_s3_with_filesystem_uri
15.22s call pyarrow/tests/test_fs.py::test_s3_real_aws_region_selection
3.19s call pyarrow/tests/test_fs.py::test_s3_real_aws
3.12s call pyarrow/tests/test_dataset.py::test_write_dataset_s3
2.03s setup pyarrow/tests/test_fs.py::test_open_input_stream[S3FileSystem-gzip-256-compress]
2.02s call pyarrow/tests/test_fs.py::test_filesystem_is_functional_after_pickling[S3FileSystem]
2.02s setup pyarrow/tests/test_dataset.py::test_open_dataset_from_uri_s3
2.01s setup pyarrow/tests/test_dataset.py::test_open_dataset_from_uri_s3_fsspec
2.01s setup pyarrow/tests/test_dataset.py::test_write_dataset_s3
```
After:
```
================================================== slowest 10 durations ===================================================
0.69s call pyarrow/tests/test_fs.py::test_s3_real_aws_region_selection
0.63s call pyarrow/tests/test_fs.py::test_s3_options
0.31s call pyarrow/tests/parquet/test_dataset.py::test_read_multiple_files[True]
0.27s setup pyarrow/tests/test_dataset.py::test_make_fragment
0.25s call pyarrow/tests/test_dataset.py::test_open_dataset_from_uri_s3_fsspec
0.22s setup pyarrow/tests/test_dataset.py::test_open_dataset_from_uri_s3
0.21s call pyarrow/tests/parquet/test_dataset.py::test_read_partitioned_directory_s3fs[True]
0.19s call pyarrow/tests/test_dataset.py::test_union_dataset_from_other_datasets
0.18s call pyarrow/tests/parquet/test_dataset.py::test_read_partitioned_directory_s3fs[False]
0.16s call pyarrow/tests/parquet/test_dataset.py::test_read_multiple_files[False]
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org