You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@arrow.apache.org by ap...@apache.org on 2019/12/12 10:58:19 UTC
[arrow] branch master updated (c3e5668 -> 54cb9c0)
This is an automated email from the ASF dual-hosted git repository.
apitrou pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/arrow.git.
from c3e5668 ARROW-7177: [Java] Provide a utility to improve the performance of vector loading/unloading (#5842)
add 54cb9c0 ARROW-7310: [Python] Expose HDFS implementation for pyarrow.fs
No new revisions were added by this update.
Summary of changes:
ci/etc/hdfs-site.xml | 12 +-
ci/scripts/integration_hdfs.sh | 1 +
ci/scripts/python_build.sh | 1 +
cpp/src/arrow/filesystem/hdfs.cc | 6 +
cpp/src/arrow/filesystem/hdfs.h | 1 +
cpp/src/arrow/io/hdfs.cc | 12 +-
docker-compose.yml | 1 +
python/CMakeLists.txt | 4 +
python/pyarrow/_fs.pxd | 1 +
python/pyarrow/_hdfs.pyx | 185 ++++++++++++++++++++++++++++++
python/pyarrow/_s3fs.pyx | 7 +-
python/pyarrow/fs.py | 17 +++
python/pyarrow/includes/libarrow.pxd | 75 +-----------
python/pyarrow/includes/libarrow_fs.pxd | 149 ++++++++++++++++++++++++
python/pyarrow/includes/libarrow_s3fs.pxd | 60 ----------
python/pyarrow/io-hdfs.pxi | 4 +-
python/pyarrow/s3fs.py | 27 -----
python/pyarrow/tests/conftest.py | 22 +++-
python/pyarrow/tests/test_fs.py | 98 ++++++++++++++--
python/setup.py | 6 +
20 files changed, 511 insertions(+), 178 deletions(-)
create mode 100644 python/pyarrow/_hdfs.pyx
create mode 100644 python/pyarrow/includes/libarrow_fs.pxd
delete mode 100644 python/pyarrow/includes/libarrow_s3fs.pxd
delete mode 100644 python/pyarrow/s3fs.py