You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@arrow.apache.org by bk...@apache.org on 2020/04/30 17:50:39 UTC
[arrow] branch master updated (af44053 -> 8d5ca47)
This is an automated email from the ASF dual-hosted git repository.
bkietz pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/arrow.git.
from af44053 ARROW-8639: [C++][Plasma] Require gflags
add 8d5ca47 ARROW-7759: [C++][Dataset] Add CsvFileFormat
No new revisions were added by this update.
Summary of changes:
cpp/src/arrow/csv/options.h | 2 +-
cpp/src/arrow/dataset/CMakeLists.txt | 8 ++
cpp/src/arrow/dataset/api.h | 1 +
cpp/src/arrow/dataset/dataset_internal.h | 9 +-
cpp/src/arrow/dataset/file_csv.cc | 136 ++++++++++++++++++++
cpp/src/arrow/dataset/{file_ipc.h => file_csv.h} | 17 ++-
cpp/src/arrow/dataset/file_csv_test.cc | 152 +++++++++++++++++++++++
cpp/src/arrow/dataset/file_ipc.cc | 10 +-
cpp/src/arrow/dataset/type_fwd.h | 6 +-
ci/scripts/go_test.sh => python/pyarrow/_csv.pxd | 16 ++-
python/pyarrow/_csv.pyx | 24 +++-
python/pyarrow/_dataset.pyx | 33 ++++-
python/pyarrow/dataset.py | 3 +
python/pyarrow/includes/libarrow_dataset.pxd | 4 +
python/pyarrow/tests/test_dataset.py | 21 ++++
r/Makefile | 2 +-
r/NAMESPACE | 1 +
r/R/arrowExports.R | 4 +
r/R/dataset.R | 76 +++++++++---
r/man/Dataset.Rd | 5 +-
r/man/FileFormat.Rd | 20 ++-
r/man/dataset_factory.Rd | 23 +++-
r/man/open_dataset.Rd | 3 +-
r/src/arrowExports.cpp | 16 +++
r/src/dataset.cpp | 8 ++
r/tests/testthat/test-dataset.R | 78 ++++++++++++
26 files changed, 614 insertions(+), 64 deletions(-)
create mode 100644 cpp/src/arrow/dataset/file_csv.cc
copy cpp/src/arrow/dataset/{file_ipc.h => file_csv.h} (80%)
create mode 100644 cpp/src/arrow/dataset/file_csv_test.cc
copy ci/scripts/go_test.sh => python/pyarrow/_csv.pxd (79%)
mode change 100755 => 100644