You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@arrow.apache.org by fs...@apache.org on 2020/04/14 15:44:39 UTC
[arrow] branch master updated (422618c -> 18872a4)
This is an automated email from the ASF dual-hosted git repository.
fsaintjacques pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/arrow.git.
from 422618c ARROW-8401: [C++] Add byte-stream-split AVX2/AVX512 implementation
add 18872a4 ARROW-3410: [C++][Python] Add streaming CSV reader.
No new revisions were added by this update.
Summary of changes:
cpp/src/arrow/CMakeLists.txt | 1 +
cpp/src/arrow/csv/CMakeLists.txt | 1 +
cpp/src/arrow/csv/column_builder.cc | 411 ++++-------
cpp/src/arrow/csv/column_builder.h | 13 +-
cpp/src/arrow/csv/column_builder_test.cc | 189 ++---
cpp/src/arrow/csv/column_decoder.cc | 367 ++++++++++
.../csv/{column_builder.h => column_decoder.h} | 46 +-
cpp/src/arrow/csv/column_decoder_test.cc | 427 ++++++++++++
cpp/src/arrow/csv/converter.cc | 9 +-
cpp/src/arrow/csv/converter.h | 6 +-
cpp/src/arrow/csv/inference_internal.h | 141 ++++
cpp/src/arrow/csv/reader.cc | 759 +++++++++++++++------
cpp/src/arrow/csv/reader.h | 16 +
docs/source/python/api/formats.rst | 2 +
docs/source/python/csv.rst | 7 +
python/pyarrow/_csv.pyx | 87 ++-
python/pyarrow/compat.py | 7 +-
python/pyarrow/csv.py | 4 +-
python/pyarrow/error.pxi | 7 +-
python/pyarrow/includes/libarrow.pxd | 7 +
python/pyarrow/tests/test_csv.py | 276 +++++++-
21 files changed, 2183 insertions(+), 600 deletions(-)
create mode 100644 cpp/src/arrow/csv/column_decoder.cc
copy cpp/src/arrow/csv/{column_builder.h => column_decoder.h} (59%)
create mode 100644 cpp/src/arrow/csv/column_decoder_test.cc
create mode 100644 cpp/src/arrow/csv/inference_internal.h