You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@arrow.apache.org by em...@apache.org on 2020/08/14 19:51:17 UTC
[arrow] branch decimal256 updated (7525286 -> 4e06c1e)
This is an automated email from the ASF dual-hosted git repository.
emkornfield pushed a change to branch decimal256
in repository https://gitbox.apache.org/repos/asf/arrow.git.
from 7525286 ARROW-9573: [Python][Dataset] Provide read_table(ignore_prefixes=)
add fd6f545 ARROW-9666: [Python][wheel][Windows] Fix wheel build for Windows
add 634fcd1 ARROW-9548: [Go] Test output files are not removed correctly
add a3596c9 ARROW-9546: [Python] Clean up Pandas Metadata Conversion test
add 4489cb7 ARROW-9462:[Go] The Indentation after the first Record in arrjson writer is incorrect
add 9c04867 ARROW-9643: [C++] Only register the SIMD variants when it's supported.
add f40e287 ARROW-9536: [Java] Miss parameters in PlasmaOutOfMemoryException.java
add 3d0a9d5 ARROW-9671: [C++] Fix a bug in BasicDecimal128 constructor that interprets uint64_t integers with highest bit set as negative.
add 40ac6e3 ARROW-9205: [Documentation] Fix typos
add 52d0fe6 ARROW-9429: [Python] ChunkedArray.to_numpy
add 811d8f6 ARROW-9402: [C++] Rework portable wrappers for checked integer arithmetic
add 1c375b5 ARROW-9631: [Rust] Make arrow not depend on flight
add a84e7b0 ARROW-9652: [Rust][DataFusion] Error message rather than panic for external csv tables with no column defs
add 1e48d6a ARROW-7218: [Python] Conversion from boolean numpy scalars not working
add 858059f ARROW-9606: [C++][Dataset] Support `"a"_.In(<>).Assume(<compound>)`
add 37ee600 ARROW-9628: [Rust] Disable artifact caching for Mac OSX builds
add 1b0aebe ARROW-9598: [C++][Parquet] Fix writing nullable structs
add e31e5d4 ARROW-9683: [Rust][DataFusion] Add debug printing to physical plans and associated types
add 0e15d26 ARROW-9521: [Rust][DataFusion] Handle custom CSV file extensions
add a0ec4f2 ARROW-9638: [C++][Compute] Implement mode kernel
add 66a8f04 ARROW-9692: [Python] Fix distutils-related warning
add e934a8a ARROW-9602: [R] Improve cmake detection in Linux build
add b1a30e6 ARROW-9653: [Rust][DataFusion] Do not error in planner with SQL has multiple group by expressions
add aec21b2 ARROW-9696: [Rust] [DataFusion] fix nested binary expressions
add 3fc7fe4 ARROW-9691: [Rust] [DataFusion] Make sql_statement_to_plan method public
add dd98a9f ARROW-9577: [C++] Ignore EBADF error in posix_madvise()
add ebbe60c ARROW-9684: [C++] Fix undefined behaviour on invalid IPC / Parquet input
add e1e3188 ARROW-9659: [C++] Fix RecordBatchStreamReader when source is CudaBufferReader
add faee652 ARROW-9604: [C++] Add aggregate min/max benchmark
add 042998c ARROW-9679: [Rust] [DataFusion] More efficient creation of final batch from HashAggregateExec
add db9185e ARROW-9695: [Rust] Improve comments on LogicalPlan enum variants
add 12e31a5 ARROW-9715: [R] changelog/doc updates for 1.0.1
add 796b050 ARROW-9700: [Python] fix create_library_symlinks for macos
add 90d1ab7 ARROW-9721: [Packaging][Python] Update wheel dependency files
add 69d7b2b ARROW-9698: [C++] Remove -DNDEBUG flag leak in .pc file
add b5955d8 ARROW-9713: [Rust] [DataFusion] Remove explicit panics
add 9919e3e ARROW-9712: [Rust] [DataFusion] Fix parquet error handling and general code improvements
add aaf467a ARROW-9644: [C++][Dataset] Don't apply ignore_prefixes to partition base_dir
add 898bef8 ARROW-9665: [R] head/tail/take for Datasets
add 8150008 ARROW-9722: [Rust] Shorten key lifetime for dict lookup key
add 586c060 ARROW-9615: [Rust] Added kernel to compute length of a string.
add 525a5e9 ARROW-9693: [CI][Docs] Nightly docs build fails
add 570184b ARROW-9727: [C++] Fix crashes on invalid IPC input (OSS-Fuzz)
add 7efc4f3 ARROW-9714: [Rust] [DataFusion] Implement type coercion rule for limit and sort
add b2788c5 ARROW-9725: [Rust] [DataFusion] SortExec and LimitExec re-use MergeExec
add d23f0a6 ARROW-9706: [Java] Tests of TestLargeListVector correctly read offset
add cf1c749 ARROW-9681: [Java] Fix test failures of Arrow Memory - Core on big-endian platform
add 3368159 ARROW-9734: [Rust] [DataFusion] TableProvider.scan now returns partitions instead of iterators
add ecba35c ARROW-9726: [Rust] [DataFusion] Do not create parquet reader thread until execute is called
add 2f36cc4 ARROW-9716: [Rust] [DataFusion] Implement limit on concurrent threads in MergeExec
add 4e06c1e ARROW-9711: [Rust] Add new benchmark derived from TPC-H
No new revisions were added by this update.
Summary of changes:
.github/workflows/rust.yml | 8 +-
LICENSE.txt | 16 +
ci/conda_env_sphinx.yml | 4 +-
ci/docker/linux-apt-docs.dockerfile | 3 +-
cpp/cmake_modules/DefineOptions.cmake | 10 +-
cpp/cmake_modules/FindSnappy.cmake | 9 +-
cpp/cmake_modules/SetupCxxFlags.cmake | 6 -
cpp/src/arrow/CMakeLists.txt | 1 +
cpp/src/arrow/array/array_base.h | 17 +-
cpp/src/arrow/array/array_binary.h | 11 +-
cpp/src/arrow/array/array_nested.cc | 71 +-
cpp/src/arrow/array/array_nested.h | 22 +-
cpp/src/arrow/array/array_primitive.h | 5 -
cpp/src/arrow/array/concatenate.cc | 10 +-
cpp/src/arrow/array/data.cc | 2 +-
cpp/src/arrow/array/data.h | 16 +
cpp/src/arrow/array/validate.cc | 29 +-
cpp/src/arrow/arrow.pc.in | 2 +-
cpp/src/arrow/buffer.cc | 2 +-
cpp/src/arrow/compute/api_aggregate.cc | 4 +
cpp/src/arrow/compute/api_aggregate.h | 17 +-
cpp/src/arrow/compute/kernels/aggregate_basic.cc | 23 +-
.../compute/kernels/aggregate_basic_internal.h | 6 +
.../arrow/compute/kernels/aggregate_benchmark.cc | 68 +
cpp/src/arrow/compute/kernels/aggregate_mode.cc | 179 ++
cpp/src/arrow/compute/kernels/aggregate_test.cc | 115 +-
cpp/src/arrow/compute/kernels/codegen_internal.h | 353 ++-
cpp/src/arrow/compute/kernels/scalar_arithmetic.cc | 148 +-
.../compute/kernels/scalar_arithmetic_benchmark.cc | 57 +-
.../compute/kernels/scalar_arithmetic_test.cc | 280 +-
.../arrow/compute/kernels/scalar_cast_boolean.cc | 8 +-
.../arrow/compute/kernels/scalar_cast_numeric.cc | 50 +-
.../arrow/compute/kernels/scalar_cast_temporal.cc | 6 +-
cpp/src/arrow/compute/kernels/scalar_nested.cc | 4 +-
cpp/src/arrow/compute/kernels/scalar_string.cc | 6 +-
cpp/src/arrow/compute/kernels/test_util.cc | 113 +-
cpp/src/arrow/compute/kernels/test_util.h | 10 +
cpp/src/arrow/dataset/discovery.cc | 12 +-
cpp/src/arrow/dataset/discovery_test.cc | 25 +-
cpp/src/arrow/dataset/filter.cc | 78 +-
cpp/src/arrow/dataset/filter.h | 10 +
cpp/src/arrow/dataset/filter_test.cc | 13 +-
cpp/src/arrow/dataset/partition.cc | 39 +-
cpp/src/arrow/ipc/metadata_internal.cc | 3 +-
cpp/src/arrow/pretty_print.cc | 2 +-
cpp/src/arrow/python/filesystem.cc | 10 +
cpp/src/arrow/python/filesystem.h | 5 +
cpp/src/arrow/python/python_to_arrow.cc | 2 +
cpp/src/arrow/scalar.h | 16 +-
cpp/src/arrow/type.cc | 12 +
cpp/src/arrow/type.h | 3 +
cpp/src/arrow/util/basic_decimal.cc | 2 +-
cpp/src/arrow/util/basic_decimal.h | 7 +-
cpp/src/arrow/util/bit_block_counter.cc | 23 +-
cpp/src/arrow/util/bit_block_counter.h | 186 +-
cpp/src/arrow/util/bit_block_counter_test.cc | 92 +
cpp/src/arrow/util/decimal.cc | 2 +-
cpp/src/arrow/util/decimal_test.cc | 22 +-
cpp/src/arrow/util/int_util.h | 94 -
cpp/src/arrow/util/int_util_internal.h | 124 +
cpp/src/arrow/util/int_util_test.cc | 1 +
cpp/src/arrow/util/io_util.cc | 8 +-
cpp/src/arrow/util/trie.h | 2 -
cpp/src/arrow/util/windows_fixup.h | 11 +
cpp/src/arrow/vendored/portable-snippets/README.md | 10 +
.../arrow/vendored/portable-snippets/safe-math.h | 1071 +++++++
cpp/src/arrow/visitor_inline.h | 90 +-
cpp/src/parquet/arrow/arrow_reader_writer_test.cc | 17 +
cpp/src/parquet/arrow/reader_internal.cc | 4 +-
cpp/src/parquet/column_reader.cc | 32 +-
cpp/src/parquet/column_writer.cc | 9 +-
cpp/src/parquet/types.h | 1 -
dev/release/00-prepare-test.rb | 16 +-
dev/release/00-prepare.sh | 4 +-
docker-compose.yml | 2 +-
docs/source/cpp/compute.rst | 7 +-
docs/source/format/Columnar.rst | 4 +-
docs/source/format/Flight.rst | 2 +-
go/arrow/arrio/arrio_test.go | 12 +-
go/arrow/internal/arrjson/arrjson_test.go | 2995 +++++++++++++++++++-
go/arrow/internal/arrjson/writer.go | 2 +-
go/arrow/ipc/cmd/arrow-cat/main_test.go | 18 +-
go/arrow/ipc/cmd/arrow-file-to-stream/main_test.go | 13 +-
.../cmd/arrow-json-integration-test/main_test.go | 17 +-
go/arrow/ipc/cmd/arrow-ls/main_test.go | 18 +-
go/arrow/ipc/cmd/arrow-stream-to-file/main_test.go | 12 +-
go/arrow/ipc/file_test.go | 9 +-
go/arrow/ipc/stream_test.go | 9 +-
.../java/org/apache/arrow/memory/ArrowBuf.java | 4 +-
.../arrow/memory/util/ByteFunctionHelpers.java | 34 +-
.../exceptions/PlasmaOutOfMemoryException.java | 8 +
.../org/apache/arrow/plasma/PlasmaClientTest.java | 17 +-
.../apache/arrow/vector/TestLargeListVector.java | 50 +-
python/pyarrow/__init__.py | 2 +-
python/pyarrow/_fs.pyx | 46 +-
python/pyarrow/dataset.py | 10 +-
python/pyarrow/fs.py | 4 +-
python/pyarrow/includes/libarrow_fs.pxd | 2 +
python/pyarrow/table.pxi | 68 +-
python/pyarrow/tests/test_convert_builtin.py | 12 +-
python/pyarrow/tests/test_cuda.py | 54 +
python/pyarrow/tests/test_dataset.py | 6 +-
python/pyarrow/tests/test_extension_type.py | 21 +-
python/pyarrow/tests/test_fs.py | 12 +
python/pyarrow/tests/test_pandas.py | 4 +-
python/pyarrow/tests/test_parquet.py | 5 +-
python/pyarrow/tests/test_table.py | 74 +-
python/requirements-wheel-build.txt | 4 +-
python/requirements-wheel-test.txt | 3 +-
python/setup.py | 14 +-
r/NAMESPACE | 7 +
r/NEWS.md | 6 +-
r/R/arrowExports.R | 4 +
r/R/dataset.R | 83 +-
r/R/dplyr.R | 94 +-
r/src/arrowExports.cpp | 17 +
r/src/dataset.cpp | 20 +
r/tests/testthat/test-dataset.R | 115 +-
r/tests/testthat/test-dplyr.R | 109 +
r/tools/linuxlibs.R | 33 +-
r/vignettes/install.Rmd | 2 +
rust/arrow/Cargo.toml | 6 +-
.../{array_from_vec.rs => length_kernel.rs} | 33 +-
rust/arrow/src/array/array.rs | 2 +-
rust/arrow/src/compute/kernels/length.rs | 186 ++
rust/arrow/src/compute/kernels/mod.rs | 1 +
rust/benchmarks/README.md | 22 +-
rust/benchmarks/src/{main.rs => bin/nyctaxi.rs} | 9 +-
rust/benchmarks/src/bin/tpch.rs | 171 ++
rust/datafusion/Cargo.toml | 8 +-
rust/datafusion/src/datasource/csv.rs | 18 +-
rust/datafusion/src/datasource/datasource.rs | 10 +-
rust/datafusion/src/datasource/memory.rs | 31 +-
rust/datafusion/src/datasource/mod.rs | 2 +-
rust/datafusion/src/datasource/parquet.rs | 39 +-
rust/datafusion/src/error.rs | 1 -
rust/datafusion/src/execution/context.rs | 196 +-
rust/datafusion/src/execution/physical_plan/csv.rs | 24 +-
.../src/execution/physical_plan/datasource.rs | 47 +-
.../src/execution/physical_plan/expressions.rs | 135 +-
.../src/execution/physical_plan/hash_aggregate.rs | 438 ++-
.../src/execution/physical_plan/limit.rs | 111 +-
.../src/execution/physical_plan/memory.rs | 4 +-
.../src/execution/physical_plan/merge.rs | 110 +-
rust/datafusion/src/execution/physical_plan/mod.rs | 12 +-
.../src/execution/physical_plan/parquet.rs | 137 +-
.../src/execution/physical_plan/projection.rs | 2 +
.../src/execution/physical_plan/selection.rs | 2 +
.../datafusion/src/execution/physical_plan/sort.rs | 49 +-
rust/datafusion/src/execution/physical_plan/udf.rs | 23 +
rust/datafusion/src/logicalplan.rs | 99 +-
rust/datafusion/src/optimizer/type_coercion.rs | 51 +-
rust/datafusion/src/optimizer/utils.rs | 1 +
rust/datafusion/src/sql/parser.rs | 43 +-
rust/datafusion/src/sql/planner.rs | 154 +-
rust/datafusion/tests/sql.rs | 38 +
testing | 2 +-
157 files changed, 8355 insertions(+), 1675 deletions(-)
create mode 100644 cpp/src/arrow/compute/kernels/aggregate_mode.cc
create mode 100644 cpp/src/arrow/util/int_util_internal.h
create mode 100644 cpp/src/arrow/vendored/portable-snippets/README.md
create mode 100644 cpp/src/arrow/vendored/portable-snippets/safe-math.h
copy rust/arrow/benches/{array_from_vec.rs => length_kernel.rs} (58%)
create mode 100644 rust/arrow/src/compute/kernels/length.rs
rename rust/benchmarks/src/{main.rs => bin/nyctaxi.rs} (93%)
create mode 100644 rust/benchmarks/src/bin/tpch.rs