You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@arrow.apache.org by ks...@apache.org on 2021/01/25 21:54:23 UTC
[arrow] branch master updated (d238279 -> 437c8c9)
This is an automated email from the ASF dual-hosted git repository.
kszucs pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/arrow.git.
omit d238279 ARROW-11147: [CI][Python] Remove pandas=0.25.3 pin for dask-latest
omit b3b6241 ARROW-10370: [Python] Clean-up filesystem handling in write_dataset
omit 3e47777 ARROW-11375: [Rust] Fix deprecation warning in clippy
omit cf7638f ARROW-11349: [Rust] Add from_iter_values to create arrays from (non null) values
omit 10f4ada ARROW-11317: [Rust] Include the prettyprint feature in CI Coverage
omit 67d0c2e ARROW-11319: [Rust] [DataFusion] Improve test comparisons to record batch, remove test::format_batch
omit 13e2134 ARROW-11291: [Rust] Add extend to MutableBuffer (-20% for arithmetic, -97% for length)
omit b44a4ad ARROW-11299: [Python] Fix invalid-offsetof warnings
omit 262bbdc ARROW-11332: [Rust] Use MutableBuffer in take_string instead of Vec
omit 251ecac ARROW-10766: [Rust] [Parquet] Compute nested list definitions
omit 457fa91 ARROW-11343: [Rust][DataFusion] Simplified example with UDF.
omit 629a6fd ARROW-10299: [Rust] Use IPC Metadata V5 as default
omit 499b6d0 ARROW-11333: [Rust] Generalized creation of empty arrays.
omit 6959e46 ARROW-11337: [C++] Compilation error with ThreadSanitizer
omit c413566 ARROW-11141: [Rust] Add basic Miri checks to CI pipeline
omit bc5d8bf ARROW-11320: [C++] Try to strengthen temporary dir creation
omit 72bf95a ARROW-11334: [Python][CI] Fix failing pandas nightly tests
omit bd90043 ARROW-10831: [C++][Compute] Implement quantile kernel
omit 84126d5 ARROW-11323: [Rust][DataFusion] Allow sort queries to return no results
omit 4601c02 ARROW-11330: [Rust][DataFusion] add ExpressionVisitor to encode expression walking
omit 8b56f85 ARROW-11220: [Rust] Implement GROUP BY support for Boolean
omit a0e1244 ARROW-11329: [Rust] Don't rerun build.rs on every file change
omit 23550c2 ARROW-11149: [Rust] DF Support List/LargeList/FixedSizeList in create_batch_empty
omit 6912869 ARROW-11290: [Rust][DataFusion] Address hash aggregate performance issue with high number of groups
omit 01c5aec ARROW-11265: [Rust] Made bool not ArrowNativeType
omit ed709e0 ARROW-11311: [Rust] Fixed unset_bit
omit 71572bd ARROW-11318: [Rust] Support pretty printing timestamp, date, and timestamp types
omit e7c69e6 ARROW-11279: [Rust][Parquet] ArrowWriter Definition Levels Memory Usage
omit 555643a ARROW-11269: [Rust] [Parquet] Preserve timezone in int96 reader
omit a7633c7 ARROW-11322: [Rust] Re-opening `memory` module as public
omit 50ba534 ARROW-11277: [C++] Workaround macOS 10.11: don't default construct consts
omit 35053fe ARROW-11222: [Rust] Catch up with flatbuffers 0.8.1 which had some UB problems fixed
omit 8e218e0 ARROW-11313: [Rust] Fixed size_hint
omit bbc9029 ARROW-11156: [Rust][DataFusion] Create hashes vectorized in hash join
omit a4266a1 ARROW-11321: [Rust][DataFusion] Fix DataFusion compilation error
omit 4a6eb19 ARROW-11268: [Rust][DataFusion] MemTable::load output partition support
omit b448de7 ARROW-11216: [Rust] add doc example for StringDictionaryBuilder
omit 7e0cb0a ARROW-11108: [Rust] Fixed performance issue in mutableBuffer.
omit f63cffa ARROW-11305 Skip first argument (which is the program name) in parquet-rowcount binary
omit 0e5d646 ARROW-9128: [C++] Implement string space trimming kernels: trim, ltrim, and rtrim
omit 127961a ARROW-10489: [C++] Add Intel C++ compiler options for different warning levels
omit 18dc62c ARROW-11074: [Rust][DataFusion] Implement predicate push-down for parquet tables
omit e20f439 ARROW-11254: [Rust][DataFusion] Add SIMD and snmalloc flags as options to benchmarks
omit 2d3e8f9 ARROW-11246: [Rust] Add type to Unexpected accumulator state error
omit 275fda1 ARROW-7633: [C++][CI] Create fuzz targets for tensors and sparse tensors
omit 17a3fab ARROW-11314: [Release][APT][Yum] Add support for verifying arm64 packages
omit 19e9559 ARROW-11315: [Packaging][APT][arm64] Add missing gir1.2 files
omit 903b41c ARROW-11309: [Release][C#] Use .NET 3.1 for verification
omit 69a9a1c ARROW-11303: [Release][C++] Enable mimalloc in the windows verification script
add d27d80d [Release] Update CHANGELOG.md for 3.0.0
add d1128e8 [Release] Update .deb/.rpm changelogs for 3.0.0
add 771c515 [Release] Update versions for 3.0.0
add d613aa6 [maven-release-plugin] prepare release apache-arrow-3.0.0
new 30e61a0 [maven-release-plugin] prepare for next development iteration
new e2e9810 [Release] Update versions for 4.0.0-SNAPSHOT
new 3af46ff [Release] Update .deb package names for 4.0.0
new f297504 ARROW-11303: [Release][C++] Enable mimalloc in the windows verification script
new b090461 ARROW-11309: [Release][C#] Use .NET 3.1 for verification
new e3b5103 ARROW-11315: [Packaging][APT][arm64] Add missing gir1.2 files
new 284155e ARROW-11314: [Release][APT][Yum] Add support for verifying arm64 packages
new d6be461 ARROW-7633: [C++][CI] Create fuzz targets for tensors and sparse tensors
new ceb6b25 ARROW-11246: [Rust] Add type to Unexpected accumulator state error
new 6354e9c ARROW-11254: [Rust][DataFusion] Add SIMD and snmalloc flags as options to benchmarks
new 6eb5f91 ARROW-11074: [Rust][DataFusion] Implement predicate push-down for parquet tables
new 5fa201d ARROW-10489: [C++] Add Intel C++ compiler options for different warning levels
new c0cff01 ARROW-9128: [C++] Implement string space trimming kernels: trim, ltrim, and rtrim
new aeeeca0 ARROW-11305 Skip first argument (which is the program name) in parquet-rowcount binary
new 99a6300 ARROW-11108: [Rust] Fixed performance issue in mutableBuffer.
new 2de39d1 ARROW-11216: [Rust] add doc example for StringDictionaryBuilder
new 47752e0 ARROW-11268: [Rust][DataFusion] MemTable::load output partition support
new 434112b ARROW-11321: [Rust][DataFusion] Fix DataFusion compilation error
new e073d8c ARROW-11156: [Rust][DataFusion] Create hashes vectorized in hash join
new 8f7a5ff ARROW-11313: [Rust] Fixed size_hint
new 7ee0166 ARROW-11222: [Rust] Catch up with flatbuffers 0.8.1 which had some UB problems fixed
new 063cbaf ARROW-11277: [C++] Workaround macOS 10.11: don't default construct consts
new 34b35fa ARROW-11322: [Rust] Re-opening `memory` module as public
new a1b404a ARROW-11269: [Rust] [Parquet] Preserve timezone in int96 reader
new 56f8d71 ARROW-11279: [Rust][Parquet] ArrowWriter Definition Levels Memory Usage
new 15cebca ARROW-11318: [Rust] Support pretty printing timestamp, date, and timestamp types
new 29cfed4 ARROW-11311: [Rust] Fixed unset_bit
new 0a58593 ARROW-11265: [Rust] Made bool not ArrowNativeType
new 7c795c9 ARROW-11290: [Rust][DataFusion] Address hash aggregate performance issue with high number of groups
new 70ecc6e ARROW-11149: [Rust] DF Support List/LargeList/FixedSizeList in create_batch_empty
new 413573e ARROW-11329: [Rust] Don't rerun build.rs on every file change
new 0c3eb74 ARROW-11220: [Rust] Implement GROUP BY support for Boolean
new 391606e ARROW-11330: [Rust][DataFusion] add ExpressionVisitor to encode expression walking
new 7eedce2 ARROW-11323: [Rust][DataFusion] Allow sort queries to return no results
new 1be28fb ARROW-10831: [C++][Compute] Implement quantile kernel
new a2f53fb ARROW-11334: [Python][CI] Fix failing pandas nightly tests
new f676473 ARROW-11320: [C++] Try to strengthen temporary dir creation
new 682c5cd ARROW-11141: [Rust] Add basic Miri checks to CI pipeline
new b224108 ARROW-11337: [C++] Compilation error with ThreadSanitizer
new e1cebfc ARROW-11333: [Rust] Generalized creation of empty arrays.
new aa2ec3e ARROW-10299: [Rust] Use IPC Metadata V5 as default
new 0a54666 ARROW-11343: [Rust][DataFusion] Simplified example with UDF.
new dea7b5e ARROW-10766: [Rust] [Parquet] Compute nested list definitions
new 691226b ARROW-11332: [Rust] Use MutableBuffer in take_string instead of Vec
new 6710ddd ARROW-11299: [Python] Fix invalid-offsetof warnings
new eb81c81 ARROW-11291: [Rust] Add extend to MutableBuffer (-20% for arithmetic, -97% for length)
new 447d73e ARROW-11319: [Rust] [DataFusion] Improve test comparisons to record batch, remove test::format_batch
new 09de412 ARROW-11317: [Rust] Include the prettyprint feature in CI Coverage
new 84ea8b9 ARROW-11349: [Rust] Add from_iter_values to create arrays from (non null) values
new 0708422 ARROW-11375: [Rust] Fix deprecation warning in clippy
new 2a0bcc7 ARROW-10370: [Python] Clean-up filesystem handling in write_dataset
new 437c8c9 ARROW-11147: [CI][Python] Remove pandas=0.25.3 pin for dask-latest
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (d238279)
\
N -- N -- N refs/heads/master (437c8c9)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 52 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
CHANGELOG.md | 699 +++++++++++++++++++++
c_glib/configure.ac | 2 +-
c_glib/meson.build | 2 +-
ci/scripts/PKGBUILD | 2 +-
cpp/CMakeLists.txt | 2 +-
csharp/Directory.Build.props | 2 +-
dev/release/rat_exclude_files.txt | 56 +-
dev/tasks/homebrew-formulae/apache-arrow.rb | 2 +-
.../homebrew-formulae/autobrew/apache-arrow.rb | 2 +-
.../apache-arrow-archive-keyring/debian/changelog | 6 +
.../yum/apache-arrow-release.spec.in | 3 +
.../apache-arrow/debian.ubuntu-xenial/changelog | 6 +
.../apache-arrow/debian.ubuntu-xenial/control | 86 +--
.../libarrow-cuda-glib400.install} | 0
.../libarrow-cuda400.install} | 0
.../libarrow-dataset-glib400.install} | 0
.../libarrow-dataset400.install} | 0
.../libarrow-glib400.install} | 0
.../libarrow-python400.install} | 0
.../libarrow400.install} | 0
.../libgandiva-glib400.install} | 0
.../libgandiva400.install} | 0
.../libparquet-glib400.install} | 0
.../libparquet400.install} | 0
.../libplasma-glib400.install} | 0
.../libplasma400.install} | 0
.../linux-packages/apache-arrow/debian/changelog | 6 +
.../linux-packages/apache-arrow/debian/control.in | 102 +--
.../libarrow-cuda-glib400.install} | 0
.../libarrow-cuda400.install} | 0
.../libarrow-dataset-glib400.install} | 0
.../libarrow-dataset400.install} | 0
...light300.install => libarrow-flight400.install} | 0
.../libarrow-glib400.install} | 0
...0.install => libarrow-python-flight400.install} | 0
.../libarrow-python400.install} | 0
.../libarrow400.install} | 0
.../libgandiva-glib400.install} | 0
.../libgandiva400.install} | 0
.../libparquet-glib400.install} | 0
.../libparquet400.install} | 0
.../libplasma-glib400.install} | 0
.../libplasma400.install} | 0
.../linux-packages/apache-arrow/yum/arrow.spec.in | 3 +
dev/tasks/tasks.yml | 284 ++++-----
java/adapter/avro/pom.xml | 2 +-
java/adapter/jdbc/pom.xml | 2 +-
java/adapter/orc/pom.xml | 2 +-
java/algorithm/pom.xml | 2 +-
java/flight/flight-core/pom.xml | 2 +-
java/flight/flight-grpc/pom.xml | 2 +-
java/format/pom.xml | 2 +-
java/gandiva/pom.xml | 2 +-
java/memory/memory-core/pom.xml | 2 +-
java/memory/memory-netty/pom.xml | 2 +-
java/memory/memory-unsafe/pom.xml | 2 +-
java/memory/pom.xml | 2 +-
java/performance/pom.xml | 4 +-
java/plasma/pom.xml | 2 +-
java/pom.xml | 2 +-
java/tools/pom.xml | 2 +-
java/vector/pom.xml | 2 +-
js/package.json | 2 +-
matlab/CMakeLists.txt | 2 +-
python/setup.py | 2 +-
r/DESCRIPTION | 2 +-
r/NEWS.md | 4 +-
ruby/red-arrow-cuda/lib/arrow-cuda/version.rb | 2 +-
.../red-arrow-dataset/lib/arrow-dataset/version.rb | 2 +-
ruby/red-arrow/lib/arrow/version.rb | 2 +-
ruby/red-gandiva/lib/gandiva/version.rb | 2 +-
ruby/red-parquet/lib/parquet/version.rb | 2 +-
ruby/red-plasma/lib/plasma/version.rb | 2 +-
rust/arrow-flight/Cargo.toml | 4 +-
rust/arrow-pyarrow-integration-testing/Cargo.toml | 4 +-
rust/arrow/Cargo.toml | 2 +-
rust/benchmarks/Cargo.toml | 2 +-
rust/datafusion/Cargo.toml | 8 +-
rust/datafusion/README.md | 2 +-
rust/integration-testing/Cargo.toml | 2 +-
rust/parquet/Cargo.toml | 6 +-
rust/parquet/README.md | 4 +-
rust/parquet_derive/Cargo.toml | 4 +-
rust/parquet_derive/README.md | 4 +-
rust/parquet_derive_test/Cargo.toml | 6 +-
85 files changed, 1049 insertions(+), 324 deletions(-)
rename dev/tasks/linux-packages/apache-arrow/{debian/libarrow-cuda-glib300.install => debian.ubuntu-xenial/libarrow-cuda-glib400.install} (100%)
rename dev/tasks/linux-packages/apache-arrow/{debian/libarrow-cuda300.install => debian.ubuntu-xenial/libarrow-cuda400.install} (100%)
rename dev/tasks/linux-packages/apache-arrow/{debian/libarrow-dataset-glib300.install => debian.ubuntu-xenial/libarrow-dataset-glib400.install} (100%)
rename dev/tasks/linux-packages/apache-arrow/{debian/libarrow-dataset300.install => debian.ubuntu-xenial/libarrow-dataset400.install} (100%)
rename dev/tasks/linux-packages/apache-arrow/{debian/libarrow-glib300.install => debian.ubuntu-xenial/libarrow-glib400.install} (100%)
rename dev/tasks/linux-packages/apache-arrow/{debian/libarrow-python300.install => debian.ubuntu-xenial/libarrow-python400.install} (100%)
rename dev/tasks/linux-packages/apache-arrow/{debian/libarrow300.install => debian.ubuntu-xenial/libarrow400.install} (100%)
rename dev/tasks/linux-packages/apache-arrow/{debian/libgandiva-glib300.install => debian.ubuntu-xenial/libgandiva-glib400.install} (100%)
rename dev/tasks/linux-packages/apache-arrow/{debian/libgandiva300.install => debian.ubuntu-xenial/libgandiva400.install} (100%)
rename dev/tasks/linux-packages/apache-arrow/{debian/libparquet-glib300.install => debian.ubuntu-xenial/libparquet-glib400.install} (100%)
rename dev/tasks/linux-packages/apache-arrow/{debian/libparquet300.install => debian.ubuntu-xenial/libparquet400.install} (100%)
rename dev/tasks/linux-packages/apache-arrow/{debian/libplasma-glib300.install => debian.ubuntu-xenial/libplasma-glib400.install} (100%)
rename dev/tasks/linux-packages/apache-arrow/{debian/libplasma300.install => debian.ubuntu-xenial/libplasma400.install} (100%)
rename dev/tasks/linux-packages/apache-arrow/{debian.ubuntu-xenial/libarrow-cuda-glib300.install => debian/libarrow-cuda-glib400.install} (100%)
rename dev/tasks/linux-packages/apache-arrow/{debian.ubuntu-xenial/libarrow-cuda300.install => debian/libarrow-cuda400.install} (100%)
rename dev/tasks/linux-packages/apache-arrow/{debian.ubuntu-xenial/libarrow-dataset-glib300.install => debian/libarrow-dataset-glib400.install} (100%)
rename dev/tasks/linux-packages/apache-arrow/{debian.ubuntu-xenial/libarrow-dataset300.install => debian/libarrow-dataset400.install} (100%)
rename dev/tasks/linux-packages/apache-arrow/debian/{libarrow-flight300.install => libarrow-flight400.install} (100%)
rename dev/tasks/linux-packages/apache-arrow/{debian.ubuntu-xenial/libarrow-glib300.install => debian/libarrow-glib400.install} (100%)
rename dev/tasks/linux-packages/apache-arrow/debian/{libarrow-python-flight300.install => libarrow-python-flight400.install} (100%)
rename dev/tasks/linux-packages/apache-arrow/{debian.ubuntu-xenial/libarrow-python300.install => debian/libarrow-python400.install} (100%)
rename dev/tasks/linux-packages/apache-arrow/{debian.ubuntu-xenial/libarrow300.install => debian/libarrow400.install} (100%)
rename dev/tasks/linux-packages/apache-arrow/{debian.ubuntu-xenial/libgandiva-glib300.install => debian/libgandiva-glib400.install} (100%)
rename dev/tasks/linux-packages/apache-arrow/{debian.ubuntu-xenial/libgandiva300.install => debian/libgandiva400.install} (100%)
rename dev/tasks/linux-packages/apache-arrow/{debian.ubuntu-xenial/libparquet-glib300.install => debian/libparquet-glib400.install} (100%)
rename dev/tasks/linux-packages/apache-arrow/{debian.ubuntu-xenial/libparquet300.install => debian/libparquet400.install} (100%)
rename dev/tasks/linux-packages/apache-arrow/{debian.ubuntu-xenial/libplasma-glib300.install => debian/libplasma-glib400.install} (100%)
rename dev/tasks/linux-packages/apache-arrow/{debian.ubuntu-xenial/libplasma300.install => debian/libplasma400.install} (100%)