You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@datafusion.apache.org by gi...@apache.org on 2026/10/20 05:14:59 UTC
(datafusion-comet) branch main updated (cae599ace3 -> 137c894539)
This is an automated email from the ASF dual-hosted git repository.
github-merge-queue[bot] pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git
from cae599ace3 feat: add config to disable or restrict native UDF library loading (#6775)
add 137c894539 feat: support native wide-decimal hashing (#6548)
No new revisions were added by this update.
Summary of changes:
.../expression-audits/hash_funcs.md | 7 +-
docs/source/contributor-guide/jvm_shuffle.md | 4 +-
docs/source/contributor-guide/native_shuffle.md | 9 +-
docs/source/user-guide/latest/expressions.md | 4 +-
docs/source/user-guide/latest/tuning/shuffle.md | 17 +-
native/spark-expr/Cargo.toml | 4 +
native/spark-expr/benches/decimal_hash.rs | 117 ++++++++++
native/spark-expr/src/hash_funcs/utils.rs | 258 +++++++++++++++++++--
native/spark-expr/src/hash_funcs/xxhash64.rs | 4 +-
native/spark-expr/src/hash_funcs/xxhash64_diff.rs | 43 +++-
.../main/scala/org/apache/comet/CometConf.scala | 5 +-
.../scala/org/apache/comet/serde/aggregates.scala | 3 +-
.../main/scala/org/apache/comet/serde/hash.scala | 8 +-
.../shuffle/CometShuffleExchangeExec.scala | 7 +-
.../approved-plans-v1_4/q49/extended.txt | 2 +-
.../approved-plans-v2_7-spark3_5/q70a/extended.txt | 2 +-
.../approved-plans-v2_7-spark4_1/q14a/extended.txt | 2 +-
.../approved-plans-v2_7/q14a/extended.txt | 2 +-
.../approved-plans-v2_7/q36a/extended.txt | 2 +-
.../approved-plans-v2_7/q49/extended.txt | 2 +-
.../approved-plans-v2_7/q5a/extended.txt | 2 +-
.../approved-plans-v2_7/q70a/extended.txt | 2 +-
.../approved-plans-v2_7/q77a/extended.txt | 2 +-
.../approved-plans-v2_7/q80a/extended.txt | 2 +-
.../approved-plans-v2_7/q86a/extended.txt | 2 +-
.../org/apache/comet/CometFuzzAggregateSuite.scala | 28 +--
.../org/apache/comet/CometFuzzTestSuite.scala | 20 +-
.../apache/comet/CometHashExpressionSuite.scala | 71 ++++--
.../comet/exec/CometNativeShuffleSuite.scala | 103 +++++---
.../exec/CometShuffleInputConversionSuite.scala | 46 +++-
.../apache/comet/exec/CometTypedDatasetSuite.scala | 43 ++--
.../benchmark/CometHashExpressionBenchmark.scala | 63 +++++
.../CometCelebornShufflePlanningSuite.scala | 50 ++--
33 files changed, 699 insertions(+), 237 deletions(-)
create mode 100644 native/spark-expr/benches/decimal_hash.rs
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datafusion.apache.org
For additional commands, e-mail: commits-help@datafusion.apache.org