You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@datafusion.apache.org by gi...@apache.org on 2026/10/04 19:17:46 UTC
(datafusion-comet) branch main updated (def2d45c73 -> 683f89dc99)
This is an automated email from the ASF dual-hosted git repository.
github-merge-queue[bot] pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git
from def2d45c73 fix: choose get_json_object number-limit behavior from the runtime Jackson version (#6600)
add 76f436c0f9 feat: add native distinct-combined collect_list aggregate support (#4727)
add 0d729a9b11 fix: align wide-decimal ANSI overflow value with Spark (#5276)
add f8cc63184e fix: draw the cached plan below CometInMemoryTableScan in the SQL tab and event log (#6577)
add 683f89dc99 test: add seeded fuzz coverage for PyArrow UDFs (#6074)
No new revisions were added by this update.
Summary of changes:
.github/workflows/pr_build_linux.yml | 1 +
.github/workflows/pr_build_macos.yml | 1 +
.github/workflows/pyarrow_udf_test.yml | 2 +
dev/ci/compute-changes.py | 1 +
dev/diffs/3.4.3.diff | 14 +-
dev/diffs/3.5.9.diff | 14 +-
dev/diffs/4.0.4.diff | 14 +-
dev/diffs/4.1.3.diff | 14 +-
dev/diffs/4.2.0.diff | 14 +-
.../expression-audits/agg_funcs.md | 2 +-
.../user-guide/latest/compatibility/index.md | 2 -
native/core/src/execution/merge_as_partial.rs | 83 +-
native/core/src/execution/mod.rs | 1 +
native/core/src/execution/spark_aggregate_state.rs | 1101 ++++++++++++++++++++
.../src/math_funcs/wide_decimal_binary_expr.rs | 99 +-
.../org/apache/comet/rules/CometExecRule.scala | 137 +--
.../org/apache/comet/serde/QueryPlanSerde.scala | 19 -
.../scala/org/apache/comet/serde/aggregates.scala | 33 +-
.../sql/comet/CometInMemoryTableScanExec.scala | 9 +
.../org/apache/spark/sql/comet/operators.scala | 36 +-
.../sql/comet/shims/ShimSparkErrorConverter.scala | 3 +-
.../sql/comet/shims/ShimSparkErrorConverter.scala | 3 +-
.../sql/comet/shims/ShimSparkErrorConverter.scala | 3 +-
.../resources/pyspark/test_pyarrow_udf_fuzz.py | 379 +++++++
.../expressions/aggregate/collect_list.sql | 15 +
.../expressions/aggregate/collect_set.sql | 16 +
.../sql-tests/expressions/aggregate/mode.sql | 8 +
.../org/apache/comet/CometExpressionSuite.scala | 15 +-
.../apache/comet/exec/CometAggregateSuite.scala | 209 +++-
.../comet/exec/CometInMemoryCacheSuite.scala | 46 +-
.../apache/comet/rules/CometExecRuleSuite.scala | 22 +
.../sql/execution/CometSparkPlanInfoHelper.scala} | 14 +-
.../CometInMemoryCacheLastAttemptMetricSuite.scala | 73 ++
33 files changed, 2216 insertions(+), 187 deletions(-)
create mode 100644 native/core/src/execution/spark_aggregate_state.rs
create mode 100644 spark/src/test/resources/pyspark/test_pyarrow_udf_fuzz.py
copy spark/src/{main/scala/org/apache/comet/MetricsSupport.scala => test/scala/org/apache/spark/sql/execution/CometSparkPlanInfoHelper.scala} (68%)
create mode 100644 spark/src/test/spark-4.2/org/apache/comet/exec/CometInMemoryCacheLastAttemptMetricSuite.scala
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datafusion.apache.org
For additional commands, e-mail: commits-help@datafusion.apache.org