You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@datafusion.apache.org by gi...@apache.org on 2026/10/04 19:17:46 UTC

(datafusion-comet) branch main updated (def2d45c73 -> 683f89dc99)

This is an automated email from the ASF dual-hosted git repository.

github-merge-queue[bot] pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git


    from def2d45c73 fix: choose get_json_object number-limit behavior from the runtime Jackson version (#6600)
     add 76f436c0f9 feat: add native distinct-combined collect_list aggregate support (#4727)
     add 0d729a9b11 fix: align wide-decimal ANSI overflow value with Spark (#5276)
     add f8cc63184e fix: draw the cached plan below CometInMemoryTableScan in the SQL tab and event log (#6577)
     add 683f89dc99 test: add seeded fuzz coverage for PyArrow UDFs (#6074)

No new revisions were added by this update.

Summary of changes:
 .github/workflows/pr_build_linux.yml               |    1 +
 .github/workflows/pr_build_macos.yml               |    1 +
 .github/workflows/pyarrow_udf_test.yml             |    2 +
 dev/ci/compute-changes.py                          |    1 +
 dev/diffs/3.4.3.diff                               |   14 +-
 dev/diffs/3.5.9.diff                               |   14 +-
 dev/diffs/4.0.4.diff                               |   14 +-
 dev/diffs/4.1.3.diff                               |   14 +-
 dev/diffs/4.2.0.diff                               |   14 +-
 .../expression-audits/agg_funcs.md                 |    2 +-
 .../user-guide/latest/compatibility/index.md       |    2 -
 native/core/src/execution/merge_as_partial.rs      |   83 +-
 native/core/src/execution/mod.rs                   |    1 +
 native/core/src/execution/spark_aggregate_state.rs | 1101 ++++++++++++++++++++
 .../src/math_funcs/wide_decimal_binary_expr.rs     |   99 +-
 .../org/apache/comet/rules/CometExecRule.scala     |  137 +--
 .../org/apache/comet/serde/QueryPlanSerde.scala    |   19 -
 .../scala/org/apache/comet/serde/aggregates.scala  |   33 +-
 .../sql/comet/CometInMemoryTableScanExec.scala     |    9 +
 .../org/apache/spark/sql/comet/operators.scala     |   36 +-
 .../sql/comet/shims/ShimSparkErrorConverter.scala  |    3 +-
 .../sql/comet/shims/ShimSparkErrorConverter.scala  |    3 +-
 .../sql/comet/shims/ShimSparkErrorConverter.scala  |    3 +-
 .../resources/pyspark/test_pyarrow_udf_fuzz.py     |  379 +++++++
 .../expressions/aggregate/collect_list.sql         |   15 +
 .../expressions/aggregate/collect_set.sql          |   16 +
 .../sql-tests/expressions/aggregate/mode.sql       |    8 +
 .../org/apache/comet/CometExpressionSuite.scala    |   15 +-
 .../apache/comet/exec/CometAggregateSuite.scala    |  209 +++-
 .../comet/exec/CometInMemoryCacheSuite.scala       |   46 +-
 .../apache/comet/rules/CometExecRuleSuite.scala    |   22 +
 .../sql/execution/CometSparkPlanInfoHelper.scala}  |   14 +-
 .../CometInMemoryCacheLastAttemptMetricSuite.scala |   73 ++
 33 files changed, 2216 insertions(+), 187 deletions(-)
 create mode 100644 native/core/src/execution/spark_aggregate_state.rs
 create mode 100644 spark/src/test/resources/pyspark/test_pyarrow_udf_fuzz.py
 copy spark/src/{main/scala/org/apache/comet/MetricsSupport.scala => test/scala/org/apache/spark/sql/execution/CometSparkPlanInfoHelper.scala} (68%)
 create mode 100644 spark/src/test/spark-4.2/org/apache/comet/exec/CometInMemoryCacheLastAttemptMetricSuite.scala


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datafusion.apache.org
For additional commands, e-mail: commits-help@datafusion.apache.org