You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@datafusion.apache.org by gi...@apache.org on 2026/10/03 13:28:02 UTC

(datafusion-comet) branch main updated (03cb6bdefa -> 9c0fde09c0)

This is an automated email from the ASF dual-hosted git repository.

github-merge-queue[bot] pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git


    from 03cb6bdefa docs: note that the peak native aggregate memory metric is not reported (#6557)
     add 77aa7f32f4 fix: match Spark's float ordering for sort and window keys nested in arrays and structs (#6475)
     add 4bde6895a7 fix: check accelerated mapInArrow output against the declared schema (#6365)
     add 9c0fde09c0 docs: check behavior against the latest release and add the 1.1.0 audit's lessons to the review skills (#6516)

No new revisions were added by this update.

Summary of changes:
 .ai/skills/review-comet-expression-pr/SKILL.md     |  14 ++
 .ai/skills/review-comet-memory-pr/SKILL.md         |   4 +
 .ai/skills/review-comet-pr/SKILL.md                | 119 ++++++++++++-
 .ai/skills/review-comet-shuffle-pr/SKILL.md        |  14 +-
 docs/source/contributor-guide/native_shuffle.md    |   4 +-
 .../latest/compatibility/floating-point.md         |  33 ++--
 .../user-guide/latest/compatibility/operators.md   |  22 +--
 docs/source/user-guide/latest/pyarrow-udfs.md      |  11 ++
 docs/source/user-guide/latest/tuning/operators.md  |  21 +--
 native/core/src/execution/planner.rs               |  60 +++++--
 .../main/scala/org/apache/comet/CometConf.scala    |  10 +-
 .../org/apache/comet/serde/CometSortOrder.scala    |  56 ++++--
 .../apache/spark/sql/comet/CometWindowExec.scala   |  38 +++-
 .../sql/comet/CometWindowGroupLimitExec.scala      |  34 +---
 .../sql/comet/shims/ShimCometMapInBatch.scala      |   1 +
 .../execution/python/CometArrowPythonRunner.scala  |  11 +-
 .../sql/comet/shims/ShimCometMapInBatch.scala      |   1 +
 .../execution/python/CometArrowPythonRunner.scala  |  14 +-
 .../sql/comet/shims/ShimCometMapInBatch.scala      |   1 +
 .../execution/python/CometArrowPythonRunner.scala  |  14 +-
 .../sql/comet/shims/Spark4xMapInBatchSupport.scala |   3 +
 .../python/CometArrowPythonRunnerBase.scala        | 101 ++++++++++-
 .../src/test/resources/pyspark/test_pyarrow_udf.py | 144 +++++++++++++++
 .../sql-tests/windows/nested_float_order_keys.sql  | 106 +++++++++++
 .../windows/nested_float_order_keys_strict.sql     | 125 +++++++++++++
 .../sql-tests/windows/window_functions.sql         |  56 ++++++
 .../org/apache/comet/CometExpressionSuite.scala    |  99 ++++++++---
 .../apache/comet/CometFloatSemanticsSuite.scala    |   4 -
 .../apache/comet/exec/CometWindowExecSuite.scala   |  22 ++-
 .../python/CometArrowPythonRunnerSuite.scala       | 195 ++++++++++++++++++++-
 30 files changed, 1179 insertions(+), 158 deletions(-)
 create mode 100644 spark/src/test/resources/sql-tests/windows/nested_float_order_keys.sql
 create mode 100644 spark/src/test/resources/sql-tests/windows/nested_float_order_keys_strict.sql


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datafusion.apache.org
For additional commands, e-mail: commits-help@datafusion.apache.org