You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@datafusion.apache.org by gi...@apache.org on 2026/10/03 13:28:02 UTC
(datafusion-comet) branch main updated (03cb6bdefa -> 9c0fde09c0)
This is an automated email from the ASF dual-hosted git repository.
github-merge-queue[bot] pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git
from 03cb6bdefa docs: note that the peak native aggregate memory metric is not reported (#6557)
add 77aa7f32f4 fix: match Spark's float ordering for sort and window keys nested in arrays and structs (#6475)
add 4bde6895a7 fix: check accelerated mapInArrow output against the declared schema (#6365)
add 9c0fde09c0 docs: check behavior against the latest release and add the 1.1.0 audit's lessons to the review skills (#6516)
No new revisions were added by this update.
Summary of changes:
.ai/skills/review-comet-expression-pr/SKILL.md | 14 ++
.ai/skills/review-comet-memory-pr/SKILL.md | 4 +
.ai/skills/review-comet-pr/SKILL.md | 119 ++++++++++++-
.ai/skills/review-comet-shuffle-pr/SKILL.md | 14 +-
docs/source/contributor-guide/native_shuffle.md | 4 +-
.../latest/compatibility/floating-point.md | 33 ++--
.../user-guide/latest/compatibility/operators.md | 22 +--
docs/source/user-guide/latest/pyarrow-udfs.md | 11 ++
docs/source/user-guide/latest/tuning/operators.md | 21 +--
native/core/src/execution/planner.rs | 60 +++++--
.../main/scala/org/apache/comet/CometConf.scala | 10 +-
.../org/apache/comet/serde/CometSortOrder.scala | 56 ++++--
.../apache/spark/sql/comet/CometWindowExec.scala | 38 +++-
.../sql/comet/CometWindowGroupLimitExec.scala | 34 +---
.../sql/comet/shims/ShimCometMapInBatch.scala | 1 +
.../execution/python/CometArrowPythonRunner.scala | 11 +-
.../sql/comet/shims/ShimCometMapInBatch.scala | 1 +
.../execution/python/CometArrowPythonRunner.scala | 14 +-
.../sql/comet/shims/ShimCometMapInBatch.scala | 1 +
.../execution/python/CometArrowPythonRunner.scala | 14 +-
.../sql/comet/shims/Spark4xMapInBatchSupport.scala | 3 +
.../python/CometArrowPythonRunnerBase.scala | 101 ++++++++++-
.../src/test/resources/pyspark/test_pyarrow_udf.py | 144 +++++++++++++++
.../sql-tests/windows/nested_float_order_keys.sql | 106 +++++++++++
.../windows/nested_float_order_keys_strict.sql | 125 +++++++++++++
.../sql-tests/windows/window_functions.sql | 56 ++++++
.../org/apache/comet/CometExpressionSuite.scala | 99 ++++++++---
.../apache/comet/CometFloatSemanticsSuite.scala | 4 -
.../apache/comet/exec/CometWindowExecSuite.scala | 22 ++-
.../python/CometArrowPythonRunnerSuite.scala | 195 ++++++++++++++++++++-
30 files changed, 1179 insertions(+), 158 deletions(-)
create mode 100644 spark/src/test/resources/sql-tests/windows/nested_float_order_keys.sql
create mode 100644 spark/src/test/resources/sql-tests/windows/nested_float_order_keys_strict.sql
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datafusion.apache.org
For additional commands, e-mail: commits-help@datafusion.apache.org