You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@datafusion.apache.org by gi...@apache.org on 2026/10/23 12:38:57 UTC
(datafusion-comet) branch asf-site updated (2d537d85c1 -> d136db16ca)
This is an automated email from the ASF dual-hosted git repository.
github-actions[bot] pushed a change to branch asf-site
in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git
discard 2d537d85c1 Publish built docs triggered by 886e0a9532597322fc131027f4d1841f1e36ba66
new d136db16ca Publish built docs triggered by 6cc7b8625aa9f33c24de221182c59bc7fb58c97e
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (2d537d85c1)
\
N -- N -- N refs/heads/asf-site (d136db16ca)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
_images/mermaid-09341aca03757d9d3637a2eaff73472d472d0673.svg | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datafusion.apache.org
For additional commands, e-mail: commits-help@datafusion.apache.org
(datafusion-comet) 01/01: Publish built docs triggered by 6cc7b8625aa9f33c24de221182c59bc7fb58c97e
Posted by gi...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
github-actions[bot] pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git
commit d136db16ca0499429e8874822545755bde0bbdba
Author: github-actions[bot] <gi...@users.noreply.github.com>
AuthorDate: Fri Oct 23 12:38:50 2026 +0000
Publish built docs triggered by 6cc7b8625aa9f33c24de221182c59bc7fb58c97e
---
_images/mermaid-09341aca03757d9d3637a2eaff73472d472d0673.svg | 2 +-
_sources/contributor-guide/adding_a_new_operator.md.txt | 7 +++++++
_sources/contributor-guide/expression-audits/window_funcs.md.txt | 3 ++-
contributor-guide/adding_a_new_operator.html | 6 ++++++
contributor-guide/expression-audits/window_funcs.html | 3 ++-
searchindex.js | 2 +-
6 files changed, 19 insertions(+), 4 deletions(-)
diff --git a/_images/mermaid-09341aca03757d9d3637a2eaff73472d472d0673.svg b/_images/mermaid-09341aca03757d9d3637a2eaff73472d472d0673.svg
index 5091f2a2ce..a21379916a 100644
--- a/_images/mermaid-09341aca03757d9d3637a2eaff73472d472d0673.svg
+++ b/_images/mermaid-09341aca03757d9d3637a2eaff73472d472d0673.svg
@@ -1 +1 @@
-<svg id="my-svg" width="100%" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" class="flowchart" style="max-width: 511.73px; background-color: transparent;" viewBox="0 0 511.7299499511719 1014" role="graphics-document document" aria-roledescription="flowchart-v2"><style>#my-svg{font-family:"trebuchet ms",verdana,arial,sans-serif;font-size:16px;fill:#333;}@keyframes edge-animation-frame{from{stroke-dashoffset:0;}}@keyframes dash{to{stroke-dashoffset:0;}}#my-sv [...]
\ No newline at end of file
+<svg id="my-svg" width="100%" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" class="flowchart" style="max-width: 511.73px; background-color: transparent;" viewBox="0 0 511.7299499511719 1014" role="graphics-document document" aria-roledescription="flowchart-v2"><style>#my-svg{font-family:"trebuchet ms",verdana,arial,sans-serif;font-size:16px;fill:#333;}@keyframes edge-animation-frame{from{stroke-dashoffset:0;}}@keyframes dash{to{stroke-dashoffset:0;}}#my-sv [...]
\ No newline at end of file
diff --git a/_sources/contributor-guide/adding_a_new_operator.md.txt b/_sources/contributor-guide/adding_a_new_operator.md.txt
index 0706e71f7d..e142aaa499 100644
--- a/_sources/contributor-guide/adding_a_new_operator.md.txt
+++ b/_sources/contributor-guide/adding_a_new_operator.md.txt
@@ -576,6 +576,13 @@ then the projection restores its order, duplicates and aliases. The predicate st
original input schema. Both native plans remain for metrics, including when they share a Spark
plan ID. Computed projections and projections that use every input column are unchanged.
+`CometFilterExec` and `CometProjectionExec` are typed aliases of `MetricOwningExec`, which owns
+the stable metrics for their Spark plan nodes. Execution-local child replacements share that
+metric set and register the executing DataFusion operator's fresh metric handles. Plan rewrites,
+including `reset_state`, create a new metric set. Both keep the operator's settings, such as the
+filter's runtime filter pushdown permission. The aliases retain their operator-specific accessors
+and distinct downcast types.
+
#### Implement the Operator
Create the operator implementation that the builder calls, either in an existing file or a new file in `native/core/src/execution/operators/`:
diff --git a/_sources/contributor-guide/expression-audits/window_funcs.md.txt b/_sources/contributor-guide/expression-audits/window_funcs.md.txt
index c692a42a55..7b6111f1fa 100644
--- a/_sources/contributor-guide/expression-audits/window_funcs.md.txt
+++ b/_sources/contributor-guide/expression-audits/window_funcs.md.txt
@@ -35,6 +35,7 @@
## sum (window)
-- 4.1.1, audited 2026-06-25: `SUM(<decimal>)` over a sliding window frame (lower bound not `UNBOUNDED PRECEDING`) falls back to Spark. The native sliding path would use DataFusion's built-in `sum`, which wraps on overflow rather than returning Spark's NULL, and overflow cannot be detected at plan time, so the whole sliding decimal `SUM` case falls back. Ever-expanding frames use Comet's overflow-aware `SumDecimal` UDAF and run natively, matching Spark including overflow-to-NULL. Bigint s [...]
+- 4.1.1, audited 2026-06-25: `SUM(<decimal>)` over a sliding window frame (lower bound not `UNBOUNDED PRECEDING`) falls back to Spark. The native sliding path would use DataFusion's built-in `sum`, which wraps on overflow rather than returning Spark's NULL, and overflow cannot be detected at plan time, so the whole sliding decimal `SUM` case falls back. Ever-expanding frames use Comet's overflow-aware `SumDecimal` UDAF and run natively, matching Spark including overflow-to-NULL. Bigint s [...]
+- 3.5.9 and 4.1.3, audited 2026-09-30: Integral sliding `SUM` uses a native retractable accumulator in ANSI and TRY mode. It checks ordered prefix sums, so intermediate overflow throws or returns NULL even when later values cancel it, and results recover once the offending values leave the frame. Legacy sliding sums retain the DataFusion path.
[Spark Expression Support]: ../../user-guide/latest/expressions.md
diff --git a/contributor-guide/adding_a_new_operator.html b/contributor-guide/adding_a_new_operator.html
index 96422050e5..8fc121d0af 100644
--- a/contributor-guide/adding_a_new_operator.html
+++ b/contributor-guide/adding_a_new_operator.html
@@ -1082,6 +1082,12 @@ empty projections such as the input to <code class="docutils literal notranslate
then the projection restores its order, duplicates and aliases. The predicate still sees its
original input schema. Both native plans remain for metrics, including when they share a Spark
plan ID. Computed projections and projections that use every input column are unchanged.</p>
+<p><code class="docutils literal notranslate"><span class="pre">CometFilterExec</span></code> and <code class="docutils literal notranslate"><span class="pre">CometProjectionExec</span></code> are typed aliases of <code class="docutils literal notranslate"><span class="pre">MetricOwningExec</span></code>, which owns
+the stable metrics for their Spark plan nodes. Execution-local child replacements share that
+metric set and register the executing DataFusion operator’s fresh metric handles. Plan rewrites,
+including <code class="docutils literal notranslate"><span class="pre">reset_state</span></code>, create a new metric set. Both keep the operator’s settings, such as the
+filter’s runtime filter pushdown permission. The aliases retain their operator-specific accessors
+and distinct downcast types.</p>
</section>
<section id="implement-the-operator">
<h4>Implement the Operator<a class="headerlink" href="#implement-the-operator" title="Link to this heading">#</a></h4>
diff --git a/contributor-guide/expression-audits/window_funcs.html b/contributor-guide/expression-audits/window_funcs.html
index 44baeccacf..a039d2aa76 100644
--- a/contributor-guide/expression-audits/window_funcs.html
+++ b/contributor-guide/expression-audits/window_funcs.html
@@ -584,7 +584,8 @@ under the License.
<section id="sum-window">
<h2>sum (window)<a class="headerlink" href="#sum-window" title="Link to this heading">#</a></h2>
<ul class="simple">
-<li><p>4.1.1, audited 2026-06-25: <code class="docutils literal notranslate"><span class="pre">SUM(<decimal>)</span></code> over a sliding window frame (lower bound not <code class="docutils literal notranslate"><span class="pre">UNBOUNDED</span> <span class="pre">PRECEDING</span></code>) falls back to Spark. The native sliding path would use DataFusion’s built-in <code class="docutils literal notranslate"><span class="pre">sum</span></code>, which wraps on overflow rather than ret [...]
+<li><p>4.1.1, audited 2026-06-25: <code class="docutils literal notranslate"><span class="pre">SUM(<decimal>)</span></code> over a sliding window frame (lower bound not <code class="docutils literal notranslate"><span class="pre">UNBOUNDED</span> <span class="pre">PRECEDING</span></code>) falls back to Spark. The native sliding path would use DataFusion’s built-in <code class="docutils literal notranslate"><span class="pre">sum</span></code>, which wraps on overflow rather than ret [...]
+<li><p>3.5.9 and 4.1.3, audited 2026-09-30: Integral sliding <code class="docutils literal notranslate"><span class="pre">SUM</span></code> uses a native retractable accumulator in ANSI and TRY mode. It checks ordered prefix sums, so intermediate overflow throws or returns NULL even when later values cancel it, and results recover once the offending values leave the frame. Legacy sliding sums retain the DataFusion path.</p></li>
</ul>
</section>
</section>
diff --git a/searchindex.js b/searchindex.js
index f7218e91cc..bdb23e2729 100644
--- a/searchindex.js
+++ b/searchindex.js
@@ -1 +1 @@
-Search.setIndex({"alltitles": {"!": [[63, "id1"]], "%": [[61, "id1"]], "&": [[51, "id1"]], "*": [[61, "id2"]], "+": [[61, "id3"]], "-": [[61, "id4"]], "/": [[61, "id5"]], "1. Format Your Code": [[48, "format-your-code"]], "1. Install Comet": [[70, "install-comet"], [82, "install-comet"]], "1. Native Operators (nativeExecs map)": [[31, "native-operators-nativeexecs-map"]], "2. Build and Verify": [[48, "build-and-verify"]], "2. Clone Iceberg and Apply Diff": [[70, "clone-iceberg-and-apply- [...]
\ No newline at end of file
+Search.setIndex({"alltitles": {"!": [[63, "id1"]], "%": [[61, "id1"]], "&": [[51, "id1"]], "*": [[61, "id2"]], "+": [[61, "id3"]], "-": [[61, "id4"]], "/": [[61, "id5"]], "1. Format Your Code": [[48, "format-your-code"]], "1. Install Comet": [[70, "install-comet"], [82, "install-comet"]], "1. Native Operators (nativeExecs map)": [[31, "native-operators-nativeexecs-map"]], "2. Build and Verify": [[48, "build-and-verify"]], "2. Clone Iceberg and Apply Diff": [[70, "clone-iceberg-and-apply- [...]
\ No newline at end of file
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datafusion.apache.org
For additional commands, e-mail: commits-help@datafusion.apache.org