You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@datafusion.apache.org by gi...@apache.org on 2026/08/23 23:02:08 UTC
(datafusion-comet) 01/01: Publish built docs triggered by e0ab0a6fe60c05bd679654f0201ebe88319cc3a7
This is an automated email from the ASF dual-hosted git repository.
github-actions[bot] pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git
commit bb240c2c66ec2c6e9d8c9b0c96637392cc93e2a9
Author: github-actions[bot] <gi...@users.noreply.github.com>
AuthorDate: Sun Aug 23 23:02:00 2026 +0000
Publish built docs triggered by e0ab0a6fe60c05bd679654f0201ebe88319cc3a7
---
_sources/contributor-guide/expression-audits/math_funcs.md.txt | 4 +---
.../latest/compatibility/expressions/spark-3.4/datetime.md.txt | 6 ------
.../latest/compatibility/expressions/spark-3.5/datetime.md.txt | 6 ------
.../latest/compatibility/expressions/spark-4.0/datetime.md.txt | 6 ------
.../latest/compatibility/expressions/spark-4.1/datetime.md.txt | 6 ------
contributor-guide/expression-audits/math_funcs.html | 5 +----
searchindex.js | 2 +-
.../latest/compatibility/expressions/spark-3.4/datetime.html | 8 --------
.../latest/compatibility/expressions/spark-3.5/datetime.html | 8 --------
.../latest/compatibility/expressions/spark-4.0/datetime.html | 8 --------
.../latest/compatibility/expressions/spark-4.1/datetime.html | 8 --------
11 files changed, 3 insertions(+), 64 deletions(-)
diff --git a/_sources/contributor-guide/expression-audits/math_funcs.md.txt b/_sources/contributor-guide/expression-audits/math_funcs.md.txt
index 87bfa27cb8..6a9d786851 100644
--- a/_sources/contributor-guide/expression-audits/math_funcs.md.txt
+++ b/_sources/contributor-guide/expression-audits/math_funcs.md.txt
@@ -121,9 +121,7 @@ Internal decimal wrapper emitted around every decimal `+ - * /`, `sum`, and `avg
## DecimalRescaleCheckOverflow (internal)
-Internal fused expression that rescales a Decimal128 value (changing scale) and checks output precision in one pass, replacing the `CheckOverflow(Cast(expr, Decimal128(p, s)))` pattern used by decimal-to-decimal casts. Native impl: `math_funcs/internal/decimal_rescale_check.rs`.
-
-- Performance (tuned 2026-07-15, PR [#4938](https://github.com/apache/datafusion-comet/pull/4938)): the legacy path ran `null_if_overflow_precision` (a second full pass that allocates a new array) on every batch to turn overflow sentinels into nulls, even when nothing overflowed. Now that pass runs only when a sentinel is present (`contains(&i128::MAX)`, short-circuiting), so the common no-overflow case skips the allocation. 8 to 26% faster on no-overflow shapes; overflow and ANSI shapes [...]
+Internal fused expression that replaces the `CheckOverflow(Cast(expr, Decimal128(p, s)))` pattern used by decimal-to-decimal casts. It delegates rescaling, HALF_UP rounding, and output-precision validation to Arrow's single-pass decimal cast kernel. Arrow writes nulls directly in legacy mode and returns an error in ANSI mode. Native impl: `math_funcs/internal/decimal_rescale_check.rs`; benchmark: `benches/decimal_rescale.rs`.
## e
diff --git a/_sources/user-guide/latest/compatibility/expressions/spark-3.4/datetime.md.txt b/_sources/user-guide/latest/compatibility/expressions/spark-3.4/datetime.md.txt
index 103cdbb330..7cf2b36f5a 100644
--- a/_sources/user-guide/latest/compatibility/expressions/spark-3.4/datetime.md.txt
+++ b/_sources/user-guide/latest/compatibility/expressions/spark-3.4/datetime.md.txt
@@ -88,12 +88,6 @@ The following cases are not supported by Comet and always fall back to Spark, re
- Only `TimestampType` and `TimestampNTZType` inputs are supported.
-## MakeDate
-
-The following differences from Spark are always present and do not require any additional configuration:
-
-- Native `make_date` is limited to chrono's year range `[-262143, 262142]`; Spark accepts wider years (for example, `300000`), so Comet returns `NULL` or throws under ANSI mode for dates Spark accepts, and may incorrectly report valid dates as invalid (for example, `300000-02-29` is falsely reported as not a leap year) ([#5208](https://github.com/apache/datafusion-comet/issues/5208)).
-
## MakeInterval
The following differences from Spark are always present and do not require any additional configuration:
diff --git a/_sources/user-guide/latest/compatibility/expressions/spark-3.5/datetime.md.txt b/_sources/user-guide/latest/compatibility/expressions/spark-3.5/datetime.md.txt
index 103cdbb330..7cf2b36f5a 100644
--- a/_sources/user-guide/latest/compatibility/expressions/spark-3.5/datetime.md.txt
+++ b/_sources/user-guide/latest/compatibility/expressions/spark-3.5/datetime.md.txt
@@ -88,12 +88,6 @@ The following cases are not supported by Comet and always fall back to Spark, re
- Only `TimestampType` and `TimestampNTZType` inputs are supported.
-## MakeDate
-
-The following differences from Spark are always present and do not require any additional configuration:
-
-- Native `make_date` is limited to chrono's year range `[-262143, 262142]`; Spark accepts wider years (for example, `300000`), so Comet returns `NULL` or throws under ANSI mode for dates Spark accepts, and may incorrectly report valid dates as invalid (for example, `300000-02-29` is falsely reported as not a leap year) ([#5208](https://github.com/apache/datafusion-comet/issues/5208)).
-
## MakeInterval
The following differences from Spark are always present and do not require any additional configuration:
diff --git a/_sources/user-guide/latest/compatibility/expressions/spark-4.0/datetime.md.txt b/_sources/user-guide/latest/compatibility/expressions/spark-4.0/datetime.md.txt
index a51bd0cef3..e29f3837b6 100644
--- a/_sources/user-guide/latest/compatibility/expressions/spark-4.0/datetime.md.txt
+++ b/_sources/user-guide/latest/compatibility/expressions/spark-4.0/datetime.md.txt
@@ -90,12 +90,6 @@ The following cases are not supported by Comet and always fall back to Spark, re
- Only `TimestampType` and `TimestampNTZType` inputs are supported.
-## MakeDate
-
-The following differences from Spark are always present and do not require any additional configuration:
-
-- Native `make_date` is limited to chrono's year range `[-262143, 262142]`; Spark accepts wider years (for example, `300000`), so Comet returns `NULL` or throws under ANSI mode for dates Spark accepts, and may incorrectly report valid dates as invalid (for example, `300000-02-29` is falsely reported as not a leap year) ([#5208](https://github.com/apache/datafusion-comet/issues/5208)).
-
## MakeInterval
The following differences from Spark are always present and do not require any additional configuration:
diff --git a/_sources/user-guide/latest/compatibility/expressions/spark-4.1/datetime.md.txt b/_sources/user-guide/latest/compatibility/expressions/spark-4.1/datetime.md.txt
index a51bd0cef3..e29f3837b6 100644
--- a/_sources/user-guide/latest/compatibility/expressions/spark-4.1/datetime.md.txt
+++ b/_sources/user-guide/latest/compatibility/expressions/spark-4.1/datetime.md.txt
@@ -90,12 +90,6 @@ The following cases are not supported by Comet and always fall back to Spark, re
- Only `TimestampType` and `TimestampNTZType` inputs are supported.
-## MakeDate
-
-The following differences from Spark are always present and do not require any additional configuration:
-
-- Native `make_date` is limited to chrono's year range `[-262143, 262142]`; Spark accepts wider years (for example, `300000`), so Comet returns `NULL` or throws under ANSI mode for dates Spark accepts, and may incorrectly report valid dates as invalid (for example, `300000-02-29` is falsely reported as not a leap year) ([#5208](https://github.com/apache/datafusion-comet/issues/5208)).
-
## MakeInterval
The following differences from Spark are always present and do not require any additional configuration:
diff --git a/contributor-guide/expression-audits/math_funcs.html b/contributor-guide/expression-audits/math_funcs.html
index 44ddfd594e..328a66869b 100644
--- a/contributor-guide/expression-audits/math_funcs.html
+++ b/contributor-guide/expression-audits/math_funcs.html
@@ -699,10 +699,7 @@ under the License.
</section>
<section id="decimalrescalecheckoverflow-internal">
<h2>DecimalRescaleCheckOverflow (internal)<a class="headerlink" href="#decimalrescalecheckoverflow-internal" title="Link to this heading">#</a></h2>
-<p>Internal fused expression that rescales a Decimal128 value (changing scale) and checks output precision in one pass, replacing the <code class="docutils literal notranslate"><span class="pre">CheckOverflow(Cast(expr,</span> <span class="pre">Decimal128(p,</span> <span class="pre">s)))</span></code> pattern used by decimal-to-decimal casts. Native impl: <code class="docutils literal notranslate"><span class="pre">math_funcs/internal/decimal_rescale_check.rs</span></code>.</p>
-<ul class="simple">
-<li><p>Performance (tuned 2026-07-15, PR <a class="reference external" href="https://github.com/apache/datafusion-comet/pull/4938">#4938</a>): the legacy path ran <code class="docutils literal notranslate"><span class="pre">null_if_overflow_precision</span></code> (a second full pass that allocates a new array) on every batch to turn overflow sentinels into nulls, even when nothing overflowed. Now that pass runs only when a sentinel is present (<code class="docutils literal notranslate"> [...]
-</ul>
+<p>Internal fused expression that replaces the <code class="docutils literal notranslate"><span class="pre">CheckOverflow(Cast(expr,</span> <span class="pre">Decimal128(p,</span> <span class="pre">s)))</span></code> pattern used by decimal-to-decimal casts. It delegates rescaling, HALF_UP rounding, and output-precision validation to Arrow’s single-pass decimal cast kernel. Arrow writes nulls directly in legacy mode and returns an error in ANSI mode. Native impl: <code class="docutils lit [...]
</section>
<section id="e">
<h2>e<a class="headerlink" href="#e" title="Link to this heading">#</a></h2>
diff --git a/searchindex.js b/searchindex.js
index dead142604..71e3ea6db1 100644
--- a/searchindex.js
+++ b/searchindex.js
@@ -1 +1 @@
-Search.setIndex({"alltitles": {"!": [[55, "id1"]], "%": [[53, "id1"]], "&": [[43, "id1"]], "*": [[53, "id2"]], "+": [[53, "id3"]], "-": [[53, "id4"]], "/": [[53, "id5"]], "1. Format Your Code": [[40, "format-your-code"]], "1. Install Comet": [[61, "install-comet"], [71, "install-comet"]], "1. Native Operators (nativeExecs map)": [[28, "native-operators-nativeexecs-map"]], "2. Build and Verify": [[40, "build-and-verify"]], "2. Clone Iceberg and Apply Diff": [[61, "clone-iceberg-and-apply- [...]
\ No newline at end of file
+Search.setIndex({"alltitles": {"!": [[55, "id1"]], "%": [[53, "id1"]], "&": [[43, "id1"]], "*": [[53, "id2"]], "+": [[53, "id3"]], "-": [[53, "id4"]], "/": [[53, "id5"]], "1. Format Your Code": [[40, "format-your-code"]], "1. Install Comet": [[61, "install-comet"], [71, "install-comet"]], "1. Native Operators (nativeExecs map)": [[28, "native-operators-nativeexecs-map"]], "2. Build and Verify": [[40, "build-and-verify"]], "2. Clone Iceberg and Apply Diff": [[61, "clone-iceberg-and-apply- [...]
\ No newline at end of file
diff --git a/user-guide/latest/compatibility/expressions/spark-3.4/datetime.html b/user-guide/latest/compatibility/expressions/spark-3.4/datetime.html
index 08794c67fd..3665ece74b 100644
--- a/user-guide/latest/compatibility/expressions/spark-3.4/datetime.html
+++ b/user-guide/latest/compatibility/expressions/spark-3.4/datetime.html
@@ -856,13 +856,6 @@ with Spark. For dates beyond this range, functions that involve timezone-aware c
<li><p>Only <code class="docutils literal notranslate"><span class="pre">TimestampType</span></code> and <code class="docutils literal notranslate"><span class="pre">TimestampNTZType</span></code> inputs are supported.</p></li>
</ul>
</section>
-<section id="makedate">
-<h2>MakeDate<a class="headerlink" href="#makedate" title="Link to this heading">#</a></h2>
-<p>The following differences from Spark are always present and do not require any additional configuration:</p>
-<ul class="simple">
-<li><p>Native <code class="docutils literal notranslate"><span class="pre">make_date</span></code> is limited to chrono’s year range <code class="docutils literal notranslate"><span class="pre">[-262143,</span> <span class="pre">262142]</span></code>; Spark accepts wider years (for example, <code class="docutils literal notranslate"><span class="pre">300000</span></code>), so Comet returns <code class="docutils literal notranslate"><span class="pre">NULL</span></code> or throws under ANS [...]
-</ul>
-</section>
<section id="makeinterval">
<h2>MakeInterval<a class="headerlink" href="#makeinterval" title="Link to this heading">#</a></h2>
<p>The following differences from Spark are always present and do not require any additional configuration:</p>
@@ -982,7 +975,6 @@ with Spark. For dates beyond this range, functions that involve timezone-aware c
<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#fromutctimestamp">FromUTCTimestamp</a></li>
<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#fromunixtime">FromUnixTime</a></li>
<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#hours">Hours</a></li>
-<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#makedate">MakeDate</a></li>
<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#makeinterval">MakeInterval</a></li>
<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#precisetimestampconversion">PreciseTimestampConversion</a></li>
<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#secondstotimestamp">SecondsToTimestamp</a></li>
diff --git a/user-guide/latest/compatibility/expressions/spark-3.5/datetime.html b/user-guide/latest/compatibility/expressions/spark-3.5/datetime.html
index f6cb6c5b90..073485c3d4 100644
--- a/user-guide/latest/compatibility/expressions/spark-3.5/datetime.html
+++ b/user-guide/latest/compatibility/expressions/spark-3.5/datetime.html
@@ -856,13 +856,6 @@ with Spark. For dates beyond this range, functions that involve timezone-aware c
<li><p>Only <code class="docutils literal notranslate"><span class="pre">TimestampType</span></code> and <code class="docutils literal notranslate"><span class="pre">TimestampNTZType</span></code> inputs are supported.</p></li>
</ul>
</section>
-<section id="makedate">
-<h2>MakeDate<a class="headerlink" href="#makedate" title="Link to this heading">#</a></h2>
-<p>The following differences from Spark are always present and do not require any additional configuration:</p>
-<ul class="simple">
-<li><p>Native <code class="docutils literal notranslate"><span class="pre">make_date</span></code> is limited to chrono’s year range <code class="docutils literal notranslate"><span class="pre">[-262143,</span> <span class="pre">262142]</span></code>; Spark accepts wider years (for example, <code class="docutils literal notranslate"><span class="pre">300000</span></code>), so Comet returns <code class="docutils literal notranslate"><span class="pre">NULL</span></code> or throws under ANS [...]
-</ul>
-</section>
<section id="makeinterval">
<h2>MakeInterval<a class="headerlink" href="#makeinterval" title="Link to this heading">#</a></h2>
<p>The following differences from Spark are always present and do not require any additional configuration:</p>
@@ -982,7 +975,6 @@ with Spark. For dates beyond this range, functions that involve timezone-aware c
<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#fromutctimestamp">FromUTCTimestamp</a></li>
<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#fromunixtime">FromUnixTime</a></li>
<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#hours">Hours</a></li>
-<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#makedate">MakeDate</a></li>
<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#makeinterval">MakeInterval</a></li>
<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#precisetimestampconversion">PreciseTimestampConversion</a></li>
<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#secondstotimestamp">SecondsToTimestamp</a></li>
diff --git a/user-guide/latest/compatibility/expressions/spark-4.0/datetime.html b/user-guide/latest/compatibility/expressions/spark-4.0/datetime.html
index 7ad0bce21e..cf03ea80b0 100644
--- a/user-guide/latest/compatibility/expressions/spark-4.0/datetime.html
+++ b/user-guide/latest/compatibility/expressions/spark-4.0/datetime.html
@@ -858,13 +858,6 @@ with Spark. For dates beyond this range, functions that involve timezone-aware c
<li><p>Only <code class="docutils literal notranslate"><span class="pre">TimestampType</span></code> and <code class="docutils literal notranslate"><span class="pre">TimestampNTZType</span></code> inputs are supported.</p></li>
</ul>
</section>
-<section id="makedate">
-<h2>MakeDate<a class="headerlink" href="#makedate" title="Link to this heading">#</a></h2>
-<p>The following differences from Spark are always present and do not require any additional configuration:</p>
-<ul class="simple">
-<li><p>Native <code class="docutils literal notranslate"><span class="pre">make_date</span></code> is limited to chrono’s year range <code class="docutils literal notranslate"><span class="pre">[-262143,</span> <span class="pre">262142]</span></code>; Spark accepts wider years (for example, <code class="docutils literal notranslate"><span class="pre">300000</span></code>), so Comet returns <code class="docutils literal notranslate"><span class="pre">NULL</span></code> or throws under ANS [...]
-</ul>
-</section>
<section id="makeinterval">
<h2>MakeInterval<a class="headerlink" href="#makeinterval" title="Link to this heading">#</a></h2>
<p>The following differences from Spark are always present and do not require any additional configuration:</p>
@@ -1011,7 +1004,6 @@ with Spark. For dates beyond this range, functions that involve timezone-aware c
<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#fromutctimestamp">FromUTCTimestamp</a></li>
<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#fromunixtime">FromUnixTime</a></li>
<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#hours">Hours</a></li>
-<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#makedate">MakeDate</a></li>
<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#makeinterval">MakeInterval</a></li>
<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#maketimestamp">MakeTimestamp</a></li>
<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#nextday">NextDay</a></li>
diff --git a/user-guide/latest/compatibility/expressions/spark-4.1/datetime.html b/user-guide/latest/compatibility/expressions/spark-4.1/datetime.html
index 4200897b69..a0f4b2816b 100644
--- a/user-guide/latest/compatibility/expressions/spark-4.1/datetime.html
+++ b/user-guide/latest/compatibility/expressions/spark-4.1/datetime.html
@@ -858,13 +858,6 @@ with Spark. For dates beyond this range, functions that involve timezone-aware c
<li><p>Only <code class="docutils literal notranslate"><span class="pre">TimestampType</span></code> and <code class="docutils literal notranslate"><span class="pre">TimestampNTZType</span></code> inputs are supported.</p></li>
</ul>
</section>
-<section id="makedate">
-<h2>MakeDate<a class="headerlink" href="#makedate" title="Link to this heading">#</a></h2>
-<p>The following differences from Spark are always present and do not require any additional configuration:</p>
-<ul class="simple">
-<li><p>Native <code class="docutils literal notranslate"><span class="pre">make_date</span></code> is limited to chrono’s year range <code class="docutils literal notranslate"><span class="pre">[-262143,</span> <span class="pre">262142]</span></code>; Spark accepts wider years (for example, <code class="docutils literal notranslate"><span class="pre">300000</span></code>), so Comet returns <code class="docutils literal notranslate"><span class="pre">NULL</span></code> or throws under ANS [...]
-</ul>
-</section>
<section id="makeinterval">
<h2>MakeInterval<a class="headerlink" href="#makeinterval" title="Link to this heading">#</a></h2>
<p>The following differences from Spark are always present and do not require any additional configuration:</p>
@@ -1011,7 +1004,6 @@ with Spark. For dates beyond this range, functions that involve timezone-aware c
<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#fromutctimestamp">FromUTCTimestamp</a></li>
<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#fromunixtime">FromUnixTime</a></li>
<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#hours">Hours</a></li>
-<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#makedate">MakeDate</a></li>
<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#makeinterval">MakeInterval</a></li>
<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#maketimestamp">MakeTimestamp</a></li>
<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#nextday">NextDay</a></li>
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datafusion.apache.org
For additional commands, e-mail: commits-help@datafusion.apache.org