You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@datafusion.apache.org by gi...@apache.org on 2026/10/20 06:40:41 UTC
(datafusion-comet) branch asf-site updated: Publish built docs triggered by 99c4873d52e47bc466d740b4023e0de7be797e28
This is an automated email from the ASF dual-hosted git repository.
github-actions[bot] pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 81d1ede1e7 Publish built docs triggered by 99c4873d52e47bc466d740b4023e0de7be797e28
81d1ede1e7 is described below
commit 81d1ede1e765bf359d8c1e0d7e11d577a9de01dc
Author: github-actions[bot] <gi...@users.noreply.github.com>
AuthorDate: Tue Oct 20 06:40:34 2026 +0000
Publish built docs triggered by 99c4873d52e47bc466d740b4023e0de7be797e28
---
_images/mermaid-09341aca03757d9d3637a2eaff73472d472d0673.svg | 2 +-
_sources/contributor-guide/expression-audits/conversion_funcs.md.txt | 1 +
contributor-guide/expression-audits/conversion_funcs.html | 1 +
searchindex.js | 2 +-
4 files changed, 4 insertions(+), 2 deletions(-)
diff --git a/_images/mermaid-09341aca03757d9d3637a2eaff73472d472d0673.svg b/_images/mermaid-09341aca03757d9d3637a2eaff73472d472d0673.svg
index 6e6f75bc9d..ea49e43e4b 100644
--- a/_images/mermaid-09341aca03757d9d3637a2eaff73472d472d0673.svg
+++ b/_images/mermaid-09341aca03757d9d3637a2eaff73472d472d0673.svg
@@ -1 +1 @@
-<svg id="my-svg" width="100%" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" class="flowchart" style="max-width: 511.73px; background-color: transparent;" viewBox="0 0 511.7299499511719 1014" role="graphics-document document" aria-roledescription="flowchart-v2"><style>#my-svg{font-family:"trebuchet ms",verdana,arial,sans-serif;font-size:16px;fill:#333;}@keyframes edge-animation-frame{from{stroke-dashoffset:0;}}@keyframes dash{to{stroke-dashoffset:0;}}#my-sv [...]
\ No newline at end of file
+<svg id="my-svg" width="100%" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" class="flowchart" style="max-width: 511.73px; background-color: transparent;" viewBox="0 0 511.7299499511719 1014" role="graphics-document document" aria-roledescription="flowchart-v2"><style>#my-svg{font-family:"trebuchet ms",verdana,arial,sans-serif;font-size:16px;fill:#333;}@keyframes edge-animation-frame{from{stroke-dashoffset:0;}}@keyframes dash{to{stroke-dashoffset:0;}}#my-sv [...]
\ No newline at end of file
diff --git a/_sources/contributor-guide/expression-audits/conversion_funcs.md.txt b/_sources/contributor-guide/expression-audits/conversion_funcs.md.txt
index 0b52c96d01..c5e2f1369f 100644
--- a/_sources/contributor-guide/expression-audits/conversion_funcs.md.txt
+++ b/_sources/contributor-guide/expression-audits/conversion_funcs.md.txt
@@ -39,5 +39,6 @@
- Performance (tuned 2026-07-15, PR [#4940](https://github.com/apache/datafusion-comet/pull/4940)): float/double-to-decimal casts (`cast_floating_point_to_decimal128`) now convert in a single vectorized `unary_opt` pass that maps out-of-range values (NaN, infinity, precision overflow) to null, replacing the per-element `Decimal128Builder` loop. ANSI raises via an O(1) null-count check plus a rare element-wise rescan. 15-36% faster with no regression on any shape. Benchmark: `benches/cast [...]
- Performance (tuned 2026-07-15, PR [#4939](https://github.com/apache/datafusion-comet/pull/4939)): integer-to-decimal casts (`cast_int_to_decimal128_internal`) now convert in a single vectorized `unary_opt` pass that maps overflowing values to null, replacing the per-element `Decimal128Builder` loop. ANSI raises via an O(1) null-count check plus a rare element-wise rescan. 28-50% faster with no regression on any shape. Benchmark: `benches/cast_int_to_decimal.rs`.
- Performance (tuned 2026-09-30, PR [#5130](https://github.com/apache/datafusion-comet/pull/5130)): string-to-timestamp and string-to-timestamp_ntz (`timestamp_parser` / `timestamp_ntz_parser`) classify the input shape once with a single byte scan, replacing up to 34 sequential regex `is_match` calls per row (27 for the NTZ variant). The shapes only accept ASCII digits, so the cast no longer runs a regex at all. 40-86% faster (1.7x-6.9x, median 3.0x) across all 118 benchmark cases, none [...]
+- Performance (tuned 2026-10-14, PR [#6969](https://github.com/apache/datafusion-comet/pull/6969)): casts to timestamp from int, decimal, float, and boolean (`cast_int_to_timestamp`, `cast_decimal_to_timestamp`, `cast_float_to_timestamp`, `cast_boolean_to_timestamp`) use Arrow `unary` / `try_unary` / `unary_opt` / `from_unary` instead of a per-row `TimestampMicrosecondBuilder`. Integer casts are about 9-12x faster and boolean casts about 5-7x. Float casts are 14-35% faster with few nulls [...]
[Spark Expression Support]: ../../user-guide/latest/expressions.md
diff --git a/contributor-guide/expression-audits/conversion_funcs.html b/contributor-guide/expression-audits/conversion_funcs.html
index cb589d0f22..eda9f5e83e 100644
--- a/contributor-guide/expression-audits/conversion_funcs.html
+++ b/contributor-guide/expression-audits/conversion_funcs.html
@@ -585,6 +585,7 @@ under the License.
<li><p>Performance (tuned 2026-07-15, PR <a class="reference external" href="https://github.com/apache/datafusion-comet/pull/4940">#4940</a>): float/double-to-decimal casts (<code class="docutils literal notranslate"><span class="pre">cast_floating_point_to_decimal128</span></code>) now convert in a single vectorized <code class="docutils literal notranslate"><span class="pre">unary_opt</span></code> pass that maps out-of-range values (NaN, infinity, precision overflow) to null, replacin [...]
<li><p>Performance (tuned 2026-07-15, PR <a class="reference external" href="https://github.com/apache/datafusion-comet/pull/4939">#4939</a>): integer-to-decimal casts (<code class="docutils literal notranslate"><span class="pre">cast_int_to_decimal128_internal</span></code>) now convert in a single vectorized <code class="docutils literal notranslate"><span class="pre">unary_opt</span></code> pass that maps overflowing values to null, replacing the per-element <code class="docutils lite [...]
<li><p>Performance (tuned 2026-09-30, PR <a class="reference external" href="https://github.com/apache/datafusion-comet/pull/5130">#5130</a>): string-to-timestamp and string-to-timestamp_ntz (<code class="docutils literal notranslate"><span class="pre">timestamp_parser</span></code> / <code class="docutils literal notranslate"><span class="pre">timestamp_ntz_parser</span></code>) classify the input shape once with a single byte scan, replacing up to 34 sequential regex <code class="docut [...]
+<li><p>Performance (tuned 2026-10-14, PR <a class="reference external" href="https://github.com/apache/datafusion-comet/pull/6969">#6969</a>): casts to timestamp from int, decimal, float, and boolean (<code class="docutils literal notranslate"><span class="pre">cast_int_to_timestamp</span></code>, <code class="docutils literal notranslate"><span class="pre">cast_decimal_to_timestamp</span></code>, <code class="docutils literal notranslate"><span class="pre">cast_float_to_timestamp</span> [...]
</ul>
</section>
</section>
diff --git a/searchindex.js b/searchindex.js
index a2247532aa..ab8f14d7a7 100644
--- a/searchindex.js
+++ b/searchindex.js
@@ -1 +1 @@
-Search.setIndex({"alltitles": {"!": [[63, "id1"]], "%": [[61, "id1"]], "&": [[51, "id1"]], "*": [[61, "id2"]], "+": [[61, "id3"]], "-": [[61, "id4"]], "/": [[61, "id5"]], "1. Format Your Code": [[48, "format-your-code"]], "1. Install Comet": [[70, "install-comet"], [82, "install-comet"]], "1. Native Operators (nativeExecs map)": [[31, "native-operators-nativeexecs-map"]], "2. Build and Verify": [[48, "build-and-verify"]], "2. Clone Iceberg and Apply Diff": [[70, "clone-iceberg-and-apply- [...]
\ No newline at end of file
+Search.setIndex({"alltitles": {"!": [[63, "id1"]], "%": [[61, "id1"]], "&": [[51, "id1"]], "*": [[61, "id2"]], "+": [[61, "id3"]], "-": [[61, "id4"]], "/": [[61, "id5"]], "1. Format Your Code": [[48, "format-your-code"]], "1. Install Comet": [[70, "install-comet"], [82, "install-comet"]], "1. Native Operators (nativeExecs map)": [[31, "native-operators-nativeexecs-map"]], "2. Build and Verify": [[48, "build-and-verify"]], "2. Clone Iceberg and Apply Diff": [[70, "clone-iceberg-and-apply- [...]
\ No newline at end of file
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datafusion.apache.org
For additional commands, e-mail: commits-help@datafusion.apache.org