You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@datafusion.apache.org by gi...@apache.org on 2025/10/27 14:17:52 UTC
(datafusion) branch asf-site updated: Publish built docs triggered by c6ad17cf2b604513d37c2a208b7891061419ba15
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/datafusion.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 353fedcbd0 Publish built docs triggered by c6ad17cf2b604513d37c2a208b7891061419ba15
353fedcbd0 is described below
commit 353fedcbd061177ae9fdcfb17febc6acd0ef5628
Author: github-actions[bot] <gi...@users.noreply.github.com>
AuthorDate: Mon Oct 27 14:17:47 2025 +0000
Publish built docs triggered by c6ad17cf2b604513d37c2a208b7891061419ba15
---
_sources/library-user-guide/upgrading.md.txt | 9 ++++++++
_sources/user-guide/sql/data_types.md.txt | 13 +++++++++++-
_sources/user-guide/sql/scalar_functions.md.txt | 28 +++++++++++++++++--------
library-user-guide/upgrading.html | 12 +++++++++++
searchindex.js | 2 +-
user-guide/sql/data_types.html | 11 +++++++++-
user-guide/sql/scalar_functions.html | 28 +++++++++++++++++--------
7 files changed, 82 insertions(+), 21 deletions(-)
diff --git a/_sources/library-user-guide/upgrading.md.txt b/_sources/library-user-guide/upgrading.md.txt
index 6b9cb0843c..4174fef7a6 100644
--- a/_sources/library-user-guide/upgrading.md.txt
+++ b/_sources/library-user-guide/upgrading.md.txt
@@ -25,6 +25,15 @@
You can see the current [status of the `51.0.0`release here](https://github.com/apache/datafusion/issues/17558)
+### `arrow` / `parquet` updated to 57.0.0
+
+### Upgrade to arrow `57.0.0` and parquet `57.0.0`
+
+This version of DataFusion upgrades the underlying Apache Arrow implementation
+to version `57.0.0`, including several dependent crates such as `prost`,
+`tonic`, `pyo3`, and `substrait`. . See the [release
+notes](https://github.com/apache/arrow-rs/releases/tag/57.0.0) for more details.
+
### `MSRV` updated to 1.87.0
The Minimum Supported Rust Version (MSRV) has been updated to [`1.87.0`].
diff --git a/_sources/user-guide/sql/data_types.md.txt b/_sources/user-guide/sql/data_types.md.txt
index d977a4396e..02edb6371c 100644
--- a/_sources/user-guide/sql/data_types.md.txt
+++ b/_sources/user-guide/sql/data_types.md.txt
@@ -41,7 +41,18 @@ You can cast a SQL expression to a specific Arrow type using the `arrow_cast` fu
For example, to cast the output of `now()` to a `Timestamp` with second precision:
```sql
-select arrow_cast(now(), 'Timestamp(Second, None)');
+select arrow_cast(now(), 'Timestamp(s)') as "now()";
++---------------------+
+| now() |
++---------------------+
+| 2025-10-24T20:02:45 |
++---------------------+
+```
+
+The older syntax still works as well:
+
+```sql
+select arrow_cast(now(), 'Timestamp(Second, None)') as "now()";
+---------------------+
| now() |
+---------------------+
diff --git a/_sources/user-guide/sql/scalar_functions.md.txt b/_sources/user-guide/sql/scalar_functions.md.txt
index d2e7066191..63a3eb2da8 100644
--- a/_sources/user-guide/sql/scalar_functions.md.txt
+++ b/_sources/user-guide/sql/scalar_functions.md.txt
@@ -4972,16 +4972,26 @@ arrow_cast(expression, datatype)
#### Example
```sql
-> select arrow_cast(-5, 'Int8') as a,
+> select
+ arrow_cast(-5, 'Int8') as a,
arrow_cast('foo', 'Dictionary(Int32, Utf8)') as b,
- arrow_cast('bar', 'LargeUtf8') as c,
- arrow_cast('2023-01-02T12:53:02', 'Timestamp(Microsecond, Some("+08:00"))') as d
- ;
-+----+-----+-----+---------------------------+
-| a | b | c | d |
-+----+-----+-----+---------------------------+
-| -5 | foo | bar | 2023-01-02T12:53:02+08:00 |
-+----+-----+-----+---------------------------+
+ arrow_cast('bar', 'LargeUtf8') as c;
+
++----+-----+-----+
+| a | b | c |
++----+-----+-----+
+| -5 | foo | bar |
++----+-----+-----+
+
+> select
+ arrow_cast('2023-01-02T12:53:02', 'Timestamp(µs, "+08:00")') as d,
+ arrow_cast('2023-01-02T12:53:02', 'Timestamp(µs)') as e;
+
++---------------------------+---------------------+
+| d | e |
++---------------------------+---------------------+
+| 2023-01-02T12:53:02+08:00 | 2023-01-02T12:53:02 |
++---------------------------+---------------------+
```
### `arrow_typeof`
diff --git a/library-user-guide/upgrading.html b/library-user-guide/upgrading.html
index 292c183b31..86dd54fc9a 100644
--- a/library-user-guide/upgrading.html
+++ b/library-user-guide/upgrading.html
@@ -728,6 +728,16 @@
<h2>DataFusion <code class="docutils literal notranslate"><span class="pre">51.0.0</span></code><a class="headerlink" href="#datafusion-51-0-0" title="Link to this heading">#</a></h2>
<p><strong>Note:</strong> DataFusion <code class="docutils literal notranslate"><span class="pre">51.0.0</span></code> has not been released yet. The information provided in this section pertains to features and changes that have already been merged to the main branch and are awaiting release in this version.</p>
<p>You can see the current <a class="reference external" href="https://github.com/apache/datafusion/issues/17558">status of the <code class="docutils literal notranslate"><span class="pre">51.0.0</span></code>release here</a></p>
+<section id="arrow-parquet-updated-to-57-0-0">
+<h3><code class="docutils literal notranslate"><span class="pre">arrow</span></code> / <code class="docutils literal notranslate"><span class="pre">parquet</span></code> updated to 57.0.0<a class="headerlink" href="#arrow-parquet-updated-to-57-0-0" title="Link to this heading">#</a></h3>
+</section>
+<section id="upgrade-to-arrow-57-0-0-and-parquet-57-0-0">
+<h3>Upgrade to arrow <code class="docutils literal notranslate"><span class="pre">57.0.0</span></code> and parquet <code class="docutils literal notranslate"><span class="pre">57.0.0</span></code><a class="headerlink" href="#upgrade-to-arrow-57-0-0-and-parquet-57-0-0" title="Link to this heading">#</a></h3>
+<p>This version of DataFusion upgrades the underlying Apache Arrow implementation
+to version <code class="docutils literal notranslate"><span class="pre">57.0.0</span></code>, including several dependent crates such as <code class="docutils literal notranslate"><span class="pre">prost</span></code>,
+<code class="docutils literal notranslate"><span class="pre">tonic</span></code>, <code class="docutils literal notranslate"><span class="pre">pyo3</span></code>, and <code class="docutils literal notranslate"><span class="pre">substrait</span></code>. . See the <a class="reference external" href="https://github.com/apache/arrow-rs/releases/tag/57.0.0">release
+notes</a> for more details.</p>
+</section>
<section id="msrv-updated-to-1-87-0">
<h3><code class="docutils literal notranslate"><span class="pre">MSRV</span></code> updated to 1.87.0<a class="headerlink" href="#msrv-updated-to-1-87-0" title="Link to this heading">#</a></h3>
<p>The Minimum Supported Rust Version (MSRV) has been updated to <a class="reference external" href="https://releases.rs/docs/1.87.0/"><code class="docutils literal notranslate"><span class="pre">1.87.0</span></code></a>.</p>
@@ -1754,6 +1764,8 @@ take care of constructing the <code class="docutils literal notranslate"><span c
<nav class="bd-toc-nav page-toc" aria-labelledby="pst-page-navigation-heading-2">
<ul class="visible nav section-nav flex-column">
<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#datafusion-51-0-0">DataFusion <code class="docutils literal notranslate"><span class="pre">51.0.0</span></code></a><ul class="nav section-nav flex-column">
+<li class="toc-h3 nav-item toc-entry"><a class="reference internal nav-link" href="#arrow-parquet-updated-to-57-0-0"><code class="docutils literal notranslate"><span class="pre">arrow</span></code> / <code class="docutils literal notranslate"><span class="pre">parquet</span></code> updated to 57.0.0</a></li>
+<li class="toc-h3 nav-item toc-entry"><a class="reference internal nav-link" href="#upgrade-to-arrow-57-0-0-and-parquet-57-0-0">Upgrade to arrow <code class="docutils literal notranslate"><span class="pre">57.0.0</span></code> and parquet <code class="docutils literal notranslate"><span class="pre">57.0.0</span></code></a></li>
<li class="toc-h3 nav-item toc-entry"><a class="reference internal nav-link" href="#msrv-updated-to-1-87-0"><code class="docutils literal notranslate"><span class="pre">MSRV</span></code> updated to 1.87.0</a></li>
<li class="toc-h3 nav-item toc-entry"><a class="reference internal nav-link" href="#functionregistry-exposes-two-additional-methods"><code class="docutils literal notranslate"><span class="pre">FunctionRegistry</span></code> exposes two additional methods</a></li>
<li class="toc-h3 nav-item toc-entry"><a class="reference internal nav-link" href="#datafusion-proto-use-taskcontext-rather-than-sessioncontext-in-physical-plan-serde-methods"><code class="docutils literal notranslate"><span class="pre">datafusion-proto</span></code> use <code class="docutils literal notranslate"><span class="pre">TaskContext</span></code> rather than <code class="docutils literal notranslate"><span class="pre">SessionContext</span></code> in physical plan serde methods< [...]
diff --git a/searchindex.js b/searchindex.js
index 55d60f9b15..4148eedb33 100644
--- a/searchindex.js
+++ b/searchindex.js
@@ -1 +1 @@
-Search.setIndex({"alltitles":{"!=":[[60,"op-neq"]],"!~":[[60,"op-re-not-match"]],"!~*":[[60,"op-re-not-match-i"]],"!~~":[[60,"id19"]],"!~~*":[[60,"id20"]],"#":[[60,"op-bit-xor"]],"%":[[60,"op-modulo"]],"&":[[60,"op-bit-and"]],"(relation, name) tuples in logical fields and logical columns are unique":[[13,"relation-name-tuples-in-logical-fields-and-logical-columns-are-unique"]],"*":[[60,"op-multiply"]],"+":[[60,"op-plus"]],"-":[[60,"op-minus"]],"/":[[60,"op-divide"]],"<":[[60,"op-lt"]],"< [...]
\ No newline at end of file
+Search.setIndex({"alltitles":{"!=":[[60,"op-neq"]],"!~":[[60,"op-re-not-match"]],"!~*":[[60,"op-re-not-match-i"]],"!~~":[[60,"id19"]],"!~~*":[[60,"id20"]],"#":[[60,"op-bit-xor"]],"%":[[60,"op-modulo"]],"&":[[60,"op-bit-and"]],"(relation, name) tuples in logical fields and logical columns are unique":[[13,"relation-name-tuples-in-logical-fields-and-logical-columns-are-unique"]],"*":[[60,"op-multiply"]],"+":[[60,"op-plus"]],"-":[[60,"op-minus"]],"/":[[60,"op-divide"]],"<":[[60,"op-lt"]],"< [...]
\ No newline at end of file
diff --git a/user-guide/sql/data_types.html b/user-guide/sql/data_types.html
index 4a2165bd85..243ae91e3b 100644
--- a/user-guide/sql/data_types.html
+++ b/user-guide/sql/data_types.html
@@ -744,7 +744,16 @@ the <code class="docutils literal notranslate"><span class="pre">arrow_typeof</s
</div>
<p>You can cast a SQL expression to a specific Arrow type using the <code class="docutils literal notranslate"><span class="pre">arrow_cast</span></code> function
For example, to cast the output of <code class="docutils literal notranslate"><span class="pre">now()</span></code> to a <code class="docutils literal notranslate"><span class="pre">Timestamp</span></code> with second precision:</p>
-<div class="highlight-sql notranslate"><div class="highlight"><pre><span></span><span class="k">select</span><span class="w"> </span><span class="n">arrow_cast</span><span class="p">(</span><span class="n">now</span><span class="p">(),</span><span class="w"> </span><span class="s1">'Timestamp(Second, None)'</span><span class="p">);</span>
+<div class="highlight-sql notranslate"><div class="highlight"><pre><span></span><span class="k">select</span><span class="w"> </span><span class="n">arrow_cast</span><span class="p">(</span><span class="n">now</span><span class="p">(),</span><span class="w"> </span><span class="s1">'Timestamp(s)'</span><span class="p">)</span><span class="w"> </span><span class="k">as</span><span class="w"> </span><span class="ss">"now()"</span><span class="p">;</span>
+<span class="o">+</span><span class="c1">---------------------+</span>
+<span class="o">|</span><span class="w"> </span><span class="n">now</span><span class="p">()</span><span class="w"> </span><span class="o">|</span>
+<span class="o">+</span><span class="c1">---------------------+</span>
+<span class="o">|</span><span class="w"> </span><span class="mi">2025</span><span class="o">-</span><span class="mi">10</span><span class="o">-</span><span class="mi">24</span><span class="n">T20</span><span class="p">:</span><span class="mi">02</span><span class="p">:</span><span class="mi">45</span><span class="w"> </span><span class="o">|</span>
+<span class="o">+</span><span class="c1">---------------------+</span>
+</pre></div>
+</div>
+<p>The older syntax still works as well:</p>
+<div class="highlight-sql notranslate"><div class="highlight"><pre><span></span><span class="k">select</span><span class="w"> </span><span class="n">arrow_cast</span><span class="p">(</span><span class="n">now</span><span class="p">(),</span><span class="w"> </span><span class="s1">'Timestamp(Second, None)'</span><span class="p">)</span><span class="w"> </span><span class="k">as</span><span class="w"> </span><span class="ss">"now()"</span><span class="p">;</span>
<span class="o">+</span><span class="c1">---------------------+</span>
<span class="o">|</span><span class="w"> </span><span class="n">now</span><span class="p">()</span><span class="w"> </span><span class="o">|</span>
<span class="o">+</span><span class="c1">---------------------+</span>
diff --git a/user-guide/sql/scalar_functions.html b/user-guide/sql/scalar_functions.html
index d1a55b486c..f3acfc75f2 100644
--- a/user-guide/sql/scalar_functions.html
+++ b/user-guide/sql/scalar_functions.html
@@ -5941,16 +5941,26 @@ For <code class="docutils literal notranslate"><span class="pre">make_map</span>
</section>
<section id="id353">
<h4>Example<a class="headerlink" href="#id353" title="Link to this heading">#</a></h4>
-<div class="highlight-sql notranslate"><div class="highlight"><pre><span></span><span class="o">></span><span class="w"> </span><span class="k">select</span><span class="w"> </span><span class="n">arrow_cast</span><span class="p">(</span><span class="o">-</span><span class="mi">5</span><span class="p">,</span><span class="w"> </span><span class="s1">'Int8'</span><span class="p">)</span><span class="w"> </span><span class="k">as</span><span class="w"> </span><span class="n">a</ [...]
+<div class="highlight-sql notranslate"><div class="highlight"><pre><span></span><span class="o">></span><span class="w"> </span><span class="k">select</span>
+<span class="w"> </span><span class="n">arrow_cast</span><span class="p">(</span><span class="o">-</span><span class="mi">5</span><span class="p">,</span><span class="w"> </span><span class="s1">'Int8'</span><span class="p">)</span><span class="w"> </span><span class="k">as</span><span class="w"> </span><span class="n">a</span><span class="p">,</span>
<span class="w"> </span><span class="n">arrow_cast</span><span class="p">(</span><span class="s1">'foo'</span><span class="p">,</span><span class="w"> </span><span class="s1">'Dictionary(Int32, Utf8)'</span><span class="p">)</span><span class="w"> </span><span class="k">as</span><span class="w"> </span><span class="n">b</span><span class="p">,</span>
-<span class="w"> </span><span class="n">arrow_cast</span><span class="p">(</span><span class="s1">'bar'</span><span class="p">,</span><span class="w"> </span><span class="s1">'LargeUtf8'</span><span class="p">)</span><span class="w"> </span><span class="k">as</span><span class="w"> </span><span class="k">c</span><span class="p">,</span>
-<span class="w"> </span><span class="n">arrow_cast</span><span class="p">(</span><span class="s1">'2023-01-02T12:53:02'</span><span class="p">,</span><span class="w"> </span><span class="s1">'Timestamp(Microsecond, Some("+08:00"))'</span><span class="p">)</span><span class="w"> </span><span class="k">as</span><span class="w"> </span><span class="n">d</span>
-<span class="w"> </span><span class="p">;</span>
-<span class="o">+</span><span class="c1">----+-----+-----+---------------------------+</span>
-<span class="o">|</span><span class="w"> </span><span class="n">a</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">b</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="k">c</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">d</span><span class="w"> </span><span class="o">|</span>
-<span class="o">+</span><span class="c1">----+-----+-----+---------------------------+</span>
-<span class="o">|</span><span class="w"> </span><span class="o">-</span><span class="mi">5</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">foo</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">bar</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="mi">2023</span><span class="o">-</span><span class="mi">01</span><span class="o">-</span><span class="mi">02</span [...]
-<span class="o">+</span><span class="c1">----+-----+-----+---------------------------+</span>
+<span class="w"> </span><span class="n">arrow_cast</span><span class="p">(</span><span class="s1">'bar'</span><span class="p">,</span><span class="w"> </span><span class="s1">'LargeUtf8'</span><span class="p">)</span><span class="w"> </span><span class="k">as</span><span class="w"> </span><span class="k">c</span><span class="p">;</span>
+
+<span class="o">+</span><span class="c1">----+-----+-----+</span>
+<span class="o">|</span><span class="w"> </span><span class="n">a</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">b</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="k">c</span><span class="w"> </span><span class="o">|</span>
+<span class="o">+</span><span class="c1">----+-----+-----+</span>
+<span class="o">|</span><span class="w"> </span><span class="o">-</span><span class="mi">5</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">foo</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">bar</span><span class="w"> </span><span class="o">|</span>
+<span class="o">+</span><span class="c1">----+-----+-----+</span>
+
+<span class="o">></span><span class="w"> </span><span class="k">select</span>
+<span class="w"> </span><span class="n">arrow_cast</span><span class="p">(</span><span class="s1">'2023-01-02T12:53:02'</span><span class="p">,</span><span class="w"> </span><span class="s1">'Timestamp(µs, "+08:00")'</span><span class="p">)</span><span class="w"> </span><span class="k">as</span><span class="w"> </span><span class="n">d</span><span class="p">,</span>
+<span class="w"> </span><span class="n">arrow_cast</span><span class="p">(</span><span class="s1">'2023-01-02T12:53:02'</span><span class="p">,</span><span class="w"> </span><span class="s1">'Timestamp(µs)'</span><span class="p">)</span><span class="w"> </span><span class="k">as</span><span class="w"> </span><span class="n">e</span><span class="p">;</span>
+
+<span class="o">+</span><span class="c1">---------------------------+---------------------+</span>
+<span class="o">|</span><span class="w"> </span><span class="n">d</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">e</span><span class="w"> </span><span class="o">|</span>
+<span class="o">+</span><span class="c1">---------------------------+---------------------+</span>
+<span class="o">|</span><span class="w"> </span><span class="mi">2023</span><span class="o">-</span><span class="mi">01</span><span class="o">-</span><span class="mi">02</span><span class="n">T12</span><span class="p">:</span><span class="mi">53</span><span class="p">:</span><span class="mi">02</span><span class="o">+</span><span class="mi">08</span><span class="p">:</span><span class="mi">00</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="mi">2 [...]
+<span class="o">+</span><span class="c1">---------------------------+---------------------+</span>
</pre></div>
</div>
</section>
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datafusion.apache.org
For additional commands, e-mail: commits-help@datafusion.apache.org