You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@datafusion.apache.org by gi...@apache.org on 2026/06/29 18:19:52 UTC
(datafusion) branch asf-site updated: Publish built docs triggered by 01bf68cdc46ffbf4c226e760b0ba8a63fdb89a6b
This is an automated email from the ASF dual-hosted git repository.
github-actions[bot] pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/datafusion.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 1bffda41bd Publish built docs triggered by 01bf68cdc46ffbf4c226e760b0ba8a63fdb89a6b
1bffda41bd is described below
commit 1bffda41bd4fd61a36d099cc42d05acde2c444f1
Author: github-actions[bot] <gi...@users.noreply.github.com>
AuthorDate: Mon Jun 29 18:19:47 2026 +0000
Publish built docs triggered by 01bf68cdc46ffbf4c226e760b0ba8a63fdb89a6b
---
.../library-user-guide/upgrading/55.0.0.md.txt | 29 ++++++++++++++++++++++
library-user-guide/upgrading/55.0.0.html | 19 ++++++++++++++
searchindex.js | 2 +-
3 files changed, 49 insertions(+), 1 deletion(-)
diff --git a/_sources/library-user-guide/upgrading/55.0.0.md.txt b/_sources/library-user-guide/upgrading/55.0.0.md.txt
index d0778a3619..307de722bd 100644
--- a/_sources/library-user-guide/upgrading/55.0.0.md.txt
+++ b/_sources/library-user-guide/upgrading/55.0.0.md.txt
@@ -25,6 +25,35 @@
in this section pertains to features and changes that have already been merged
to the main branch and are awaiting release in this version.
+### User `SpillFile` traits instead of [`RefCountedTempFile`]
+
+Spill file APIs now use the `datafusion_execution::SpillFile` trait instead of
+the concrete [`RefCountedTempFile`] type. [`DiskManager::create_tmp_file`] now
+returns `Arc<dyn SpillFile>`.
+This change was introduced in [PR #21882], which adds pluggable spill file
+backends via `SpillFile` and `TempFileFactory`.
+
+If your code matched on [`DiskManagerMode`], add a `DiskManagerMode::Custom(_)`
+arm.
+
+If your code wrote directly to a [`RefCountedTempFile`] or called
+[`RefCountedTempFile::update_disk_usage`], open a spill writer instead:
+
+```diff
+- temp_file.inner().as_file().write_all(bytes)?;
+- temp_file.update_disk_usage()?;
++ temp_file.open_writer()?.write_all(bytes)?;
+```
+
+Use `temp_file.size()` instead of [`RefCountedTempFile::current_disk_usage`].
+
+[`diskmanager::create_tmp_file`]: https://docs.rs/datafusion-execution/latest/datafusion_execution/disk_manager/struct.DiskManager.html#method.create_tmp_file
+[`diskmanagermode`]: https://docs.rs/datafusion-execution/latest/datafusion_execution/disk_manager/enum.DiskManagerMode.html
+[`pr #21882`]: https://github.com/apache/datafusion/pull/21882
+[`refcountedtempfile`]: https://docs.rs/datafusion-execution/latest/datafusion_execution/disk_manager/struct.RefCountedTempFile.html
+[`refcountedtempfile::current_disk_usage`]: https://docs.rs/datafusion-execution/latest/datafusion_execution/disk_manager/struct.RefCountedTempFile.html#method.current_disk_usage
+[`refcountedtempfile::update_disk_usage`]: https://docs.rs/datafusion-execution/latest/datafusion_execution/disk_manager/struct.RefCountedTempFile.html#method.update_disk_usage
+
### `Dialect::AVAILABLE` replaced by `Dialect::available()`
`datafusion_common::config::Dialect::AVAILABLE` has been removed. Use
diff --git a/library-user-guide/upgrading/55.0.0.html b/library-user-guide/upgrading/55.0.0.html
index 8fae1b1b4d..1764c051d0 100644
--- a/library-user-guide/upgrading/55.0.0.html
+++ b/library-user-guide/upgrading/55.0.0.html
@@ -451,6 +451,24 @@
<p><strong>Note:</strong> DataFusion <code class="docutils literal notranslate"><span class="pre">55.0.0</span></code> has not been released yet. The information provided
in this section pertains to features and changes that have already been merged
to the main branch and are awaiting release in this version.</p>
+<section id="user-spillfile-traits-instead-of-refcountedtempfile">
+<h3>User <code class="docutils literal notranslate"><span class="pre">SpillFile</span></code> traits instead of <a class="reference external" href="https://docs.rs/datafusion-execution/latest/datafusion_execution/disk_manager/struct.RefCountedTempFile.html"><code class="docutils literal notranslate"><span class="pre">RefCountedTempFile</span></code></a><a class="headerlink" href="#user-spillfile-traits-instead-of-refcountedtempfile" title="Link to this heading">#</a></h3>
+<p>Spill file APIs now use the <code class="docutils literal notranslate"><span class="pre">datafusion_execution::SpillFile</span></code> trait instead of
+the concrete <a class="reference external" href="https://docs.rs/datafusion-execution/latest/datafusion_execution/disk_manager/struct.RefCountedTempFile.html"><code class="docutils literal notranslate"><span class="pre">RefCountedTempFile</span></code></a> type. <a class="reference external" href="https://docs.rs/datafusion-execution/latest/datafusion_execution/disk_manager/struct.DiskManager.html#method.create_tmp_file"><code class="docutils literal notranslate"><span class="pre">DiskMa [...]
+returns <code class="docutils literal notranslate"><span class="pre">Arc<dyn</span> <span class="pre">SpillFile></span></code>.
+This change was introduced in [PR #21882], which adds pluggable spill file
+backends via <code class="docutils literal notranslate"><span class="pre">SpillFile</span></code> and <code class="docutils literal notranslate"><span class="pre">TempFileFactory</span></code>.</p>
+<p>If your code matched on <a class="reference external" href="https://docs.rs/datafusion-execution/latest/datafusion_execution/disk_manager/enum.DiskManagerMode.html"><code class="docutils literal notranslate"><span class="pre">DiskManagerMode</span></code></a>, add a <code class="docutils literal notranslate"><span class="pre">DiskManagerMode::Custom(_)</span></code>
+arm.</p>
+<p>If your code wrote directly to a <a class="reference external" href="https://docs.rs/datafusion-execution/latest/datafusion_execution/disk_manager/struct.RefCountedTempFile.html"><code class="docutils literal notranslate"><span class="pre">RefCountedTempFile</span></code></a> or called
+<a class="reference external" href="https://docs.rs/datafusion-execution/latest/datafusion_execution/disk_manager/struct.RefCountedTempFile.html#method.update_disk_usage"><code class="docutils literal notranslate"><span class="pre">RefCountedTempFile::update_disk_usage</span></code></a>, open a spill writer instead:</p>
+<div class="highlight-diff notranslate"><div class="highlight"><pre><span></span><span class="gd">- temp_file.inner().as_file().write_all(bytes)?;</span>
+<span class="gd">- temp_file.update_disk_usage()?;</span>
+<span class="gi">+ temp_file.open_writer()?.write_all(bytes)?;</span>
+</pre></div>
+</div>
+<p>Use <code class="docutils literal notranslate"><span class="pre">temp_file.size()</span></code> instead of <a class="reference external" href="https://docs.rs/datafusion-execution/latest/datafusion_execution/disk_manager/struct.RefCountedTempFile.html#method.current_disk_usage"><code class="docutils literal notranslate"><span class="pre">RefCountedTempFile::current_disk_usage</span></code></a>.</p>
+</section>
<section id="dialect-available-replaced-by-dialect-available">
<h3><code class="docutils literal notranslate"><span class="pre">Dialect::AVAILABLE</span></code> replaced by <code class="docutils literal notranslate"><span class="pre">Dialect::available()</span></code><a class="headerlink" href="#dialect-available-replaced-by-dialect-available" title="Link to this heading">#</a></h3>
<p><code class="docutils literal notranslate"><span class="pre">datafusion_common::config::Dialect::AVAILABLE</span></code> has been removed. Use
@@ -864,6 +882,7 @@ type aliases:</p>
<nav id="pst-page-toc-nav" class="page-toc" aria-labelledby="pst-page-navigation-heading-2">
<ul class="pst-show_toc_level nav section-nav flex-column">
<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#datafusion-55-0-0">DataFusion 55.0.0</a><ul class="nav section-nav flex-column">
+<li class="toc-h3 nav-item toc-entry"><a class="reference internal nav-link" href="#user-spillfile-traits-instead-of-refcountedtempfile">User <code class="docutils literal notranslate"><span class="pre">SpillFile</span></code> traits instead of <code class="docutils literal notranslate"><span class="pre">RefCountedTempFile</span></code></a></li>
<li class="toc-h3 nav-item toc-entry"><a class="reference internal nav-link" href="#dialect-available-replaced-by-dialect-available"><code class="docutils literal notranslate"><span class="pre">Dialect::AVAILABLE</span></code> replaced by <code class="docutils literal notranslate"><span class="pre">Dialect::available()</span></code></a></li>
<li class="toc-h3 nav-item toc-entry"><a class="reference internal nav-link" href="#spill-record-batch-by-size-removed"><code class="docutils literal notranslate"><span class="pre">spill_record_batch_by_size</span></code> removed</a></li>
<li class="toc-h3 nav-item toc-entry"><a class="reference internal nav-link" href="#decimal-scalar-formatting-uses-human-readable-values">Decimal scalar formatting uses human-readable values</a></li>
diff --git a/searchindex.js b/searchindex.js
index d9e46dc86d..bbd1f233cc 100644
--- a/searchindex.js
+++ b/searchindex.js
@@ -1 +1 @@
-Search.setIndex({"alltitles":{"!=":[[74,"op-neq"]],"!~":[[74,"op-re-not-match"]],"!~*":[[74,"op-re-not-match-i"]],"!~~":[[74,"id19"]],"!~~*":[[74,"id20"]],"#":[[74,"op-bit-xor"]],"%":[[74,"op-modulo"]],"&":[[74,"op-bit-and"]],"(relation, name) tuples in logical fields and logical columns are unique":[[15,"relation-name-tuples-in-logical-fields-and-logical-columns-are-unique"]],"*":[[74,"op-multiply"]],"+":[[74,"op-plus"]],"-":[[74,"op-minus"]],"/":[[74,"op-divide"]],"1. Array Literal Con [...]
\ No newline at end of file
+Search.setIndex({"alltitles":{"!=":[[74,"op-neq"]],"!~":[[74,"op-re-not-match"]],"!~*":[[74,"op-re-not-match-i"]],"!~~":[[74,"id19"]],"!~~*":[[74,"id20"]],"#":[[74,"op-bit-xor"]],"%":[[74,"op-modulo"]],"&":[[74,"op-bit-and"]],"(relation, name) tuples in logical fields and logical columns are unique":[[15,"relation-name-tuples-in-logical-fields-and-logical-columns-are-unique"]],"*":[[74,"op-multiply"]],"+":[[74,"op-plus"]],"-":[[74,"op-minus"]],"/":[[74,"op-divide"]],"1. Array Literal Con [...]
\ No newline at end of file
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datafusion.apache.org
For additional commands, e-mail: commits-help@datafusion.apache.org