You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@datafusion.apache.org by gi...@apache.org on 2026/09/24 19:32:52 UTC
(datafusion) branch asf-site updated: Publish built docs triggered by b4f813b14fca7ab556c119dcf23a87d473d56465
This is an automated email from the ASF dual-hosted git repository.
github-actions[bot] pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/datafusion.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 1cf9b3905a Publish built docs triggered by b4f813b14fca7ab556c119dcf23a87d473d56465
1cf9b3905a is described below
commit 1cf9b3905a638ee6b047d9c47d478a1e82999ad0
Author: github-actions[bot] <gi...@users.noreply.github.com>
AuthorDate: Thu Sep 24 19:32:45 2026 +0000
Publish built docs triggered by b4f813b14fca7ab556c119dcf23a87d473d56465
---
_sources/library-user-guide/upgrading/56.0.0.md.txt | 20 ++++++++++++++++++++
library-user-guide/upgrading/56.0.0.html | 19 +++++++++++++++++++
searchindex.js | 2 +-
3 files changed, 40 insertions(+), 1 deletion(-)
diff --git a/_sources/library-user-guide/upgrading/56.0.0.md.txt b/_sources/library-user-guide/upgrading/56.0.0.md.txt
index e11024449a..fc5e9d2f03 100644
--- a/_sources/library-user-guide/upgrading/56.0.0.md.txt
+++ b/_sources/library-user-guide/upgrading/56.0.0.md.txt
@@ -65,6 +65,26 @@ change. Use `FieldMetadata::to_hashmap` where a `HashMap` is still required.
[`metadata`]: https://docs.rs/arrow/60.0.0/arrow/datatypes/struct.Metadata.html
+### `ParquetAccessPlan::into_overall_row_selection` is deprecated
+
+`ParquetAccessPlan::into_overall_row_selection` is deprecated starting in 56.0.0.
+DataFusion now keeps selections local to each row group during Parquet scanning.
+The method remains available with its existing conversion and selection-length
+validation behavior, so direct callers continue to work but receive a deprecation
+warning.
+
+Users who attach a `ParquetAccessPlan` to a `PartitionedFile` for DataFusion to
+read need no changes.
+
+For custom readers, use `ParquetAccessPlan::into_inner()` to obtain the
+`RowGroupAccess` entries. Their positions are the original file row-group
+indexes, and each selection uses coordinates within its own row group. When
+migrating away from the deprecated method, callers must handle conversion and
+selection-length validation themselves. Parquet's push decoder and async reader
+accept `RowGroupSelection` values through `with_row_group_selections`; the
+synchronous reader still requires `with_row_groups` and an overall
+`with_row_selection`.
+
### Missing Parquet null counts are treated as unknown
DataFusion now preserves an omitted Parquet `null_count` statistic as unknown.
diff --git a/library-user-guide/upgrading/56.0.0.html b/library-user-guide/upgrading/56.0.0.html
index b33a9cf400..794e113c95 100644
--- a/library-user-guide/upgrading/56.0.0.html
+++ b/library-user-guide/upgrading/56.0.0.html
@@ -487,6 +487,24 @@ APIs now use <code class="docutils literal notranslate"><span class="pre">Metada
change. Use <code class="docutils literal notranslate"><span class="pre">FieldMetadata::to_hashmap</span></code> where a <code class="docutils literal notranslate"><span class="pre">HashMap</span></code> is still required.</p>
</section>
</section>
+<section id="parquetaccessplan-into-overall-row-selection-is-deprecated">
+<h3><code class="docutils literal notranslate"><span class="pre">ParquetAccessPlan::into_overall_row_selection</span></code> is deprecated<a class="headerlink" href="#parquetaccessplan-into-overall-row-selection-is-deprecated" title="Link to this heading">#</a></h3>
+<p><code class="docutils literal notranslate"><span class="pre">ParquetAccessPlan::into_overall_row_selection</span></code> is deprecated starting in 56.0.0.
+DataFusion now keeps selections local to each row group during Parquet scanning.
+The method remains available with its existing conversion and selection-length
+validation behavior, so direct callers continue to work but receive a deprecation
+warning.</p>
+<p>Users who attach a <code class="docutils literal notranslate"><span class="pre">ParquetAccessPlan</span></code> to a <code class="docutils literal notranslate"><span class="pre">PartitionedFile</span></code> for DataFusion to
+read need no changes.</p>
+<p>For custom readers, use <code class="docutils literal notranslate"><span class="pre">ParquetAccessPlan::into_inner()</span></code> to obtain the
+<code class="docutils literal notranslate"><span class="pre">RowGroupAccess</span></code> entries. Their positions are the original file row-group
+indexes, and each selection uses coordinates within its own row group. When
+migrating away from the deprecated method, callers must handle conversion and
+selection-length validation themselves. Parquet’s push decoder and async reader
+accept <code class="docutils literal notranslate"><span class="pre">RowGroupSelection</span></code> values through <code class="docutils literal notranslate"><span class="pre">with_row_group_selections</span></code>; the
+synchronous reader still requires <code class="docutils literal notranslate"><span class="pre">with_row_groups</span></code> and an overall
+<code class="docutils literal notranslate"><span class="pre">with_row_selection</span></code>.</p>
+</section>
<section id="missing-parquet-null-counts-are-treated-as-unknown">
<h3>Missing Parquet null counts are treated as unknown<a class="headerlink" href="#missing-parquet-null-counts-are-treated-as-unknown" title="Link to this heading">#</a></h3>
<p>DataFusion now preserves an omitted Parquet <code class="docutils literal notranslate"><span class="pre">null_count</span></code> statistic as unknown.
@@ -997,6 +1015,7 @@ expressions, which can cause resolution failure or incorrect rebinding.</p></li>
<li class="toc-h4 nav-item toc-entry"><a class="reference internal nav-link" href="#field-and-schema-metadata-now-use-arrow-s-metadata-type">Field and schema metadata now use arrow’s <code class="docutils literal notranslate"><span class="pre">Metadata</span></code> type</a></li>
</ul>
</li>
+<li class="toc-h3 nav-item toc-entry"><a class="reference internal nav-link" href="#parquetaccessplan-into-overall-row-selection-is-deprecated"><code class="docutils literal notranslate"><span class="pre">ParquetAccessPlan::into_overall_row_selection</span></code> is deprecated</a></li>
<li class="toc-h3 nav-item toc-entry"><a class="reference internal nav-link" href="#missing-parquet-null-counts-are-treated-as-unknown">Missing Parquet null counts are treated as unknown</a></li>
<li class="toc-h3 nav-item toc-entry"><a class="reference internal nav-link" href="#foreignsession-create-physical-plan-is-unsupported"><code class="docutils literal notranslate"><span class="pre">ForeignSession::create_physical_plan</span></code> is unsupported</a></li>
<li class="toc-h3 nav-item toc-entry"><a class="reference internal nav-link" href="#groupcolumn-now-requires-values-preserving"><code class="docutils literal notranslate"><span class="pre">GroupColumn</span></code> now requires <code class="docutils literal notranslate"><span class="pre">values_preserving</span></code></a></li>
diff --git a/searchindex.js b/searchindex.js
index c73ce1fbab..0bed8ba6ca 100644
--- a/searchindex.js
+++ b/searchindex.js
@@ -1 +1 @@
-Search.setIndex({"alltitles":{"!=":[[77,"op-neq"]],"!~":[[77,"op-re-not-match"]],"!~*":[[77,"op-re-not-match-i"]],"!~~":[[77,"id19"]],"!~~*":[[77,"id20"]],"#":[[77,"op-bit-xor"]],"%":[[77,"op-modulo"]],"&":[[77,"op-bit-and"]],"(relation, name) tuples in logical fields and logical columns are unique":[[16,"relation-name-tuples-in-logical-fields-and-logical-columns-are-unique"]],"*":[[77,"op-multiply"]],"+":[[77,"op-plus"]],"-":[[77,"op-minus"]],"/":[[77,"op-divide"]],"1. Array Literal Con [...]
\ No newline at end of file
+Search.setIndex({"alltitles":{"!=":[[77,"op-neq"]],"!~":[[77,"op-re-not-match"]],"!~*":[[77,"op-re-not-match-i"]],"!~~":[[77,"id19"]],"!~~*":[[77,"id20"]],"#":[[77,"op-bit-xor"]],"%":[[77,"op-modulo"]],"&":[[77,"op-bit-and"]],"(relation, name) tuples in logical fields and logical columns are unique":[[16,"relation-name-tuples-in-logical-fields-and-logical-columns-are-unique"]],"*":[[77,"op-multiply"]],"+":[[77,"op-plus"]],"-":[[77,"op-minus"]],"/":[[77,"op-divide"]],"1. Array Literal Con [...]
\ No newline at end of file
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datafusion.apache.org
For additional commands, e-mail: commits-help@datafusion.apache.org