You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@datafusion.apache.org by gi...@apache.org on 2026/09/03 23:21:48 UTC
(datafusion-comet) branch asf-site updated: Publish built docs triggered by a089669dd899c2c84a2f2781b1aca43af3f490bc
This is an automated email from the ASF dual-hosted git repository.
github-actions[bot] pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 383822f483 Publish built docs triggered by a089669dd899c2c84a2f2781b1aca43af3f490bc
383822f483 is described below
commit 383822f483949386ef9915a384d37009c661c3d6
Author: github-actions[bot] <gi...@users.noreply.github.com>
AuthorDate: Thu Sep 3 23:21:44 2026 +0000
Publish built docs triggered by a089669dd899c2c84a2f2781b1aca43af3f490bc
---
_sources/user-guide/latest/iceberg-writes.md.txt | 11 +----------
searchindex.js | 2 +-
user-guide/latest/iceberg-writes.html | 14 +-------------
3 files changed, 3 insertions(+), 24 deletions(-)
diff --git a/_sources/user-guide/latest/iceberg-writes.md.txt b/_sources/user-guide/latest/iceberg-writes.md.txt
index db4f82c8ed..e9227dea8b 100644
--- a/_sources/user-guide/latest/iceberg-writes.md.txt
+++ b/_sources/user-guide/latest/iceberg-writes.md.txt
@@ -156,7 +156,7 @@ A write is eligible only when ALL of the following hold:
| `write.spark.fanout.enabled` | any value (the native writer implements both clustered and fanout modes) [...]
| `write.target-file-size-bytes` | any value (file rolling cadence differs; see accepted divergences) [...]
| data location URI scheme | `file`, `memory`, `s3`, `s3a`, `gs` [...]
-| partition spec | any (but see partition paths under accepted divergences) [...]
+| partition spec | any [...]
| column types | any except `uuid` (Spark plans it as a string; no Arrow cast reaches `fixed(16)`) [...]
Within the namespaces that shape data-file bytes — `write.parquet.*` and `parquet.*` —
@@ -280,14 +280,5 @@ iceberg-java's _writer-tracked_ state would have recorded, and both are analyzed
the same amount, so the derived null ratios and `IS NULL` / `IS NOT NULL` pruning decisions
are unaffected.
-### Operational caveat
-
-- Partition paths are not URL-escaped: iceberg-java percent-encodes partition directory names
- and values (`region=a%2Fb`), iceberg-rust writes them raw (`region=a/b`). Readers resolve
- files through manifest metadata, not paths, so query results are unaffected — but the
- directory layout differs from iceberg-java's, and partition values containing characters
- that are invalid in a URI (`:`, `#`, newline) may produce paths that `HadoopFileIO`-based
- readers cannot open.
-
All content not listed above — the logical data, encodings for non-FLBA columns, statistics
values, and manifest metadata — must match iceberg-java exactly, or the write falls back.
diff --git a/searchindex.js b/searchindex.js
index a5662fa5f6..e756b3c505 100644
--- a/searchindex.js
+++ b/searchindex.js
@@ -1 +1 @@
-Search.setIndex({"alltitles": {"!": [[55, "id1"]], "%": [[53, "id1"]], "&": [[43, "id1"]], "*": [[53, "id2"]], "+": [[53, "id3"]], "-": [[53, "id4"]], "/": [[53, "id5"]], "1. Format Your Code": [[40, "format-your-code"]], "1. Install Comet": [[61, "install-comet"], [71, "install-comet"]], "1. Native Operators (nativeExecs map)": [[28, "native-operators-nativeexecs-map"]], "2. Build and Verify": [[40, "build-and-verify"]], "2. Clone Iceberg and Apply Diff": [[61, "clone-iceberg-and-apply- [...]
\ No newline at end of file
+Search.setIndex({"alltitles": {"!": [[55, "id1"]], "%": [[53, "id1"]], "&": [[43, "id1"]], "*": [[53, "id2"]], "+": [[53, "id3"]], "-": [[53, "id4"]], "/": [[53, "id5"]], "1. Format Your Code": [[40, "format-your-code"]], "1. Install Comet": [[61, "install-comet"], [71, "install-comet"]], "1. Native Operators (nativeExecs map)": [[28, "native-operators-nativeexecs-map"]], "2. Build and Verify": [[40, "build-and-verify"]], "2. Clone Iceberg and Apply Diff": [[61, "clone-iceberg-and-apply- [...]
\ No newline at end of file
diff --git a/user-guide/latest/iceberg-writes.html b/user-guide/latest/iceberg-writes.html
index a6d6c0cb30..5a52e4154a 100644
--- a/user-guide/latest/iceberg-writes.html
+++ b/user-guide/latest/iceberg-writes.html
@@ -938,7 +938,7 @@ iceberg-java resolves per-write options and <code class="docutils literal notran
<td><p><code class="docutils literal notranslate"><span class="pre">file</span></code>, <code class="docutils literal notranslate"><span class="pre">memory</span></code>, <code class="docutils literal notranslate"><span class="pre">s3</span></code>, <code class="docutils literal notranslate"><span class="pre">s3a</span></code>, <code class="docutils literal notranslate"><span class="pre">gs</span></code></p></td>
</tr>
<tr class="row-odd"><td><p>partition spec</p></td>
-<td><p>any (but see partition paths under accepted divergences)</p></td>
+<td><p>any</p></td>
</tr>
<tr class="row-even"><td><p>column types</p></td>
<td><p>any except <code class="docutils literal notranslate"><span class="pre">uuid</span></code> (Spark plans it as a string; no Arrow cast reaches <code class="docutils literal notranslate"><span class="pre">fixed(16)</span></code>)</p></td>
@@ -1061,17 +1061,6 @@ parquet footer), while iceberg-java’s writer-tracked counts do not. Both count
the same amount, so the derived null ratios and <code class="docutils literal notranslate"><span class="pre">IS</span> <span class="pre">NULL</span></code> / <code class="docutils literal notranslate"><span class="pre">IS</span> <span class="pre">NOT</span> <span class="pre">NULL</span></code> pruning decisions
are unaffected.</p></li>
</ul>
-</section>
-<section id="operational-caveat">
-<h3>Operational caveat<a class="headerlink" href="#operational-caveat" title="Link to this heading">#</a></h3>
-<ul class="simple">
-<li><p>Partition paths are not URL-escaped: iceberg-java percent-encodes partition directory names
-and values (<code class="docutils literal notranslate"><span class="pre">region=a%2Fb</span></code>), iceberg-rust writes them raw (<code class="docutils literal notranslate"><span class="pre">region=a/b</span></code>). Readers resolve
-files through manifest metadata, not paths, so query results are unaffected — but the
-directory layout differs from iceberg-java’s, and partition values containing characters
-that are invalid in a URI (<code class="docutils literal notranslate"><span class="pre">:</span></code>, <code class="docutils literal notranslate"><span class="pre">#</span></code>, newline) may produce paths that <code class="docutils literal notranslate"><span class="pre">HadoopFileIO</span></code>-based
-readers cannot open.</p></li>
-</ul>
<p>All content not listed above — the logical data, encodings for non-FLBA columns, statistics
values, and manifest metadata — must match iceberg-java exactly, or the write falls back.</p>
</section>
@@ -1135,7 +1124,6 @@ values, and manifest metadata — must match iceberg-java exactly, or the write
<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#accepted-divergences-behind-the-toggle">Accepted divergences behind the toggle</a><ul class="nav section-nav flex-column">
<li class="toc-h3 nav-item toc-entry"><a class="reference internal nav-link" href="#physical-file-layout-only-cosmetic">Physical file layout only (cosmetic)</a></li>
<li class="toc-h3 nav-item toc-entry"><a class="reference internal nav-link" href="#manifest-metadata-visible-to-later-readers">Manifest metadata visible to later readers</a></li>
-<li class="toc-h3 nav-item toc-entry"><a class="reference internal nav-link" href="#operational-caveat">Operational caveat</a></li>
</ul>
</li>
</ul>
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datafusion.apache.org
For additional commands, e-mail: commits-help@datafusion.apache.org