You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@datafusion.apache.org by gi...@apache.org on 2026/10/20 22:23:58 UTC
(datafusion-comet) branch asf-site updated: Publish built docs triggered by bf49f1e0283d9c2adb582542b653cd3268f88ae5
This is an automated email from the ASF dual-hosted git repository.
github-actions[bot] pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git
The following commit(s) were added to refs/heads/asf-site by this push:
new f221cfbc09 Publish built docs triggered by bf49f1e0283d9c2adb582542b653cd3268f88ae5
f221cfbc09 is described below
commit f221cfbc09178643a68e994bdeb917b1cc95cb43
Author: github-actions[bot] <gi...@users.noreply.github.com>
AuthorDate: Tue Oct 20 22:23:53 2026 +0000
Publish built docs triggered by bf49f1e0283d9c2adb582542b653cd3268f88ae5
---
.asf.yaml | 7 +++++++
_images/mermaid-09341aca03757d9d3637a2eaff73472d472d0673.svg | 2 +-
_sources/contributor-guide/development.md.txt | 7 +++++++
_sources/contributor-guide/jvm_shuffle.md.txt | 8 +++++---
contributor-guide/development.html | 6 ++++++
contributor-guide/jvm_shuffle.html | 8 +++++---
searchindex.js | 2 +-
7 files changed, 32 insertions(+), 8 deletions(-)
diff --git a/.asf.yaml b/.asf.yaml
index 29bd6a5361..1aede2a817 100644
--- a/.asf.yaml
+++ b/.asf.yaml
@@ -179,6 +179,13 @@ github:
# Lets a committer queue a PR before its checks have finished, which is
# most of the point of having a queue.
allow_auto_merge: true
+ # Limit open pull requests per user without write access.
+ #
+ # With coding agents, the number of open PRs now far exceeds our review capacity.
+ # Setting a limit helps reviewers focus on fewer PRs at a time.
+ creation_cap:
+ enabled: true
+ max_open_pull_requests: 3
# publishes the content of the `asf-site` branch to
# https://datafusion.apache.org/comet/
publish:
diff --git a/_images/mermaid-09341aca03757d9d3637a2eaff73472d472d0673.svg b/_images/mermaid-09341aca03757d9d3637a2eaff73472d472d0673.svg
index 2466e4dc26..c43ea23491 100644
--- a/_images/mermaid-09341aca03757d9d3637a2eaff73472d472d0673.svg
+++ b/_images/mermaid-09341aca03757d9d3637a2eaff73472d472d0673.svg
@@ -1 +1 @@
-<svg id="my-svg" width="100%" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" class="flowchart" style="max-width: 511.73px; background-color: transparent;" viewBox="0 0 511.7299499511719 1014" role="graphics-document document" aria-roledescription="flowchart-v2"><style>#my-svg{font-family:"trebuchet ms",verdana,arial,sans-serif;font-size:16px;fill:#333;}@keyframes edge-animation-frame{from{stroke-dashoffset:0;}}@keyframes dash{to{stroke-dashoffset:0;}}#my-sv [...]
\ No newline at end of file
+<svg id="my-svg" width="100%" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" class="flowchart" style="max-width: 511.73px; background-color: transparent;" viewBox="0 0 511.7299499511719 1014" role="graphics-document document" aria-roledescription="flowchart-v2"><style>#my-svg{font-family:"trebuchet ms",verdana,arial,sans-serif;font-size:16px;fill:#333;}@keyframes edge-animation-frame{from{stroke-dashoffset:0;}}@keyframes dash{to{stroke-dashoffset:0;}}#my-sv [...]
\ No newline at end of file
diff --git a/_sources/contributor-guide/development.md.txt b/_sources/contributor-guide/development.md.txt
index 968c82eb4f..199ec017d4 100644
--- a/_sources/contributor-guide/development.md.txt
+++ b/_sources/contributor-guide/development.md.txt
@@ -633,6 +633,13 @@ It is possible to debug both native and JVM code concurrently as described in th
## Submitting a Pull Request
+With coding agents, the number of open PRs can far exceed our review capacity. To help reviewers
+focus on fewer PRs at a time, users without write access are limited to **3 open, non-draft PRs**.
+If you reach the limit, wait for existing PRs to be merged, close them, or convert them to drafts
+before opening another. For work that is split into a series of small PRs, keep only the PR that
+is ready for review, or that the later PRs depend on, as non-draft, and open the others as drafts
+until it merges.
+
Use `git push` for normal updates to your PR branch. If you need to force push after a rebase
or amend, use `git push --force-with-lease` instead of `git push --force` (or `-f`). This reduces
the risk of accidentally overwriting another maintainer's commits when multiple people push
diff --git a/_sources/contributor-guide/jvm_shuffle.md.txt b/_sources/contributor-guide/jvm_shuffle.md.txt
index 43acc7a655..4d434270f6 100644
--- a/_sources/contributor-guide/jvm_shuffle.md.txt
+++ b/_sources/contributor-guide/jvm_shuffle.md.txt
@@ -179,9 +179,11 @@ Selection logic in `CometShuffleManager.shouldBypassMergeSort()`:
call writes every partition
5. Native code converts the rows to Arrow arrays and writes them as Arrow IPC blocks. `doSpilling()`
passes one partition's row addresses and sizes to `Native.writeSortedFileNative()`. `SpillSorter`
- sorts its record pointers by partition with `Native.sortRowPartitionsNative()`, then passes them,
- with the address of each data page, to `Native.writeSortedPartitionsNative()`. That call reads the
- rows in place, writes every partition of the spill, and returns each partition's length and checksum
+ sorts its record pointers by partition with `Native.sortRowPartitionsNative()`, a radix sort that
+ uses the half of the pointer array `ShuffleInMemorySorter` keeps free as scratch space, then
+ passes them, with the address of each data page, to `Native.writeSortedPartitionsNative()`. That
+ call reads the rows in place, writes every partition of the spill, and returns each partition's
+ length and checksum
6. For bypass writer: partition files are concatenated into final output
7. For sort writer: spill files are merged
diff --git a/contributor-guide/development.html b/contributor-guide/development.html
index 3e1a6c052a..48f9135f6d 100644
--- a/contributor-guide/development.html
+++ b/contributor-guide/development.html
@@ -1170,6 +1170,12 @@ It is possible to debug both native and JVM code concurrently as described in th
</section>
<section id="submitting-a-pull-request">
<h2>Submitting a Pull Request<a class="headerlink" href="#submitting-a-pull-request" title="Link to this heading">#</a></h2>
+<p>With coding agents, the number of open PRs can far exceed our review capacity. To help reviewers
+focus on fewer PRs at a time, users without write access are limited to <strong>3 open, non-draft PRs</strong>.
+If you reach the limit, wait for existing PRs to be merged, close them, or convert them to drafts
+before opening another. For work that is split into a series of small PRs, keep only the PR that
+is ready for review, or that the later PRs depend on, as non-draft, and open the others as drafts
+until it merges.</p>
<p>Use <code class="docutils literal notranslate"><span class="pre">git</span> <span class="pre">push</span></code> for normal updates to your PR branch. If you need to force push after a rebase
or amend, use <code class="docutils literal notranslate"><span class="pre">git</span> <span class="pre">push</span> <span class="pre">--force-with-lease</span></code> instead of <code class="docutils literal notranslate"><span class="pre">git</span> <span class="pre">push</span> <span class="pre">--force</span></code> (or <code class="docutils literal notranslate"><span class="pre">-f</span></code>). This reduces
the risk of accidentally overwriting another maintainer’s commits when multiple people push
diff --git a/contributor-guide/jvm_shuffle.html b/contributor-guide/jvm_shuffle.html
index 3fcd3de81b..882c5efddd 100644
--- a/contributor-guide/jvm_shuffle.html
+++ b/contributor-guide/jvm_shuffle.html
@@ -784,9 +784,11 @@ calls <code class="docutils literal notranslate"><span class="pre">SpillWriter.d
call writes every partition</p></li>
<li><p>Native code converts the rows to Arrow arrays and writes them as Arrow IPC blocks. <code class="docutils literal notranslate"><span class="pre">doSpilling()</span></code>
passes one partition’s row addresses and sizes to <code class="docutils literal notranslate"><span class="pre">Native.writeSortedFileNative()</span></code>. <code class="docutils literal notranslate"><span class="pre">SpillSorter</span></code>
-sorts its record pointers by partition with <code class="docutils literal notranslate"><span class="pre">Native.sortRowPartitionsNative()</span></code>, then passes them,
-with the address of each data page, to <code class="docutils literal notranslate"><span class="pre">Native.writeSortedPartitionsNative()</span></code>. That call reads the
-rows in place, writes every partition of the spill, and returns each partition’s length and checksum</p></li>
+sorts its record pointers by partition with <code class="docutils literal notranslate"><span class="pre">Native.sortRowPartitionsNative()</span></code>, a radix sort that
+uses the half of the pointer array <code class="docutils literal notranslate"><span class="pre">ShuffleInMemorySorter</span></code> keeps free as scratch space, then
+passes them, with the address of each data page, to <code class="docutils literal notranslate"><span class="pre">Native.writeSortedPartitionsNative()</span></code>. That
+call reads the rows in place, writes every partition of the spill, and returns each partition’s
+length and checksum</p></li>
<li><p>For bypass writer: partition files are concatenated into final output</p></li>
<li><p>For sort writer: spill files are merged</p></li>
</ol>
diff --git a/searchindex.js b/searchindex.js
index a6dc104935..cc0cc298ef 100644
--- a/searchindex.js
+++ b/searchindex.js
@@ -1 +1 @@
-Search.setIndex({"alltitles": {"!": [[63, "id1"]], "%": [[61, "id1"]], "&": [[51, "id1"]], "*": [[61, "id2"]], "+": [[61, "id3"]], "-": [[61, "id4"]], "/": [[61, "id5"]], "1. Format Your Code": [[48, "format-your-code"]], "1. Install Comet": [[70, "install-comet"], [82, "install-comet"]], "1. Native Operators (nativeExecs map)": [[31, "native-operators-nativeexecs-map"]], "2. Build and Verify": [[48, "build-and-verify"]], "2. Clone Iceberg and Apply Diff": [[70, "clone-iceberg-and-apply- [...]
\ No newline at end of file
+Search.setIndex({"alltitles": {"!": [[63, "id1"]], "%": [[61, "id1"]], "&": [[51, "id1"]], "*": [[61, "id2"]], "+": [[61, "id3"]], "-": [[61, "id4"]], "/": [[61, "id5"]], "1. Format Your Code": [[48, "format-your-code"]], "1. Install Comet": [[70, "install-comet"], [82, "install-comet"]], "1. Native Operators (nativeExecs map)": [[31, "native-operators-nativeexecs-map"]], "2. Build and Verify": [[48, "build-and-verify"]], "2. Clone Iceberg and Apply Diff": [[70, "clone-iceberg-and-apply- [...]
\ No newline at end of file
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datafusion.apache.org
For additional commands, e-mail: commits-help@datafusion.apache.org