You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@datafusion.apache.org by gi...@apache.org on 2025/07/01 14:51:33 UTC
(datafusion-comet) branch asf-site updated: Publish built docs triggered by 6e3a5e2a7662079fcf510d68eca55e223d5976ce
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 4d5c7346d Publish built docs triggered by 6e3a5e2a7662079fcf510d68eca55e223d5976ce
4d5c7346d is described below
commit 4d5c7346db16cc305a31e30ec8cb68c8dcc70da8
Author: github-actions[bot] <gi...@users.noreply.github.com>
AuthorDate: Tue Jul 1 14:51:29 2025 +0000
Publish built docs triggered by 6e3a5e2a7662079fcf510d68eca55e223d5976ce
---
_sources/contributor-guide/debugging.md.txt | 2 +-
_sources/user-guide/iceberg.md.txt | 4 ++--
_sources/user-guide/installation.md.txt | 4 ++--
contributor-guide/debugging.html | 2 +-
searchindex.js | 2 +-
user-guide/iceberg.html | 4 ++--
user-guide/installation.html | 4 ++--
7 files changed, 11 insertions(+), 11 deletions(-)
diff --git a/_sources/contributor-guide/debugging.md.txt b/_sources/contributor-guide/debugging.md.txt
index cbdf9264c..6149bf1ab 100644
--- a/_sources/contributor-guide/debugging.md.txt
+++ b/_sources/contributor-guide/debugging.md.txt
@@ -130,7 +130,7 @@ Then build the Comet as [described](https://github.com/apache/arrow-datafusion-c
Start Comet with `RUST_BACKTRACE=1`
```console
-RUST_BACKTRACE=1 $SPARK_HOME/spark-shell --jars spark/target/comet-spark-spark3.5_2.12-0.9.0-SNAPSHOT.jar --conf spark.plugins=org.apache.spark.CometPlugin --conf spark.comet.enabled=true --conf spark.comet.exec.enabled=true
+RUST_BACKTRACE=1 $SPARK_HOME/spark-shell --jars spark/target/comet-spark-spark3.5_2.12-0.10.0-SNAPSHOT.jar --conf spark.plugins=org.apache.spark.CometPlugin --conf spark.comet.enabled=true --conf spark.comet.exec.enabled=true
```
Get the expanded exception details
diff --git a/_sources/user-guide/iceberg.md.txt b/_sources/user-guide/iceberg.md.txt
index e9f7f2eb5..b191f42a7 100644
--- a/_sources/user-guide/iceberg.md.txt
+++ b/_sources/user-guide/iceberg.md.txt
@@ -39,7 +39,7 @@ make release
Set `COMET_JAR` env var:
```shell
-export COMET_JAR=`pwd`/spark/target/comet-spark-spark3.5_2.12-0.9.0-SNAPSHOT.jar
+export COMET_JAR=`pwd`/spark/target/comet-spark-spark3.5_2.12-0.10.0-SNAPSHOT.jar
```
## Build Iceberg
@@ -52,7 +52,7 @@ git clone git@github.com:apache/iceberg.git
It will be necessary to make some small changes to Iceberg:
-- Update Gradle files to change Comet version to `0.9.0-SNAPSHOT`.
+- Update Gradle files to change Comet version to `0.10.0-SNAPSHOT`.
- Replace `import org.apache.comet.shaded.arrow.c.CometSchemaImporter;` with `import org.apache.comet.CometSchemaImporter;`
- Modify `SparkBatchQueryScan` so that it implements the `SupportsComet` interface
- Stop shading Parquet by commenting out the following lines in the iceberg-spark build:
diff --git a/_sources/user-guide/installation.md.txt b/_sources/user-guide/installation.md.txt
index 3e9847618..0e8412915 100644
--- a/_sources/user-guide/installation.md.txt
+++ b/_sources/user-guide/installation.md.txt
@@ -84,7 +84,7 @@ See the [Comet Kubernetes Guide](kubernetes.md) guide.
Make sure `SPARK_HOME` points to the same Spark version as Comet was built for.
```shell
-export COMET_JAR=spark/target/comet-spark-spark3.5_2.12-0.9.0-SNAPSHOT.jar
+export COMET_JAR=spark/target/comet-spark-spark3.5_2.12-0.10.0-SNAPSHOT.jar
$SPARK_HOME/bin/spark-shell \
--jars $COMET_JAR \
@@ -140,7 +140,7 @@ explicitly contain Comet otherwise Spark may use a different class-loader for th
components which will then fail at runtime. For example:
```
---driver-class-path spark/target/comet-spark-spark3.5_2.12-0.9.0-SNAPSHOT.jar
+--driver-class-path spark/target/comet-spark-spark3.5_2.12-0.10.0-SNAPSHOT.jar
```
Some cluster managers may require additional configuration, see <https://spark.apache.org/docs/latest/cluster-overview.html>
diff --git a/contributor-guide/debugging.html b/contributor-guide/debugging.html
index de9ae5b37..f314c7664 100644
--- a/contributor-guide/debugging.html
+++ b/contributor-guide/debugging.html
@@ -466,7 +466,7 @@ To enable this option with Comet it is needed to include <code class="docutils l
</div>
<p>Then build the Comet as <a class="reference external" href="https://github.com/apache/arrow-datafusion-comet/blob/main/README.md#getting-started">described</a></p>
<p>Start Comet with <code class="docutils literal notranslate"><span class="pre">RUST_BACKTRACE=1</span></code></p>
-<div class="highlight-console notranslate"><div class="highlight"><pre><span></span><span class="go">RUST_BACKTRACE=1 $SPARK_HOME/spark-shell --jars spark/target/comet-spark-spark3.5_2.12-0.9.0-SNAPSHOT.jar --conf spark.plugins=org.apache.spark.CometPlugin --conf spark.comet.enabled=true --conf spark.comet.exec.enabled=true</span>
+<div class="highlight-console notranslate"><div class="highlight"><pre><span></span><span class="go">RUST_BACKTRACE=1 $SPARK_HOME/spark-shell --jars spark/target/comet-spark-spark3.5_2.12-0.10.0-SNAPSHOT.jar --conf spark.plugins=org.apache.spark.CometPlugin --conf spark.comet.enabled=true --conf spark.comet.exec.enabled=true</span>
</pre></div>
</div>
<p>Get the expanded exception details</p>
diff --git a/searchindex.js b/searchindex.js
index f774e14e2..dffd9ed79 100644
--- a/searchindex.js
+++ b/searchindex.js
@@ -1 +1 @@
-Search.setIndex({"alltitles": {"1. Install Comet": [[11, "install-comet"]], "2. Clone Spark and Apply Diff": [[11, "clone-spark-and-apply-diff"]], "3. Run Spark SQL Tests": [[11, "run-spark-sql-tests"]], "ANSI mode": [[14, "ansi-mode"]], "API Differences Between Spark Versions": [[0, "api-differences-between-spark-versions"]], "ASF Links": [[13, null]], "Accelerating Apache Iceberg Parquet Scans using Comet (Experimental)": [[19, null]], "Adding Spark-side Tests for the New Expression": [...]
\ No newline at end of file
+Search.setIndex({"alltitles": {"1. Install Comet": [[11, "install-comet"]], "2. Clone Spark and Apply Diff": [[11, "clone-spark-and-apply-diff"]], "3. Run Spark SQL Tests": [[11, "run-spark-sql-tests"]], "ANSI mode": [[14, "ansi-mode"]], "API Differences Between Spark Versions": [[0, "api-differences-between-spark-versions"]], "ASF Links": [[13, null]], "Accelerating Apache Iceberg Parquet Scans using Comet (Experimental)": [[19, null]], "Adding Spark-side Tests for the New Expression": [...]
\ No newline at end of file
diff --git a/user-guide/iceberg.html b/user-guide/iceberg.html
index e15bef379..0cfe05dcf 100644
--- a/user-guide/iceberg.html
+++ b/user-guide/iceberg.html
@@ -365,7 +365,7 @@ source rather than using available artifacts in Maven</strong></p>
</pre></div>
</div>
<p>Set <code class="docutils literal notranslate"><span class="pre">COMET_JAR</span></code> env var:</p>
-<div class="highlight-shell notranslate"><div class="highlight"><pre><span></span><span class="nb">export</span><span class="w"> </span><span class="nv">COMET_JAR</span><span class="o">=</span><span class="sb">`</span><span class="nb">pwd</span><span class="sb">`</span>/spark/target/comet-spark-spark3.5_2.12-0.9.0-SNAPSHOT.jar
+<div class="highlight-shell notranslate"><div class="highlight"><pre><span></span><span class="nb">export</span><span class="w"> </span><span class="nv">COMET_JAR</span><span class="o">=</span><span class="sb">`</span><span class="nb">pwd</span><span class="sb">`</span>/spark/target/comet-spark-spark3.5_2.12-0.10.0-SNAPSHOT.jar
</pre></div>
</div>
</section>
@@ -377,7 +377,7 @@ source rather than using available artifacts in Maven</strong></p>
</div>
<p>It will be necessary to make some small changes to Iceberg:</p>
<ul class="simple">
-<li><p>Update Gradle files to change Comet version to <code class="docutils literal notranslate"><span class="pre">0.9.0-SNAPSHOT</span></code>.</p></li>
+<li><p>Update Gradle files to change Comet version to <code class="docutils literal notranslate"><span class="pre">0.10.0-SNAPSHOT</span></code>.</p></li>
<li><p>Replace <code class="docutils literal notranslate"><span class="pre">import</span> <span class="pre">org.apache.comet.shaded.arrow.c.CometSchemaImporter;</span></code> with <code class="docutils literal notranslate"><span class="pre">import</span> <span class="pre">org.apache.comet.CometSchemaImporter;</span></code></p></li>
<li><p>Modify <code class="docutils literal notranslate"><span class="pre">SparkBatchQueryScan</span></code> so that it implements the <code class="docutils literal notranslate"><span class="pre">SupportsComet</span></code> interface</p></li>
<li><p>Stop shading Parquet by commenting out the following lines in the iceberg-spark build:</p></li>
diff --git a/user-guide/installation.html b/user-guide/installation.html
index 0d4605b5d..ba910a557 100644
--- a/user-guide/installation.html
+++ b/user-guide/installation.html
@@ -497,7 +497,7 @@ source releases, or from the latest code in the GitHub repository.</p>
<section id="run-spark-shell-with-comet-enabled">
<h2>Run Spark Shell with Comet enabled<a class="headerlink" href="#run-spark-shell-with-comet-enabled" title="Link to this heading">ΒΆ</a></h2>
<p>Make sure <code class="docutils literal notranslate"><span class="pre">SPARK_HOME</span></code> points to the same Spark version as Comet was built for.</p>
-<div class="highlight-shell notranslate"><div class="highlight"><pre><span></span><span class="nb">export</span><span class="w"> </span><span class="nv">COMET_JAR</span><span class="o">=</span>spark/target/comet-spark-spark3.5_2.12-0.9.0-SNAPSHOT.jar
+<div class="highlight-shell notranslate"><div class="highlight"><pre><span></span><span class="nb">export</span><span class="w"> </span><span class="nv">COMET_JAR</span><span class="o">=</span>spark/target/comet-spark-spark3.5_2.12-0.10.0-SNAPSHOT.jar
<span class="nv">$SPARK_HOME</span>/bin/spark-shell<span class="w"> </span><span class="se">\</span>
<span class="w"> </span>--jars<span class="w"> </span><span class="nv">$COMET_JAR</span><span class="w"> </span><span class="se">\</span>
@@ -548,7 +548,7 @@ being executed natively.</p>
<p>Depending on your deployment mode you may also need to set the driver & executor class path(s) to
explicitly contain Comet otherwise Spark may use a different class-loader for the Comet components than its internal
components which will then fail at runtime. For example:</p>
-<div class="highlight-default notranslate"><div class="highlight"><pre><span></span><span class="o">--</span><span class="n">driver</span><span class="o">-</span><span class="n">class</span><span class="o">-</span><span class="n">path</span> <span class="n">spark</span><span class="o">/</span><span class="n">target</span><span class="o">/</span><span class="n">comet</span><span class="o">-</span><span class="n">spark</span><span class="o">-</span><span class="n">spark3</span><span class= [...]
+<div class="highlight-default notranslate"><div class="highlight"><pre><span></span><span class="o">--</span><span class="n">driver</span><span class="o">-</span><span class="n">class</span><span class="o">-</span><span class="n">path</span> <span class="n">spark</span><span class="o">/</span><span class="n">target</span><span class="o">/</span><span class="n">comet</span><span class="o">-</span><span class="n">spark</span><span class="o">-</span><span class="n">spark3</span><span class= [...]
</pre></div>
</div>
<p>Some cluster managers may require additional configuration, see <a class="reference external" href="https://spark.apache.org/docs/latest/cluster-overview.html">https://spark.apache.org/docs/latest/cluster-overview.html</a></p>
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datafusion.apache.org
For additional commands, e-mail: commits-help@datafusion.apache.org