(arrow-site) branch main updated: [Website] Add Blog about Comet Donation (#479)

[al...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

alamb pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/arrow-site.git


The following commit(s) were added to refs/heads/main by this push:
     new d54b3be28a6 [Website] Add Blog about Comet Donation (#479)
d54b3be28a6 is described below

commit d54b3be28a681f130aaf58933ebdaefd944fab48
Author: Andrew Lamb <an...@nerdnetworks.org>
AuthorDate: Wed Mar 6 02:52:33 2024 -0500

    [Website] Add Blog about Comet Donation (#479)
    
    Closes https://github.com/apache/arrow-datafusion-comet/issues/6
    
    Rationale: We should tell the world about the Comet donation.
    
    See background and more details on the mailing list:
    https://lists.apache.org/thread/0q1rb11jtpopc7vt1ffdzro0omblsh0s
    
    ---------
    
    Co-authored-by: Liang-Chi Hsieh <vi...@gmail.com>
    Co-authored-by: Andy Grove <an...@gmail.com>
---
 _posts/2024-03-06-comet-donation.md         |  90 ++++++++++++++++++++++++++++
 img/datafusion-comet/comet-architecture.png | Bin 0 -> 30027 bytes
 2 files changed, 90 insertions(+)

diff --git a/_posts/2024-03-06-comet-donation.md b/_posts/2024-03-06-comet-donation.md
new file mode 100644
index 00000000000..138ae2ce9b1
--- /dev/null
+++ b/_posts/2024-03-06-comet-donation.md
@@ -0,0 +1,90 @@
+---
+layout: post
+title: "Announcing Apache Arrow DataFusion Comet"
+date: "2024-03-06 00:00:00"
+author: pmc
+categories: [release]
+---
+<!--
+{% comment %}
+Licensed to the Apache Software Foundation (ASF) under one or more
+contributor license agreements.  See the NOTICE file distributed with
+this work for additional information regarding copyright ownership.
+The ASF licenses this file to you under the Apache License, Version 2.0
+(the "License"); you may not use this file except in compliance with
+the License.  You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+{% endcomment %}
+-->
+
+# Introduction
+The Apache Arrow PMC is pleased to announce the donation of the [Comet project],
+a native Spark SQL Accelerator built on [Apache Arrow DataFusion].
+
+Comet is an Apache Spark plugin that uses Apache Arrow DataFusion to
+accelerate Spark workloads. It is designed as a drop-in
+replacement for Spark's JVM based SQL execution engine and offers significant
+performance improvements for some workloads as shown below.
+
+<figure style="text-align: center;">
+  <img 
+    src="{{ site.baseurl }}/img/datafusion-comet/comet-architecture.png" 
+    width="100%" 
+    class="img-responsive" 
+    alt="Fig 1: Adaptive Arrow schema architecture overview."
+  >
+  <figcaption>
+   <b>Figure 1</b>: With Comet, users interact with the same Spark ecosystem, tools
+    and APIs such as Spark SQL. Queries still run through Spark's query optimizer and planner. 
+    However, the execution is delegated to Comet,
+    which is significantly faster and more resource efficient than a JVM based
+    implementation.
+</figcaption>
+</figure>
+
+
+
+[Rust]: https://www.rust-lang.org/
+
+Comet is one of a growing class of projects that aim to accelerate Spark using
+native columnar engines such as the proprietary [Databricks Photon Engine] and
+open source projects [Gluten], [Spark RAPIDS], and [Blaze] (also built using
+DataFusion).
+
+Comet was originally implemented at Apple and the engineers who worked on the
+project are also significant contributors to Arrow and DataFusion. Bringing 
+Comet into the Apache Software Foundation will accelerate its development and 
+grow its community of contributors and users.
+
+[Comet project]: https://github.com/apache/arrow-datafusion-comet
+[Apache Arrow DataFusion]: https://arrow.apache.org/datafusion
+[Databricks Photon Engine]: https://www.databricks.com/product/photon
+[Gluten]: https://incubator.apache.org/projects/gluten.html
+[Blaze]: https://github.com/kwai/blaze
+[Spark RAPIDS]: https://github.com/NVIDIA/spark-rapids
+
+# Get Involved
+Comet is still in the early stages of development and we would love to have you
+join us and help shape the project. We are working on an initial release, and 
+expect to post another update with more details at that time.
+
+Before then, here are some ways to get involved:
+
+* Learn more by visiting the [Comet project] page and reading the [mailing list
+  discussion] about the initial donation.
+
+* Help us plan out the [roadmap]
+
+* Try out the project and provide feedback, file issues, and contribute code.
+
+[mailing list discussion]: https://lists.apache.org/thread/0q1rb11jtpopc7vt1ffdzro0omblsh0s
+[roadmap]: https://github.com/apache/arrow-datafusion-comet/issues/19
+
+ 
diff --git a/img/datafusion-comet/comet-architecture.png b/img/datafusion-comet/comet-architecture.png
new file mode 100644
index 00000000000..e7c90757361
Binary files /dev/null and b/img/datafusion-comet/comet-architecture.png differ