You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by yi...@apache.org on 2024/06/27 04:07:48 UTC
(hudi) branch asf-site updated: [DOCS] Add Ecosystem Page (#11526)
This is an automated email from the ASF dual-hosted git repository.
yihua pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/asf-site by this push:
new d123a2d0e49 [DOCS] Add Ecosystem Page (#11526)
d123a2d0e49 is described below
commit d123a2d0e49e6053d2e73ab0cca12f45fbee4598
Author: Bhavani Sudha Saktheeswaran <21...@users.noreply.github.com>
AuthorDate: Wed Jun 26 21:07:42 2024 -0700
[DOCS] Add Ecosystem Page (#11526)
Co-authored-by: Albert T. Wong <at...@alumni.uci.edu>
---
website/src/pages/ecosystem.md | 39 +++++++++++++++++++++++++++++++++++++++
1 file changed, 39 insertions(+)
diff --git a/website/src/pages/ecosystem.md b/website/src/pages/ecosystem.md
new file mode 100644
index 00000000000..dcda0de53ab
--- /dev/null
+++ b/website/src/pages/ecosystem.md
@@ -0,0 +1,39 @@
+---
+title: Ecosystem
+---
+
+# Ecosystem Support
+
+While Apache Hudi works seamlessly with various application frameworks, SQL query engines, and data warehouses, some systems might only offer read capabilities.
+In such cases, you can leverage another tool like Apache Spark or Apache Flink to write data to Hudi tables and then use the read-compatible system for querying.
+
+| Project / Product | Apache Hudi (as of June 2024) | Comments |
+| ----------------- | ------------------------------------------------------------------------------------------------------------------------ | ----------- |
+| Onehouse.ai | [Read + Write](https://www.onehouse.ai/universal-data-lakehouse) | |
+| Apache Spark | [Read + Write](https://hudi.apache.org/docs/quick-start-guide) | |
+| Apache Flink | [Read + Write](https://hudi.apache.org/docs/flink-quick-start-guide) | |
+| Presto | [Read](https://prestodb.io/docs/current/connector/hudi.html) | |
+| Trino | [Read](https://trino.io/docs/current/connector/hudi.html) | |
+| Hive | [Read](https://hudi.apache.org/docs/next/query_engine_setup/#hive) | |
+| DBT | [Read + Write](https://hudi.apache.org/blog/2022/07/11/build-open-lakehouse-using-apache-hudi-and-dbt) | |
+| Kafka Connect | [Write](https://github.com/apache/hudi/tree/master/hudi-kafka-connect) | |
+| Kafka | [Write](https://hudi.apache.org/docs/hoodie_deltastreamer#kafka) | |
+| Pulsar | [Write](https://hub.streamnative.io/connectors/lakehouse-sink/2.9.2/) | |
+| Debezium | [Write](https://hudi.apache.org/cn/blog/2022/01/14/change-data-capture-with-debezium-and-apache-hudi/) | |
+| Kyuubi | [Read + Write](https://kyuubi.readthedocs.io/en/v1.6.0-incubating-rc0/connector/flink/hudi.html) | |
+| ClickHouse | [Read](https://clickhouse.com/docs/en/whats-new/changelog/#-clickhouse-release-2211-2022-11-17) | |
+| Apache Impala | [Read + Write](https://hudi.apache.org/docs/querying_data/#impala-34-or-later) | |
+| AWS Athena | [Read](https://docs.aws.amazon.com/athena/latest/ug/querying-hudi.html) | [Demo with S3](https://docs.aws.amazon.com/athena/latest/ug/querying-hudi.html) |
+| AWS EMR | [Read + Write](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-hudi-installation-and-configuration.html) | |
+| AWS Redshift | [Read](https://docs.aws.amazon.com/redshift/latest/dg/c-spectrum-external-tables.html) | |
+| AWS Glue | [Read + Write](https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-format-hudi.html) | |
+| Google BigQuery | [Read](https://hudi.apache.org/docs/gcp_bigquery/) | |
+| Google DataProc | [Read + Write](https://cloud.google.com/blog/products/data-analytics/getting-started-with-new-table-formats-on-dataproc) | |
+| Azure Synapse | [Read + Write](https://www.onehouse.ai/blog/apache-hudi-on-microsoft-azure) | |
+| Azure HDInsight | [Read + Write](https://www.onehouse.ai/blog/apache-hudi-on-microsoft-azure) | |
+| Databricks | [Read + Write](https://hudi.apache.org/docs/azure_hoodie/) | |
+| Snowflake | | |
+| Vertica | [Read](https://www.vertica.com/kb/Apache_Hudi_TE/Content/Partner/Apache_Hudi_TE.htm) | |
+| Apache Doris | [Read](https://doris.apache.org/docs/ecosystem/external-table/hudi-external-table/) | |
+| Starrocks | [Read](https://docs.starrocks.io/docs/data_source/catalog/hudi_catalog/) | [Demo with HMS + Min.IO](https://github.com/StarRocks/demo/tree/master/documentation-samples/hudi) |
+| Dremio | | |