You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by yi...@apache.org on 2022/09/03 00:43:42 UTC
[hudi] branch asf-site updated: [DOCS] Add support for Apache Doris and StarRocks (#6570)
This is an automated email from the ASF dual-hosted git repository.
yihua pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 09a8207f65 [DOCS] Add support for Apache Doris and StarRocks (#6570)
09a8207f65 is described below
commit 09a8207f65a678cd825ecc06e6810f2221b545e1
Author: Bhavani Sudha Saktheeswaran <21...@users.noreply.github.com>
AuthorDate: Fri Sep 2 17:43:32 2022 -0700
[DOCS] Add support for Apache Doris and StarRocks (#6570)
---
website/docs/query_engine_setup.md | 15 +++++++++++++++
website/docs/querying_data.md | 7 +++++++
website/static/assets/images/hudi-lake.png | Bin 152033 -> 356832 bytes
.../version-0.10.0/query_engine_setup.md | 14 ++++++++++++++
.../versioned_docs/version-0.10.0/querying_data.md | 8 ++++++++
.../version-0.10.1/query_engine_setup.md | 6 ++++++
.../versioned_docs/version-0.10.1/querying_data.md | 4 ++++
.../version-0.11.0/query_engine_setup.md | 6 ++++++
.../versioned_docs/version-0.11.0/querying_data.md | 4 ++++
.../version-0.11.1/query_engine_setup.md | 6 ++++++
.../versioned_docs/version-0.11.1/querying_data.md | 5 +++++
.../version-0.12.0/query_engine_setup.md | 6 ++++++
.../versioned_docs/version-0.12.0/querying_data.md | 4 ++++
13 files changed, 85 insertions(+)
diff --git a/website/docs/query_engine_setup.md b/website/docs/query_engine_setup.md
index 63978797a6..b73e8a9d4a 100644
--- a/website/docs/query_engine_setup.md
+++ b/website/docs/query_engine_setup.md
@@ -99,3 +99,18 @@ Hudi tables are supported only when AWS Glue Data Catalog is used. It's not supp
Please refer to [Redshift Spectrum Integration with Apache Hudi](https://docs.aws.amazon.com/redshift/latest/dg/c-spectrum-external-tables.html#c-spectrum-column-mapping-hudi)
for more details.
+
+## Doris
+Copy on Write Tables in Hudi version 0.10.0 can be queried via Doris external tables starting from Doris version 1.1.
+Please refer to [Doris Hudi external table](https://doris.apache.org/docs/ecosystem/external-table/hudi-external-table/ )
+for more details on the setup.
+
+:::note
+The current default supported version of Hudi is 0.10.0 and has not been tested in other versions. More versions will be supported in the future.
+:::
+
+## StarRocks
+Copy on Write tables in Apache Hudi 0.10.0 and above can be queried via StarRocks external tables from StarRocks version 2.2.0.
+Only snapshot queries are supported currently. In future releases Merge on Read tables will also be supported.
+Please refer to [StarRocks Hudi external table](https://docs.starrocks.com/en-us/2.2/using_starrocks/External_table#hudi-external-table)
+for more details on the setup.
diff --git a/website/docs/querying_data.md b/website/docs/querying_data.md
index 024c84f5df..27551e5235 100644
--- a/website/docs/querying_data.md
+++ b/website/docs/querying_data.md
@@ -269,6 +269,11 @@ REFRESH database.table_name
## Redshift Spectrum
To set up Redshift Spectrum for querying Hudi, see the [Query Engine Setup](/docs/next/query_engine_setup#redshift-spectrum) page.
+## Doris
+To set up Doris for querying Hudi, see the [Query Engine Setup](/docs/next/query_engine_setup#doris) page.
+
+## StarRocks
+To set up StarRocks for querying Hudi, see the [Query Engine Setup](/docs/next/query_engine_setup#starrocks) page.
## Support Matrix
@@ -286,6 +291,8 @@ Following tables show whether a given query is supported on specific query engin
| **Trino** |Y|N|
| **Impala** |Y|N|
| **Redshift Spectrum** |Y|N|
+| **Doris** |Y|N|
+| **StarRocks** |Y|N|
diff --git a/website/static/assets/images/hudi-lake.png b/website/static/assets/images/hudi-lake.png
index 4e6f9cf0f3..82e628125c 100644
Binary files a/website/static/assets/images/hudi-lake.png and b/website/static/assets/images/hudi-lake.png differ
diff --git a/website/versioned_docs/version-0.10.0/query_engine_setup.md b/website/versioned_docs/version-0.10.0/query_engine_setup.md
index 6e4f60b496..80197ea528 100644
--- a/website/versioned_docs/version-0.10.0/query_engine_setup.md
+++ b/website/versioned_docs/version-0.10.0/query_engine_setup.md
@@ -81,3 +81,17 @@ Hudi tables are supported only when AWS Glue Data Catalog is used. It's not supp
Please refer to [Redshift Spectrum Integration with Apache Hudi](https://docs.aws.amazon.com/redshift/latest/dg/c-spectrum-external-tables.html#c-spectrum-column-mapping-hudi)
for more details.
+## Doris
+Copy on Write Tables in Hudi version 0.10.0 can be queried via Doris external tables starting from Doris version 1.1.
+Please refer to [Doris Hudi external table](https://doris.apache.org/docs/ecosystem/external-table/hudi-external-table/ )
+for more details on the setup.
+
+:::note
+The current default supported version of Hudi is 0.10.0 and has not been tested in other versions. More versions will be supported in the future.
+:::
+
+## StarRocks
+Copy on Write tables in Apache Hudi 0.10.0 and above can be queried via StarRocks external tables from StarRocks version 2.2.0.
+Only snapshot queries are supported currently. In future releases Merge on Read tables will also be supported.
+Please refer to [StarRocks Hudi external table](https://docs.starrocks.com/en-us/2.2/using_starrocks/External_table#hudi-external-table)
+for more details on the setup.
\ No newline at end of file
diff --git a/website/versioned_docs/version-0.10.0/querying_data.md b/website/versioned_docs/version-0.10.0/querying_data.md
index 6e1c15aa71..15b5ff3436 100644
--- a/website/versioned_docs/version-0.10.0/querying_data.md
+++ b/website/versioned_docs/version-0.10.0/querying_data.md
@@ -207,6 +207,12 @@ REFRESH database.table_name
## Redshift Spectrum
To set up Redshift Spectrum for querying Hudi, see the [Query Engine Setup](/docs/0.10.0/query_engine_setup#redshift-spectrum) page.
+## Doris
+To set up Doris for querying Hudi, see the [Query Engine Setup](/docs/0.10.0/query_engine_setup#doris) page.
+
+## StarRocks
+To set up StarRocks for querying Hudi, see the [Query Engine Setup](/docs/0.10.0/query_engine_setup#starrocks) page.
+
## Support Matrix
Following tables show whether a given query is supported on specific query engine.
@@ -223,6 +229,8 @@ Following tables show whether a given query is supported on specific query engin
|**Trino**|Y|N|
|**Impala**|Y|N|
|**Redshift Spectrum** |Y|N|
+| **Doris** |Y|N|
+| **StarRocks** |Y|N|
Note that `Read Optimized` queries are not applicable for COPY_ON_WRITE tables.
diff --git a/website/versioned_docs/version-0.10.1/query_engine_setup.md b/website/versioned_docs/version-0.10.1/query_engine_setup.md
index ffff7401a9..6195f1e0a0 100644
--- a/website/versioned_docs/version-0.10.1/query_engine_setup.md
+++ b/website/versioned_docs/version-0.10.1/query_engine_setup.md
@@ -61,3 +61,9 @@ In order for Hive to recognize Hudi tables and query correctly,
In addition to setup above, for beeline cli access, the `hive.input.format` variable needs to be set to the fully qualified path name of the
inputformat `org.apache.hudi.hadoop.HoodieParquetInputFormat`. For Tez, additionally the `hive.tez.input.format` needs to be set
to `org.apache.hadoop.hive.ql.io.HiveInputFormat`. Then proceed to query the table like any other Hive table.
+
+## StarRocks
+Copy on Write tables in Apache Hudi 0.10.0 and above can be queried via StarRocks external tables from StarRocks version 2.2.0.
+Only snapshot queries are supported currently. In future releases Merge on Read tables will also be supported.
+Please refer to [StarRocks Hudi external table](https://docs.starrocks.com/en-us/2.2/using_starrocks/External_table#hudi-external-table)
+for more details on the setup.
\ No newline at end of file
diff --git a/website/versioned_docs/version-0.10.1/querying_data.md b/website/versioned_docs/version-0.10.1/querying_data.md
index c516708e7d..620581eb16 100644
--- a/website/versioned_docs/version-0.10.1/querying_data.md
+++ b/website/versioned_docs/version-0.10.1/querying_data.md
@@ -205,6 +205,9 @@ After Hudi made a new commit, refresh the Impala table to get the latest results
REFRESH database.table_name
```
+## StarRocks
+To set up StarRocks for querying Hudi, see the [Query Engine Setup](/docs/0.10.1/query_engine_setup#starrocks) page.
+
## Support Matrix
Following tables show whether a given query is supported on specific query engine.
@@ -220,6 +223,7 @@ Following tables show whether a given query is supported on specific query engin
|**PrestoDB**|Y|N|
|**Trino**|Y|N|
|**Impala**|Y|N|
+| **StarRocks** |Y|N|
Note that `Read Optimized` queries are not applicable for COPY_ON_WRITE tables.
diff --git a/website/versioned_docs/version-0.11.0/query_engine_setup.md b/website/versioned_docs/version-0.11.0/query_engine_setup.md
index 157e6daca6..10d1bb18e7 100644
--- a/website/versioned_docs/version-0.11.0/query_engine_setup.md
+++ b/website/versioned_docs/version-0.11.0/query_engine_setup.md
@@ -71,3 +71,9 @@ In order for Hive to recognize Hudi tables and query correctly,
In addition to setup above, for beeline cli access, the `hive.input.format` variable needs to be set to the fully qualified path name of the
inputformat `org.apache.hudi.hadoop.HoodieParquetInputFormat`. For Tez, additionally the `hive.tez.input.format` needs to be set
to `org.apache.hadoop.hive.ql.io.HiveInputFormat`. Then proceed to query the table like any other Hive table.
+
+## StarRocks
+Copy on Write tables in Apache Hudi 0.10.0 and above can be queried via StarRocks external tables from StarRocks version 2.2.0.
+Only snapshot queries are supported currently. In future releases Merge on Read tables will also be supported.
+Please refer to [StarRocks Hudi external table](https://docs.starrocks.com/en-us/2.2/using_starrocks/External_table#hudi-external-table)
+for more details on the setup.
\ No newline at end of file
diff --git a/website/versioned_docs/version-0.11.0/querying_data.md b/website/versioned_docs/version-0.11.0/querying_data.md
index 1b5cee0d5b..aa4b252f82 100644
--- a/website/versioned_docs/version-0.11.0/querying_data.md
+++ b/website/versioned_docs/version-0.11.0/querying_data.md
@@ -205,6 +205,9 @@ After Hudi made a new commit, refresh the Impala table to get the latest results
REFRESH database.table_name
```
+## StarRocks
+To set up StarRocks for querying Hudi, see the [Query Engine Setup](/docs/0.11.0/query_engine_setup#starrocks) page.
+
## Support Matrix
Following tables show whether a given query is supported on specific query engine.
@@ -220,6 +223,7 @@ Following tables show whether a given query is supported on specific query engin
|**PrestoDB**|Y|N|
|**Trino**|Y|N|
|**Impala**|Y|N|
+| **StarRocks** |Y|N|
Note that `Read Optimized` queries are not applicable for COPY_ON_WRITE tables.
diff --git a/website/versioned_docs/version-0.11.1/query_engine_setup.md b/website/versioned_docs/version-0.11.1/query_engine_setup.md
index 157e6daca6..10d1bb18e7 100644
--- a/website/versioned_docs/version-0.11.1/query_engine_setup.md
+++ b/website/versioned_docs/version-0.11.1/query_engine_setup.md
@@ -71,3 +71,9 @@ In order for Hive to recognize Hudi tables and query correctly,
In addition to setup above, for beeline cli access, the `hive.input.format` variable needs to be set to the fully qualified path name of the
inputformat `org.apache.hudi.hadoop.HoodieParquetInputFormat`. For Tez, additionally the `hive.tez.input.format` needs to be set
to `org.apache.hadoop.hive.ql.io.HiveInputFormat`. Then proceed to query the table like any other Hive table.
+
+## StarRocks
+Copy on Write tables in Apache Hudi 0.10.0 and above can be queried via StarRocks external tables from StarRocks version 2.2.0.
+Only snapshot queries are supported currently. In future releases Merge on Read tables will also be supported.
+Please refer to [StarRocks Hudi external table](https://docs.starrocks.com/en-us/2.2/using_starrocks/External_table#hudi-external-table)
+for more details on the setup.
\ No newline at end of file
diff --git a/website/versioned_docs/version-0.11.1/querying_data.md b/website/versioned_docs/version-0.11.1/querying_data.md
index 1b5cee0d5b..c9778c6b0e 100644
--- a/website/versioned_docs/version-0.11.1/querying_data.md
+++ b/website/versioned_docs/version-0.11.1/querying_data.md
@@ -205,6 +205,10 @@ After Hudi made a new commit, refresh the Impala table to get the latest results
REFRESH database.table_name
```
+
+## StarRocks
+To set up StarRocks for querying Hudi, see the [Query Engine Setup](/docs/0.11.1/query_engine_setup#starrocks) page.
+
## Support Matrix
Following tables show whether a given query is supported on specific query engine.
@@ -220,6 +224,7 @@ Following tables show whether a given query is supported on specific query engin
|**PrestoDB**|Y|N|
|**Trino**|Y|N|
|**Impala**|Y|N|
+| **StarRocks** |Y|N|
Note that `Read Optimized` queries are not applicable for COPY_ON_WRITE tables.
diff --git a/website/versioned_docs/version-0.12.0/query_engine_setup.md b/website/versioned_docs/version-0.12.0/query_engine_setup.md
index 619ec17ca1..c6b472e513 100644
--- a/website/versioned_docs/version-0.12.0/query_engine_setup.md
+++ b/website/versioned_docs/version-0.12.0/query_engine_setup.md
@@ -99,3 +99,9 @@ Hudi tables are supported only when AWS Glue Data Catalog is used. It's not supp
Please refer to [Redshift Spectrum Integration with Apache Hudi](https://docs.aws.amazon.com/redshift/latest/dg/c-spectrum-external-tables.html#c-spectrum-column-mapping-hudi)
for more details.
+
+## StarRocks
+Copy on Write tables in Apache Hudi 0.10.0 and above can be queried via StarRocks external tables from StarRocks version 2.2.0.
+Only snapshot queries are supported currently. In future releases Merge on Read tables will also be supported.
+Please refer to [StarRocks Hudi external table](https://docs.starrocks.com/en-us/2.2/using_starrocks/External_table#hudi-external-table)
+for more details on the setup.
\ No newline at end of file
diff --git a/website/versioned_docs/version-0.12.0/querying_data.md b/website/versioned_docs/version-0.12.0/querying_data.md
index 024c84f5df..215a56d507 100644
--- a/website/versioned_docs/version-0.12.0/querying_data.md
+++ b/website/versioned_docs/version-0.12.0/querying_data.md
@@ -270,6 +270,9 @@ REFRESH database.table_name
To set up Redshift Spectrum for querying Hudi, see the [Query Engine Setup](/docs/next/query_engine_setup#redshift-spectrum) page.
+## StarRocks
+To set up StarRocks for querying Hudi, see the [Query Engine Setup](/docs/query_engine_setup#starrocks) page.
+
## Support Matrix
Following tables show whether a given query is supported on specific query engine.
@@ -286,6 +289,7 @@ Following tables show whether a given query is supported on specific query engin
| **Trino** |Y|N|
| **Impala** |Y|N|
| **Redshift Spectrum** |Y|N|
+| **StarRocks** |Y|N|