You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by bh...@apache.org on 2022/09/06 23:34:15 UTC
[hudi] branch asf-site updated: [DOCS] Fix Redshift spectrum Hudi version details (#6577)
This is an automated email from the ASF dual-hosted git repository.
bhavanisudha pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 55adeb7009 [DOCS] Fix Redshift spectrum Hudi version details (#6577)
55adeb7009 is described below
commit 55adeb70096655deff17516254b5286bf30118b6
Author: Bhavani Sudha Saktheeswaran <21...@users.noreply.github.com>
AuthorDate: Tue Sep 6 16:34:06 2022 -0700
[DOCS] Fix Redshift spectrum Hudi version details (#6577)
---
website/docs/query_engine_setup.md | 1 +
website/versioned_docs/version-0.10.0/query_engine_setup.md | 3 ++-
website/versioned_docs/version-0.10.1/query_engine_setup.md | 13 ++++++++++++-
website/versioned_docs/version-0.10.1/querying_data.md | 4 ++++
website/versioned_docs/version-0.11.0/query_engine_setup.md | 12 +++++++++++-
website/versioned_docs/version-0.11.0/querying_data.md | 4 ++++
website/versioned_docs/version-0.11.1/query_engine_setup.md | 12 +++++++++++-
website/versioned_docs/version-0.11.1/querying_data.md | 3 +++
website/versioned_docs/version-0.12.0/query_engine_setup.md | 3 ++-
website/versioned_docs/version-0.12.0/querying_data.md | 2 +-
website/versioned_docs/version-0.5.2/querying_data.md | 3 ++-
website/versioned_docs/version-0.6.0/querying_data.md | 3 ++-
website/versioned_docs/version-0.7.0/querying_data.md | 3 ++-
website/versioned_docs/version-0.8.0/querying_data.md | 3 ++-
website/versioned_docs/version-0.9.0/querying_data.md | 3 ++-
15 files changed, 61 insertions(+), 11 deletions(-)
diff --git a/website/docs/query_engine_setup.md b/website/docs/query_engine_setup.md
index b73e8a9d4a..ddf04b080a 100644
--- a/website/docs/query_engine_setup.md
+++ b/website/docs/query_engine_setup.md
@@ -93,6 +93,7 @@ to `org.apache.hadoop.hive.ql.io.HiveInputFormat`. Then proceed to query the tab
## Redshift Spectrum
Copy on Write Tables in Apache Hudi versions 0.5.2, 0.6.0, 0.7.0, 0.8.0, 0.9.0, 0.10.x, 0.11.x and 0.12.0 can be queried via Amazon Redshift Spectrum external tables.
+To be able to query Hudi versions 0.10.0 and above please try latest versions of Redshift.
:::note
Hudi tables are supported only when AWS Glue Data Catalog is used. It's not supported when you use an Apache Hive metastore as the external catalog.
:::
diff --git a/website/versioned_docs/version-0.10.0/query_engine_setup.md b/website/versioned_docs/version-0.10.0/query_engine_setup.md
index 80197ea528..0ba2faa8a0 100644
--- a/website/versioned_docs/version-0.10.0/query_engine_setup.md
+++ b/website/versioned_docs/version-0.10.0/query_engine_setup.md
@@ -73,7 +73,8 @@ inputformat `org.apache.hudi.hadoop.HoodieParquetInputFormat`. For Tez, addition
to `org.apache.hadoop.hive.ql.io.HiveInputFormat`. Then proceed to query the table like any other Hive table.
## Redshift Spectrum
-Copy on Write Tables in Apache Hudi versions 0.5.2, 0.6.0, 0.7.0, 0.8.0, 0.9.0, and 0.10.0 can be queried via Amazon Redshift Spectrum external tables.
+Copy on Write Tables in Apache Hudi versions 0.5.2, 0.6.0, 0.7.0, 0.8.0, 0.9.0, 0.10.x, 0.11.x and 0.12.0 can be queried via Amazon Redshift Spectrum external tables.
+To be able to query Hudi versions 0.10.0 and above please try latest versions of Redshift.
:::note
Hudi tables are supported only when AWS Glue Data Catalog is used. It's not supported when you use an Apache Hive metastore as the external catalog.
:::
diff --git a/website/versioned_docs/version-0.10.1/query_engine_setup.md b/website/versioned_docs/version-0.10.1/query_engine_setup.md
index 6195f1e0a0..4e400a7679 100644
--- a/website/versioned_docs/version-0.10.1/query_engine_setup.md
+++ b/website/versioned_docs/version-0.10.1/query_engine_setup.md
@@ -62,8 +62,19 @@ In addition to setup above, for beeline cli access, the `hive.input.format` vari
inputformat `org.apache.hudi.hadoop.HoodieParquetInputFormat`. For Tez, additionally the `hive.tez.input.format` needs to be set
to `org.apache.hadoop.hive.ql.io.HiveInputFormat`. Then proceed to query the table like any other Hive table.
+## Redshift Spectrum
+Copy on Write Tables in Apache Hudi versions 0.5.2, 0.6.0, 0.7.0, 0.8.0, 0.9.0, 0.10.x, 0.11.x and 0.12.0 can be queried via Amazon Redshift Spectrum external tables.
+To be able to query Hudi versions 0.10.0 and above please try latest versions of Redshift.
+:::note
+Hudi tables are supported only when AWS Glue Data Catalog is used. It's not supported when you use an Apache Hive metastore as the external catalog.
+:::
+
+Please refer to [Redshift Spectrum Integration with Apache Hudi](https://docs.aws.amazon.com/redshift/latest/dg/c-spectrum-external-tables.html#c-spectrum-column-mapping-hudi)
+for more details.
+
## StarRocks
Copy on Write tables in Apache Hudi 0.10.0 and above can be queried via StarRocks external tables from StarRocks version 2.2.0.
Only snapshot queries are supported currently. In future releases Merge on Read tables will also be supported.
Please refer to [StarRocks Hudi external table](https://docs.starrocks.com/en-us/2.2/using_starrocks/External_table#hudi-external-table)
-for more details on the setup.
\ No newline at end of file
+for more details on the setup.
+
diff --git a/website/versioned_docs/version-0.10.1/querying_data.md b/website/versioned_docs/version-0.10.1/querying_data.md
index 620581eb16..2fecc65595 100644
--- a/website/versioned_docs/version-0.10.1/querying_data.md
+++ b/website/versioned_docs/version-0.10.1/querying_data.md
@@ -205,6 +205,9 @@ After Hudi made a new commit, refresh the Impala table to get the latest results
REFRESH database.table_name
```
+## Redshift Spectrum
+To set up Redshift Spectrum for querying Hudi, see the [Query Engine Setup](/docs/0.10.1/query_engine_setup#redshift-spectrum) page.
+
## StarRocks
To set up StarRocks for querying Hudi, see the [Query Engine Setup](/docs/0.10.1/query_engine_setup#starrocks) page.
@@ -223,6 +226,7 @@ Following tables show whether a given query is supported on specific query engin
|**PrestoDB**|Y|N|
|**Trino**|Y|N|
|**Impala**|Y|N|
+| **Redshift Spectrum** |Y|N|
| **StarRocks** |Y|N|
diff --git a/website/versioned_docs/version-0.11.0/query_engine_setup.md b/website/versioned_docs/version-0.11.0/query_engine_setup.md
index 10d1bb18e7..a2d541a7ec 100644
--- a/website/versioned_docs/version-0.11.0/query_engine_setup.md
+++ b/website/versioned_docs/version-0.11.0/query_engine_setup.md
@@ -72,8 +72,18 @@ In addition to setup above, for beeline cli access, the `hive.input.format` vari
inputformat `org.apache.hudi.hadoop.HoodieParquetInputFormat`. For Tez, additionally the `hive.tez.input.format` needs to be set
to `org.apache.hadoop.hive.ql.io.HiveInputFormat`. Then proceed to query the table like any other Hive table.
+## Redshift Spectrum
+Copy on Write Tables in Apache Hudi versions 0.5.2, 0.6.0, 0.7.0, 0.8.0, 0.9.0, 0.10.x, 0.11.x and 0.12.0 can be queried via Amazon Redshift Spectrum external tables.
+To be able to query Hudi versions 0.10.0 and above please try latest versions of Redshift.
+:::note
+Hudi tables are supported only when AWS Glue Data Catalog is used. It's not supported when you use an Apache Hive metastore as the external catalog.
+:::
+
+Please refer to [Redshift Spectrum Integration with Apache Hudi](https://docs.aws.amazon.com/redshift/latest/dg/c-spectrum-external-tables.html#c-spectrum-column-mapping-hudi)
+for more details.
+
## StarRocks
Copy on Write tables in Apache Hudi 0.10.0 and above can be queried via StarRocks external tables from StarRocks version 2.2.0.
Only snapshot queries are supported currently. In future releases Merge on Read tables will also be supported.
Please refer to [StarRocks Hudi external table](https://docs.starrocks.com/en-us/2.2/using_starrocks/External_table#hudi-external-table)
-for more details on the setup.
\ No newline at end of file
+for more details on the setup.
diff --git a/website/versioned_docs/version-0.11.0/querying_data.md b/website/versioned_docs/version-0.11.0/querying_data.md
index aa4b252f82..e07d54ce43 100644
--- a/website/versioned_docs/version-0.11.0/querying_data.md
+++ b/website/versioned_docs/version-0.11.0/querying_data.md
@@ -205,6 +205,9 @@ After Hudi made a new commit, refresh the Impala table to get the latest results
REFRESH database.table_name
```
+## Redshift Spectrum
+To set up Redshift Spectrum for querying Hudi, see the [Query Engine Setup](/docs/0.11.0/query_engine_setup#redshift-spectrum) page.
+
## StarRocks
To set up StarRocks for querying Hudi, see the [Query Engine Setup](/docs/0.11.0/query_engine_setup#starrocks) page.
@@ -223,6 +226,7 @@ Following tables show whether a given query is supported on specific query engin
|**PrestoDB**|Y|N|
|**Trino**|Y|N|
|**Impala**|Y|N|
+| **Redshift Spectrum** |Y|N|
| **StarRocks** |Y|N|
diff --git a/website/versioned_docs/version-0.11.1/query_engine_setup.md b/website/versioned_docs/version-0.11.1/query_engine_setup.md
index 10d1bb18e7..a2d541a7ec 100644
--- a/website/versioned_docs/version-0.11.1/query_engine_setup.md
+++ b/website/versioned_docs/version-0.11.1/query_engine_setup.md
@@ -72,8 +72,18 @@ In addition to setup above, for beeline cli access, the `hive.input.format` vari
inputformat `org.apache.hudi.hadoop.HoodieParquetInputFormat`. For Tez, additionally the `hive.tez.input.format` needs to be set
to `org.apache.hadoop.hive.ql.io.HiveInputFormat`. Then proceed to query the table like any other Hive table.
+## Redshift Spectrum
+Copy on Write Tables in Apache Hudi versions 0.5.2, 0.6.0, 0.7.0, 0.8.0, 0.9.0, 0.10.x, 0.11.x and 0.12.0 can be queried via Amazon Redshift Spectrum external tables.
+To be able to query Hudi versions 0.10.0 and above please try latest versions of Redshift.
+:::note
+Hudi tables are supported only when AWS Glue Data Catalog is used. It's not supported when you use an Apache Hive metastore as the external catalog.
+:::
+
+Please refer to [Redshift Spectrum Integration with Apache Hudi](https://docs.aws.amazon.com/redshift/latest/dg/c-spectrum-external-tables.html#c-spectrum-column-mapping-hudi)
+for more details.
+
## StarRocks
Copy on Write tables in Apache Hudi 0.10.0 and above can be queried via StarRocks external tables from StarRocks version 2.2.0.
Only snapshot queries are supported currently. In future releases Merge on Read tables will also be supported.
Please refer to [StarRocks Hudi external table](https://docs.starrocks.com/en-us/2.2/using_starrocks/External_table#hudi-external-table)
-for more details on the setup.
\ No newline at end of file
+for more details on the setup.
diff --git a/website/versioned_docs/version-0.11.1/querying_data.md b/website/versioned_docs/version-0.11.1/querying_data.md
index c9778c6b0e..a7a8a6c7ab 100644
--- a/website/versioned_docs/version-0.11.1/querying_data.md
+++ b/website/versioned_docs/version-0.11.1/querying_data.md
@@ -204,6 +204,8 @@ After Hudi made a new commit, refresh the Impala table to get the latest results
```
REFRESH database.table_name
```
+## Redshift Spectrum
+To set up Redshift Spectrum for querying Hudi, see the [Query Engine Setup](/docs/0.11.1/query_engine_setup#redshift-spectrum) page.
## StarRocks
@@ -224,6 +226,7 @@ Following tables show whether a given query is supported on specific query engin
|**PrestoDB**|Y|N|
|**Trino**|Y|N|
|**Impala**|Y|N|
+| **Redshift Spectrum** |Y|N|
| **StarRocks** |Y|N|
diff --git a/website/versioned_docs/version-0.12.0/query_engine_setup.md b/website/versioned_docs/version-0.12.0/query_engine_setup.md
index c6b472e513..a581337d0d 100644
--- a/website/versioned_docs/version-0.12.0/query_engine_setup.md
+++ b/website/versioned_docs/version-0.12.0/query_engine_setup.md
@@ -92,7 +92,8 @@ to `org.apache.hadoop.hive.ql.io.HiveInputFormat`. Then proceed to query the tab
## Redshift Spectrum
-Copy on Write Tables in Apache Hudi versions 0.5.2, 0.6.0, 0.7.0, 0.8.0, 0.9.0, and 0.10.0 can be queried via Amazon Redshift Spectrum external tables.
+Copy on Write Tables in Apache Hudi versions 0.5.2, 0.6.0, 0.7.0, 0.8.0, 0.9.0, 0.10.x, 0.11.x and 0.12.0 can be queried via Amazon Redshift Spectrum external tables.
+To be able to query Hudi versions 0.10.0 and above please try latest versions of Redshift.
:::note
Hudi tables are supported only when AWS Glue Data Catalog is used. It's not supported when you use an Apache Hive metastore as the external catalog.
:::
diff --git a/website/versioned_docs/version-0.12.0/querying_data.md b/website/versioned_docs/version-0.12.0/querying_data.md
index 215a56d507..e2a4782f04 100644
--- a/website/versioned_docs/version-0.12.0/querying_data.md
+++ b/website/versioned_docs/version-0.12.0/querying_data.md
@@ -267,7 +267,7 @@ REFRESH database.table_name
```
## Redshift Spectrum
-To set up Redshift Spectrum for querying Hudi, see the [Query Engine Setup](/docs/next/query_engine_setup#redshift-spectrum) page.
+To set up Redshift Spectrum for querying Hudi, see the [Query Engine Setup](/docs/query_engine_setup#redshift-spectrum) page.
## StarRocks
diff --git a/website/versioned_docs/version-0.5.2/querying_data.md b/website/versioned_docs/version-0.5.2/querying_data.md
index fdf3b67fac..7887c888e1 100644
--- a/website/versioned_docs/version-0.5.2/querying_data.md
+++ b/website/versioned_docs/version-0.5.2/querying_data.md
@@ -201,7 +201,8 @@ After Hudi made a new commit, refresh the Impala table to get the latest results
REFRESH database.table_name
```
## Redshift Spectrum
-Copy on Write Tables in Apache Hudi versions 0.5.2, 0.6.0, 0.7.0, 0.8.0, 0.9.0, and 0.10.0 can be queried via Amazon Redshift Spectrum external tables.
+Copy on Write Tables in Apache Hudi versions 0.5.2, 0.6.0, 0.7.0, 0.8.0, 0.9.0, 0.10.x, 0.11.x and 0.12.0 can be queried via Amazon Redshift Spectrum external tables.
+To be able to query Hudi versions 0.10.0 and above please try latest versions of Redshift.
:::note
Hudi tables are supported only when AWS Glue Data Catalog is used. It's not supported when you use an Apache Hive metastore as the external catalog.
:::
diff --git a/website/versioned_docs/version-0.6.0/querying_data.md b/website/versioned_docs/version-0.6.0/querying_data.md
index 5735713c59..412be1c38a 100644
--- a/website/versioned_docs/version-0.6.0/querying_data.md
+++ b/website/versioned_docs/version-0.6.0/querying_data.md
@@ -221,7 +221,8 @@ After Hudi made a new commit, refresh the Impala table to get the latest results
REFRESH database.table_name
```
## Redshift Spectrum
-Copy on Write Tables in Apache Hudi versions 0.5.2, 0.6.0, 0.7.0, 0.8.0, 0.9.0, and 0.10.0 can be queried via Amazon Redshift Spectrum external tables.
+Copy on Write Tables in Apache Hudi versions 0.5.2, 0.6.0, 0.7.0, 0.8.0, 0.9.0, 0.10.x, 0.11.x and 0.12.0 can be queried via Amazon Redshift Spectrum external tables.
+To be able to query Hudi versions 0.10.0 and above please try latest versions of Redshift.
:::note
Hudi tables are supported only when AWS Glue Data Catalog is used. It's not supported when you use an Apache Hive metastore as the external catalog.
:::
diff --git a/website/versioned_docs/version-0.7.0/querying_data.md b/website/versioned_docs/version-0.7.0/querying_data.md
index f97e0df504..8d227dc7bc 100644
--- a/website/versioned_docs/version-0.7.0/querying_data.md
+++ b/website/versioned_docs/version-0.7.0/querying_data.md
@@ -221,7 +221,8 @@ After Hudi made a new commit, refresh the Impala table to get the latest results
REFRESH database.table_name
```
## Redshift Spectrum
-Copy on Write Tables in Apache Hudi versions 0.5.2, 0.6.0, 0.7.0, 0.8.0, 0.9.0, and 0.10.0 can be queried via Amazon Redshift Spectrum external tables.
+Copy on Write Tables in Apache Hudi versions 0.5.2, 0.6.0, 0.7.0, 0.8.0, 0.9.0, 0.10.x, 0.11.x and 0.12.0 can be queried via Amazon Redshift Spectrum external tables.
+To be able to query Hudi versions 0.10.0 and above please try latest versions of Redshift.
:::note
Hudi tables are supported only when AWS Glue Data Catalog is used. It's not supported when you use an Apache Hive metastore as the external catalog.
:::
diff --git a/website/versioned_docs/version-0.8.0/querying_data.md b/website/versioned_docs/version-0.8.0/querying_data.md
index ad929a6150..75df56f2b5 100644
--- a/website/versioned_docs/version-0.8.0/querying_data.md
+++ b/website/versioned_docs/version-0.8.0/querying_data.md
@@ -264,7 +264,8 @@ After Hudi made a new commit, refresh the Impala table to get the latest results
REFRESH database.table_name
```
## Redshift Spectrum
-Copy on Write Tables in Apache Hudi versions 0.5.2, 0.6.0, 0.7.0, 0.8.0, 0.9.0, and 0.10.0 can be queried via Amazon Redshift Spectrum external tables.
+Copy on Write Tables in Apache Hudi versions 0.5.2, 0.6.0, 0.7.0, 0.8.0, 0.9.0, 0.10.x, 0.11.x and 0.12.0 can be queried via Amazon Redshift Spectrum external tables.
+To be able to query Hudi versions 0.10.0 and above please try latest versions of Redshift.
:::note
Hudi tables are supported only when AWS Glue Data Catalog is used. It's not supported when you use an Apache Hive metastore as the external catalog.
:::
diff --git a/website/versioned_docs/version-0.9.0/querying_data.md b/website/versioned_docs/version-0.9.0/querying_data.md
index 8cb50d210a..ede7d04f4d 100644
--- a/website/versioned_docs/version-0.9.0/querying_data.md
+++ b/website/versioned_docs/version-0.9.0/querying_data.md
@@ -277,7 +277,8 @@ After Hudi made a new commit, refresh the Impala table to get the latest results
REFRESH database.table_name
```
## Redshift Spectrum
-Copy on Write Tables in Apache Hudi versions 0.5.2, 0.6.0, 0.7.0, 0.8.0, 0.9.0, and 0.10.0 can be queried via Amazon Redshift Spectrum external tables.
+Copy on Write Tables in Apache Hudi versions 0.5.2, 0.6.0, 0.7.0, 0.8.0, 0.9.0, 0.10.x, 0.11.x and 0.12.0 can be queried via Amazon Redshift Spectrum external tables.
+To be able to query Hudi versions 0.10.0 and above please try latest versions of Redshift.
:::note
Hudi tables are supported only when AWS Glue Data Catalog is used. It's not supported when you use an Apache Hive metastore as the external catalog.
:::