You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "sagarlakshmipathy (via GitHub)" <gi...@apache.org> on 2023/11/29 01:15:38 UTC
[PR] Update SQL Queries compatibility matrix [hudi]
sagarlakshmipathy opened a new pull request, #10202:
URL: https://github.com/apache/hudi/pull/10202
### Change Logs
Update SQL Queries compatibility matrix
Redshift spectrum support Hudi MOR RO tables but doesn't support Snapshot and Incremental queries.
StarRocks support MOR RO and Snapshot queries, but doesn't support Incremental queries.
### Impact
Doc update.
### Risk level (write none, low medium or high below)
MINOR Doc update.
### Documentation Update
Doc update.
### Contributor's checklist
- [x] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
- [x] Change Logs and Impact were stated clearly
- [x] Adequate tests were added if applicable - `npm run build` and `npm run serve` ran successfully
- [NA] CI passed - CI runs after raising PR
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [MINOR] [DOCS] Update SQL Queries compatibility matrix [hudi]
Posted by "bhasudha (via GitHub)" <gi...@apache.org>.
bhasudha commented on code in PR #10202:
URL: https://github.com/apache/hudi/pull/10202#discussion_r1417208639
##########
website/versioned_docs/version-0.14.0/sql_queries.md:
##########
@@ -354,37 +354,37 @@ Following tables show whether a given query is supported on specific query engin
### Copy-On-Write tables
-| Query Engine |Snapshot Queries|Incremental Queries|
-|-----------------------|--------|-----------|
-| **Hive** |Y|Y|
-| **Spark SQL** |Y|Y|
-| **Flink SQL** |Y|N|
-| **PrestoDB** |Y|N|
-| **Trino** |Y|N|
-| **AWS Athena** |Y|N|
-| **BigQuery** |Y|N|
-| **Impala** |Y|N|
-| **Redshift Spectrum** |Y|N|
-| **Doris** |Y|N|
-| **StarRocks** |Y|N|
-| **ClickHouse** |Y|N|
+| Query Engine | Snapshot Queries | Incremental Queries |
+|-----------------------|------------------|---------------------|
+| **Hive** | Y | Y |
+| **Spark SQL** | Y | Y |
+| **Flink SQL** | Y | N |
+| **PrestoDB** | Y | N |
+| **Trino** | Y | N |
+| **AWS Athena** | Y | N |
+| **BigQuery** | Y | N |
+| **Impala** | Y | N |
+| **Redshift Spectrum** | Y | N |
+| **Doris** | Y | N |
+| **StarRocks** | Y | N |
+| **ClickHouse** | Y | N |
### Merge-On-Read tables
-| Query Engine |Snapshot Queries|Incremental Queries|Read Optimized Queries|
-|---------------------|--------|-----------|--------------|
-| **Hive** |Y|Y|Y|
-| **Spark SQL** |Y|Y|Y|
-| **Spark Datasource** |Y|Y|Y|
-| **Flink SQL** |Y|Y|Y|
-| **PrestoDB** |Y|N|Y|
-| **AWS Athena** |Y|N|Y|
-| **Big Query** |Y|N|Y|
-| **Trino** |N|N|Y|
-| **Impala** |N|N|Y|
-| **Redshift Spectrum** |N|N|N|
-| **Doris** |N|N|N|
-| **StarRocks** |N|N|N|
Review Comment:
I believe we need to make two changes:
- update this matrix for previous versions as well.
- Also update the link in individual subsection - https://hudi.apache.org/docs/next/sql_queries#starrocks . The link seems to be broken now due to update on starrocks docs. We may want to clarify in starrocls section that both COW and MOR are supported. This also needs to be updated across previous versions.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [MINOR] [DOCS] Update SQL Queries compatibility matrix [hudi]
Posted by "sagarlakshmipathy (via GitHub)" <gi...@apache.org>.
sagarlakshmipathy closed pull request #10202: [MINOR] [DOCS] Update SQL Queries compatibility matrix
URL: https://github.com/apache/hudi/pull/10202
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [MINOR] [DOCS] Update SQL Queries compatibility matrix [hudi]
Posted by "bhasudha (via GitHub)" <gi...@apache.org>.
bhasudha commented on code in PR #10202:
URL: https://github.com/apache/hudi/pull/10202#discussion_r1417206019
##########
website/versioned_docs/version-0.14.0/sql_queries.md:
##########
@@ -354,37 +354,37 @@ Following tables show whether a given query is supported on specific query engin
### Copy-On-Write tables
-| Query Engine |Snapshot Queries|Incremental Queries|
-|-----------------------|--------|-----------|
-| **Hive** |Y|Y|
-| **Spark SQL** |Y|Y|
-| **Flink SQL** |Y|N|
-| **PrestoDB** |Y|N|
-| **Trino** |Y|N|
-| **AWS Athena** |Y|N|
-| **BigQuery** |Y|N|
-| **Impala** |Y|N|
-| **Redshift Spectrum** |Y|N|
-| **Doris** |Y|N|
-| **StarRocks** |Y|N|
-| **ClickHouse** |Y|N|
+| Query Engine | Snapshot Queries | Incremental Queries |
+|-----------------------|------------------|---------------------|
+| **Hive** | Y | Y |
+| **Spark SQL** | Y | Y |
+| **Flink SQL** | Y | N |
+| **PrestoDB** | Y | N |
+| **Trino** | Y | N |
+| **AWS Athena** | Y | N |
+| **BigQuery** | Y | N |
+| **Impala** | Y | N |
+| **Redshift Spectrum** | Y | N |
+| **Doris** | Y | N |
+| **StarRocks** | Y | N |
+| **ClickHouse** | Y | N |
### Merge-On-Read tables
-| Query Engine |Snapshot Queries|Incremental Queries|Read Optimized Queries|
-|---------------------|--------|-----------|--------------|
-| **Hive** |Y|Y|Y|
-| **Spark SQL** |Y|Y|Y|
-| **Spark Datasource** |Y|Y|Y|
-| **Flink SQL** |Y|Y|Y|
-| **PrestoDB** |Y|N|Y|
-| **AWS Athena** |Y|N|Y|
-| **Big Query** |Y|N|Y|
-| **Trino** |N|N|Y|
-| **Impala** |N|N|Y|
-| **Redshift Spectrum** |N|N|N|
Review Comment:
Can we update for previous versions as well ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [MINOR] [DOCS] Update SQL Queries compatibility matrix [hudi]
Posted by "bhasudha (via GitHub)" <gi...@apache.org>.
bhasudha commented on PR #10202:
URL: https://github.com/apache/hudi/pull/10202#issuecomment-1842780869
Thanks for taking care of this @sagarlakshmipathy . I left few comments. Please also update the individual sections within the queries page to reflect uptodate information.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org