You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@streampark.apache.org by "zzzk1 (via GitHub)" <gi...@apache.org> on 2024/01/21 12:48:38 UTC
[PR] [Feature] [Sql Gateway][WIP] Implement flink catalog use mysql as metadata store backend [incubator-streampark]
zzzk1 opened a new pull request, #3504:
URL: https://github.com/apache/incubator-streampark/pull/3504
<!--
Thank you for contributing to StreamPark! Please make sure that your code changes
are covered with tests. And in case of new features or big changes
remember to adjust the documentation.
## Contribution Checklist
- If this is your first time, please read our contributor guidelines: [Submit Code](https://streampark.apache.org/community/submit_guide/submit_code).
- Make sure that the pull request corresponds to a [GITHUB issue](https://github.com/apache/incubator-streampark/issues).
- Name the pull request in the form "[Feature] Title of the pull request", where *Feature* can be replaced by `Hotfix`, `Bug`, etc.
- Fill out the template below to describe the changes contributed by the pull request. That will give reviewers the context they need to do the review.
- If the PR is unfinished, add `[WIP]` in your PR title, e.g., `[WIP][Feature] Title of the pull request`.
-->
## What changes were proposed in this pull request
Issue Number: close #2888<!-- REMOVE this line if no issue to close -->
**Implement flink catalog use mysql as metadata store backend**
<!--(For example: This pull request proposed to add checkstyle plugin).-->
## Brief change log
<!--*(for example:)*
- *Add maven-checkstyle-plugin to root pom.xml*
-->
Add MySQL table schema
## Verifying this change
<!--*(Please pick either of the following options)*-->
This change is a trivial rework / code cleanup without any test coverage.
*(or)*
This change is already covered by existing tests, such as *(please describe tests)*.
*(or)*
This change added tests and can be verified as follows:
<!--*(example:)*
- *Added integration tests for end-to-end.*
- *Added *Test to verify the change.*
- *Manually verified the change by testing locally.* -->
## Does this pull request potentially affect one of the following parts
- Dependencies (does it add or upgrade a dependency): (no)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [Feature] [Sql Gateway][WIP] Implement flink catalog use mysql as metadata store backend [incubator-streampark]
Posted by "zzzk1 (via GitHub)" <gi...@apache.org>.
zzzk1 commented on PR #3504:
URL: https://github.com/apache/incubator-streampark/pull/3504#issuecomment-1902618829
@wolfboys pls take a look
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [Feature] [Sql Gateway][WIP] Implement flink catalog use mysql as metadata store backend [incubator-streampark]
Posted by "zzzk1 (via GitHub)" <gi...@apache.org>.
zzzk1 commented on PR #3504:
URL: https://github.com/apache/incubator-streampark/pull/3504#issuecomment-1902618651
### **This table is used to store all Catalogs**
eg: **MySQLCatalog**, **PGCatalog**, **HiveCatalog**
```sql
CREATE TABLE t_catalog(
`id` bigint auto_increment NOT NULL,
`catalog_name` varchar(10) NOT NULL comment 'catalog name',
`catalog_type` varchar(10) NOT NULL comment '1.jdbc 2.hive',
`default_database` varchar(50) NOT NULL,
`username` varchar(50),
`password` varchar(50),
`base-url` varchar(100) comment 'jdbc connection',
`hive-conf-dir` varchar(100) comment 'hive config path',
`create_time` datetime DEFAULT CURRENT_TIMESTAMP NOT NULL,
`update_time` datetime DEFAULT CURRENT_TIMESTAMP NOT NULL,
primary key (`id`) using btree
)engine=innodb auto_increment=100000 default charset=utf8mb4 collate=utf8mb4_general_ci;
```
### **This table is used to store the database managed in Catalog**
```sql
CREATE TABLE t_catalog_databases (
`id` bigint auto_increment NOT NULL,
`catalog_id` bigint NOT NULL,
`database_name` varchar(100) NOT NULL comment 'databbase name in catalog',
`create_time` datetime DEFAULT CURRENT_TIMESTAMP NOT NULL,
`update_time` datetime DEFAULT CURRENT_TIMESTAMP NOT NULL,
primary key (`id`) using btree
)engine=innodb auto_increment=100000 default charset=utf8mb4 collate=utf8mb4_general_ci;
```
### **This table is used to store tables managed in Catalog**
```sql
CREATE TABLE t_catalog_tables (
`id` bigint auto_increment NOT NULL,
`catalog_id` bigint NOT NULL,
`catalog_database_id` bigint NOT NULL,
`table_name` varchar(100) NOT NULL comment 'table name in database',
`create_time` datetime DEFAULT CURRENT_TIMESTAMP NOT NULL,
`update_time` datetime DEFAULT CURRENT_TIMESTAMP NOT NULL,
primary key (`id`) using btree
)engine=innodb auto_increment=100000 default charset=utf8mb4 collate=utf8mb4_general_ci;
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [Feature] [Sql Gateway][WIP] Implement flink catalog use mysql as metadata store backend [incubator-streampark]
Posted by "wolfboys (via GitHub)" <gi...@apache.org>.
wolfboys commented on PR #3504:
URL: https://github.com/apache/incubator-streampark/pull/3504#issuecomment-1902621547
cc @GOODBOY008 Can you review this feature? BTW https://github.com/apache/incubator-streampark/issues/2274 is also about the proposal for sqlgateway. It's time for us to move that proposal forward. 💪
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [Feature] [Sql Gateway][WIP] Implement flink catalog use mysql as metadata store backend [incubator-streampark]
Posted by "zzzk1 (via GitHub)" <gi...@apache.org>.
zzzk1 closed pull request #3504: [Feature] [Sql Gateway][WIP] Implement flink catalog use mysql as metadata store backend
URL: https://github.com/apache/incubator-streampark/pull/3504
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org