You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@shardingsphere.apache.org by GitBox <gi...@apache.org> on 2022/12/15 10:42:26 UTC

[GitHub] [shardingsphere] strongduanmu opened a new issue, #22887: Startup & `REGISTER STORAGE UNIT` metadata loading logic optimize

strongduanmu opened a new issue, #22887:
URL: https://github.com/apache/shardingsphere/issues/22887

   ## Background
   
   At present, when community users use ShardingSphere, they report that due to the large number of managed data sources, a large number of single tables are loaded into the memory by default, resulting in slower startup speed and taking up more memory space.
   
   Considering that in the data source registered by the user, there are a large number of single tables that do not need to be used or managed by ShardingSphere, so it is necessary to design a mechanism that allows users to actively import single tables on demand, avoiding automatic Load single table metadata.
   
   ## Metadata loading logic optimization
   
   ```yaml
   # YAML configuration
   databaseName: sharding_db
   
   - !SINGLE
     tables:
       - ds_0.t_single
       # PostgreSQL, openGauss support multiple schemas
       - ds_1.public.t_config,ds_1.test.t_config
       - ds_2.*
       - ds_3.*
       - *.*
     # controls CREATE TABLE routing, required in DistSQL
     defaultDataSource: ds_0
     
   # ZK structure (the original YAML will be loaded into a single table and then expanded and stored)
   - !SINGLE
     tables:
       - ds_0.t_single
       # PostgreSQL, openGauss support multiple schemas
       - ds_1.public.t_config,ds_1.test.t_config
       - ds_2.t_1,ds_2.t_2
       - ds_3.t_3,ds_3.t_4
       - ds_4.t_5,ds_4.t_6
     # controls CREATE TABLE routing, required in DistSQL
     defaultDataSource: ds_0
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@shardingsphere.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [shardingsphere] strongduanmu commented on issue #22887: Startup & `REGISTER STORAGE UNIT` metadata loading logic optimize

Posted by GitBox <gi...@apache.org>.
strongduanmu commented on issue #22887:
URL: https://github.com/apache/shardingsphere/issues/22887#issuecomment-1354024007

   > 
   
   Yes, they look the same. But how do we show the unloaded single table?
   
   Will this be the final DistSQL?
   
   ```sql
   SHOW SINGLE TABLES
   SHOW UNLOADED SINGLE TABLES
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@shardingsphere.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [shardingsphere] boyjoy1127 commented on issue #22887: Startup & `REGISTER STORAGE UNIT` metadata loading logic optimize

Posted by "boyjoy1127 (via GitHub)" <gi...@apache.org>.
boyjoy1127 commented on issue #22887:
URL: https://github.com/apache/shardingsphere/issues/22887#issuecomment-1585969472

   Will this issue be completed before June 15 which is the final date of version 5.4.0?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@shardingsphere.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [shardingsphere] RaigorJiang commented on issue #22887: Startup & `REGISTER STORAGE UNIT` metadata loading logic optimize

Posted by GitBox <gi...@apache.org>.
RaigorJiang commented on issue #22887:
URL: https://github.com/apache/shardingsphere/issues/22887#issuecomment-1354112339

   > > 
   > 
   > Yes, they look the same. But how do we show the unloaded single table?
   > 
   > Will this be the final DistSQL?
   > 
   > ```sql
   > SHOW SINGLE TABLES
   > SHOW UNLOADED SINGLE TABLES
   > ```
   
   I think so.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@shardingsphere.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [shardingsphere] zhaojinchao95 closed issue #22887: Startup & `REGISTER STORAGE UNIT` metadata loading logic optimize

Posted by "zhaojinchao95 (via GitHub)" <gi...@apache.org>.
zhaojinchao95 closed issue #22887: Startup & `REGISTER STORAGE UNIT` metadata loading logic optimize
URL: https://github.com/apache/shardingsphere/issues/22887


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@shardingsphere.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [shardingsphere] RaigorJiang commented on issue #22887: Startup & `REGISTER STORAGE UNIT` metadata loading logic optimize

Posted by GitBox <gi...@apache.org>.
RaigorJiang commented on issue #22887:
URL: https://github.com/apache/shardingsphere/issues/22887#issuecomment-1353454156

   Hi @strongduanmu 
   Maybe the function of `SHOW LOADED SINGLE TABLES` is duplicated with `SHOW SINGLE TABLES`?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@shardingsphere.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [shardingsphere] RaigorJiang commented on issue #22887: Startup & `REGISTER STORAGE UNIT` metadata loading logic optimize

Posted by "RaigorJiang (via GitHub)" <gi...@apache.org>.
RaigorJiang commented on issue #22887:
URL: https://github.com/apache/shardingsphere/issues/22887#issuecomment-1586078066

   > Will this issue be completed before June 15 which is the final date of version 5.4.0?
   
   Yes.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@shardingsphere.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org