You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@shardingsphere.apache.org by GitBox <gi...@apache.org> on 2020/06/23 12:41:22 UTC

[GitHub] [shardingsphere] 18511699755 opened a new issue #6179: max.connections.size.per.query affects database performance

18511699755 opened a new issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179


   There are 7000 tables in the test target library, and the default value will start slowly, and the high setting value will lead to the soaring cpu and iops of the database


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] 18511699755 commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
18511699755 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-650922611


   okay, thank you


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] 18511699755 commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
18511699755 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-650971258


   The performance of the machine where the program is located is no problem, and the configuration of the daily database may be lower.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] tuohai666 commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
tuohai666 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651038025


   > The local delay is relatively high within 20ms, so I will apply for a daily machine and test it again.
   
   OK. Wait for your response. When you start the test, please record the load of servers for both MySQL and ShardingSphere.
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] hand515 commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
hand515 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651127413


   According to mysql jdbc driver(mysql-connector-java:5.1.34) , load metadata will execute 4 sql (use wireshark to capture)
   ```
   TableMetaDataLoader.isTableExists
   1. show full tables from db_name like '%'   
   
   ColumnMetaDataLoader
   1. show full columns from table_name.
   2. select * from table_name where 1!=1
   IndexMetaDataLoader
   1. show index from table_name
   
   ```
   
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] hand515 commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
hand515 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651028620


   ```
   [INFO ColumnMetaDataLoader:84] - load column metadata for table=t1 use 192.2264ms
   [INFO IndexMetaDataLoader:62] - load index metadata for table=t1 use 38.0993ms
   [INFO ColumnMetaDataLoader:84] - load column metadata for table=t2 use 392.8141ms
   [INFO IndexMetaDataLoader:62] - load index metadata for table=t2 use 37.5664ms
   [INFO ColumnMetaDataLoader:84] - load column metadata for table=t3 use 267.1177ms
   [INFO IndexMetaDataLoader:62] - load index metadata for table=t3 use 38.5584ms
   [INFO ColumnMetaDataLoader:84] - load column metadata for table=t4 use 500.384ms
   [INFO IndexMetaDataLoader:62] - load index metadata for table=t4 use 38.3369ms
   ```
   
   Using 5.0-RC1 -SNAPSHOT, add some metric code in ColumnMetaDataLoader.load and IndexMetaDataLoader.load.
   
   The time is not related to the number of columns .
   
   Properties:
   ```
   max.connections.size.per.query: '10'
   sql.show: 'true'
   check.table.metadata.enabled: 'false'
   ```
   
   Client pings to db server: 29ms
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] tuohai666 commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
tuohai666 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-650942958


   Hi @18511699755 
   1. Please provide your hardware environment. 
   2. And check is there any other service running on this machine.
   
   Please don't just ignore my question, the answer is also important reference to me.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] tuohai666 commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
tuohai666 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651087811


   Compare to 
   `2020-06-24 11:58:01.251 INFO 61443 --- [ main] ShardingSphere-metadata : Meta data load finished, cost 1222709 milliseconds.
   `
   What's the cost this time?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] tuohai666 commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
tuohai666 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-650890486


   Actually, we don't expect 1222709 milliseconds for meta data loading for 7169 tables.
   Time cost for one query: 1222709/7169 = 170ms
   IMO, this kind of query usually cost 1~2ms or even less.
   
   There're two possibilities:
   1. There's bug in ShardingSphere. I'll double check.
   2. You machine is two slow. Please provide your hardware environment. And check is there any other service running on this machine.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] tuohai666 commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
tuohai666 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-652763557


   Duplicate with https://github.com/apache/shardingsphere/issues/6212 .


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] 18511699755 commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
18511699755 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-650964619


   There are also services that use this database, but monitoring has little impact on performance.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] 18511699755 commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
18511699755 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651086268


   The average server load in ShardingSphere is around 1.1


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] tuohai666 edited a comment on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
tuohai666 edited a comment on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-650890486


   Actually, we don't expect 1222709 milliseconds for meta data loading for 7169 tables.
   Time cost for one query: 1222709/7169 = 170ms
   IMO, this kind of query usually cost 1~2ms or even less.
   
   There're two possibilities:
   1. There's bug in ShardingSphere. I'll double check.
   2. You machine is too slow. Please provide your hardware environment. And check is there any other service running on this machine.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] tuohai666 commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
tuohai666 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651173667


   Yes, will exist in next release.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] tuohai666 commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
tuohai666 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651136146


   @hand515 There are 3 more:
   ![image](https://user-images.githubusercontent.com/24643893/86014328-c4cbda00-ba52-11ea-93ee-525db294400d.png)
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] 18511699755 commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
18511699755 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651020856


   The local delay is relatively high within 20ms, so I will apply for a daily machine and test it again.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] tuohai666 commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
tuohai666 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651086450


   What's the total time this time?
   Set the property spring.shardingsphere.props.max.connections.size.per.query to 1/2/4/8/16/32/64, record the log and show me the total time.
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] 18511699755 commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
18511699755 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-650700051


   Do you mean a machine where the application is located or a database machine?
   There are 6 machines in our production environment, but there is only one database instance, and 7169 tables will be used in the production environment.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] 18511699755 commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
18511699755 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-650970102


   Yes, the machine on which the program runs is mac, but the database is a database instance based on Alibaba Cloud.
   The machine load is below 2.0.
   mac os 6 core 16G.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] tristaZero commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
tristaZero commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-698199538


   Hi @hand515 @18511699755 ,
   
   I am sorry to give my comment late. The good news that the performance of starting ShardingProxy has been greatly improved already! Thanks for @xbkaishui, who took much effort in #6212.
   
   Presently, welcome your any test for the `master branch` (Package it local firstly). Your feedback will be the best gift for the community.
   
   Best,
   Trista


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] 18511699755 commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
18511699755 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-650728161


   That is, if there are 7169 tables, do you need to use multiple instances (machines) in the database? If so, the cost may be higher. Is there any other solution?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] 18511699755 commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
18511699755 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651081701


   load average: 1.27, 0.51, 0.22
   The load of the machine where the application is located is about 35ms.
   Machine and database delay is about 0.09ms


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] tuohai666 commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
tuohai666 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651084167


   What's the load average for? MySQL or ShardingSphere? Please record the load of servers for both MySQL and ShardingSphere.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] tuohai666 commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
tuohai666 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651122681


   I have captured some packets and studied the codes. There're 7 SQLs sent to MySQL every table for meta data purpose. In your case, there're 7 * 7169 = 50183 SQLs to be executed. The average response time is 258084 / 50183 = 5 ms. It's slow but acceptable if your server has only 4 cores.
   
   The conclusion is that you can adjust spring.shardingsphere.props.max.connections.size.per.query to a suitable value to make the initialization faster without full load. Meanwhile, I will try to reduce the interaction times during meta data procedure.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] tuohai666 commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
tuohai666 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-648161735


   1. Have you closed check.table.metadata.enabled property?
   2. How many databases and hosts hold that 7000 tables?
   3. Please show the detail configurations of ShardingSphere.
   4. Please fill in the template following.
   
   ## Bug Report
   
   **For English only**, other languages will not accept.
   
   Before report a bug, make sure you have:
   
   - Searched open and closed [GitHub issues](https://github.com/apache/shardingsphere/issues).
   - Read documentation: [ShardingSphere Doc](https://shardingsphere.apache.org/document/current/en/overview).
   
   Please pay attention on issues you submitted, because we maybe need more details. 
   If no response anymore and we cannot reproduce it on current information, we will **close it**.
   
   Please answer these questions before submitting your issue. Thanks!
   
   ### Which version of ShardingSphere did you use?
   
   ### Which project did you use? ShardingSphere-JDBC or ShardingSphere-Proxy?
   
   ### Expected behavior
   
   ### Actual behavior
   
   ### Reason analyze (If you can)
   
   ### Steps to reproduce the behavior, such as: SQL to execute, sharding rule configuration, when exception occur etc.
   
   ### Example codes for reproduce this issue (such as a github link).
   
    
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] tuohai666 commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
tuohai666 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-650702299


   I mean database machine.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] 18511699755 removed a comment on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
18511699755 removed a comment on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651081701


   load average: 1.27, 0.51, 0.22
   The load of the machine where the application is located is about 35ms.
   Machine and database delay is about 0.09ms


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] 18511699755 commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
18511699755 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651096863


   Set the property spring.shardingsphere.props.max.connections.size.per.query to 64,  database load is basically running at full load, and the cpu is full


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] 18511699755 commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
18511699755 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651079940


   load average: 1.27, 0.51, 0.22
   ShardingSphere-metadata - rt : 34ms


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] 18511699755 commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
18511699755 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651153939


   Well, I'll try debugging. Will the optimization you mentioned be iterated in subsequent versions?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] 18511699755 commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
18511699755 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-650963959


   Type of database: MySQL 5.7
   Cpu: 4 cores
   Database memory: 16384MB
   
   The application machine mac os 10.15.3
   
   At present, debug found this exception, and the source code exception was ignore.
   java.sql.SQLFeatureNotSupportedException
   	at com.alibaba.druid.pool.DruidPooledConnection.getSchema(DruidPooledConnection.java:1191)
   	at org.apache.shardingsphere.sql.parser.binder.metadata.util.JdbcUtil.getSchema(JdbcUtil.java:41)
   
   Every time I load metadata, I log it, and the time is between 90ms and 400ms


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] 18511699755 commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
18511699755 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651082518


   load average: 1.27, 0.51, 0.22
   On average, it takes 35m's to load metadata every time.
   Machine and database delay is about 0.09ms


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] 18511699755 commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
18511699755 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651096162


   Set the property spring.shardingsphere.props.max.connections.size.per.query to 1, cost 258084 milliseconds


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] tuohai666 commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
tuohai666 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-648752493


   OK. Yes, ShardingSphere will load all table names of actual datasources. The **7169 tables** in the log indicates that there are 7169 tables in ttt, although 6145 of them are not present in config file. 
   
   I noticed that you use only one machine. If your hardware environment is not good, the meta data loading procedure will cost much time.
   
   Can you create another database like **sss** contains only 1024 tables you really want to use and have a test?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] 18511699755 commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
18511699755 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-650970281


   At present, it is in the testing stage, and there are no machines produced on it


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] 18511699755 commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
18511699755 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-648568756


   2020-06-24 11:37:38.592  INFO 61443 --- [           main] ShardingSphere-metadata                  : Loading 1 logic tables' meta data.
   2020-06-24 11:37:39.538  INFO 61443 --- [           main] ShardingSphere-metadata                  : Loading 7169 tables' meta data.
   2020-06-24 11:58:01.251  INFO 61443 --- [           main] ShardingSphere-metadata                  : Meta data load finished, cost 1222709 milliseconds.
   2020-06-24 11:58:01.741  INFO 61443 --- [           main] o.s.s.concurrent.ThreadPoolTaskExecutor  : Initializing ExecutorService 'applicationTaskExecutor'
   2020-06-24 11:58:02.004  INFO 61443 --- [           main] o.s.b.w.embedded.tomcat.TomcatWebServer  : Tomcat started on port(s): 8085 (http) with context path ''


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] 18511699755 removed a comment on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
18511699755 removed a comment on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651079940


   load average: 1.27, 0.51, 0.22
   ShardingSphere-metadata - rt : 34ms


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] tuohai666 commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
tuohai666 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-650967516


   Is the mac your personal machine for working? What's the average load of it?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] 18511699755 commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
18511699755 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-648567372


   config:
   spring.shardingsphere.datasource.names=db0
   
   spring.shardingsphere.datasource.db0.type=com.alibaba.druid.pool.DruidDataSource
   spring.shardingsphere.datasource.db0.driver-class-name=com.mysql.cj.jdbc.Driver
   spring.shardingsphere.datasource.db0.url=jdbc:mysql://localhost:3306/ttt?useUnicode=true&characterEncoding=utf-8
   spring.shardingsphere.datasource.db0.username=root
   spring.shardingsphere.datasource.db0.password=root
   
   spring.shardingsphere.props.sql.show=true
   spring.shardingsphere.props.max.connections.size.per.query=1
   
   spring.shardingsphere.sharding.tables.demo.actual-data-nodes=db0.demo_$->{0..1023}
   spring.shardingsphere.sharding.tables.demo.database-strategy.inline.sharding-column=id
   spring.shardingsphere.sharding.tables.demo.database-strategy.inline.algorithm-expression=db0
   spring.shardingsphere.sharding.tables.demo.table-strategy.inline.sharding-column=id
   spring.shardingsphere.sharding.tables.demo.table-strategy.inline.algorithm-expression=demo_$->{id % 1024}
   
   
   The application needs more than 10 minutes to start
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] tuohai666 closed issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
tuohai666 closed issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] 18511699755 commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
18511699755 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651007116


   Are you referring to the cloud service database?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] tuohai666 commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
tuohai666 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651009239


   You can ping the cloud host from your mac.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] tuohai666 commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
tuohai666 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-650968425


   You said there's one machine in production environment, why you provide a mac hardware environment?
   Is all data in this issue based on the mac?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] tuohai666 commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
tuohai666 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651004586


   What's the latency between the cloud service and your mac?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] tuohai666 commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
tuohai666 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651041743


   @hand515 I noticed that ColumnMetaDataLoader.load is more slower than IndexMetaDataLoader.load. I'll check.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] tristaZero commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
tristaZero commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-698199538


   Hi @hand515 @18511699755 ,
   
   I am sorry to give my comment late. The good news that the performance of starting ShardingProxy has been greatly improved already! Thanks for @xbkaishui, who took much effort in #6212.
   
   Presently, welcome your any test for the `master branch` (Package it local firstly). Your feedback will be the best gift for the community.
   
   Best,
   Trista


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [shardingsphere] tuohai666 commented on issue #6179: max.connections.size.per.query affects database performance

Posted by GitBox <gi...@apache.org>.
tuohai666 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651112682


   Not only the 1 and 64. Please try 1/2/4/8/16/32/64.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org