You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@shardingsphere.apache.org by GitBox <gi...@apache.org> on 2020/06/23 12:41:22 UTC
[GitHub] [shardingsphere] 18511699755 opened a new issue #6179: max.connections.size.per.query affects database performance
18511699755 opened a new issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179
There are 7000 tables in the test target library, and the default value will start slowly, and the high setting value will lead to the soaring cpu and iops of the database
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] 18511699755 commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
18511699755 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-650922611
okay, thank you
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] 18511699755 commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
18511699755 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-650971258
The performance of the machine where the program is located is no problem, and the configuration of the daily database may be lower.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] tuohai666 commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
tuohai666 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651038025
> The local delay is relatively high within 20ms, so I will apply for a daily machine and test it again.
OK. Wait for your response. When you start the test, please record the load of servers for both MySQL and ShardingSphere.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] hand515 commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
hand515 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651127413
According to mysql jdbc driver(mysql-connector-java:5.1.34) , load metadata will execute 4 sql (use wireshark to capture)
```
TableMetaDataLoader.isTableExists
1. show full tables from db_name like '%'
ColumnMetaDataLoader
1. show full columns from table_name.
2. select * from table_name where 1!=1
IndexMetaDataLoader
1. show index from table_name
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] hand515 commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
hand515 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651028620
```
[INFO ColumnMetaDataLoader:84] - load column metadata for table=t1 use 192.2264ms
[INFO IndexMetaDataLoader:62] - load index metadata for table=t1 use 38.0993ms
[INFO ColumnMetaDataLoader:84] - load column metadata for table=t2 use 392.8141ms
[INFO IndexMetaDataLoader:62] - load index metadata for table=t2 use 37.5664ms
[INFO ColumnMetaDataLoader:84] - load column metadata for table=t3 use 267.1177ms
[INFO IndexMetaDataLoader:62] - load index metadata for table=t3 use 38.5584ms
[INFO ColumnMetaDataLoader:84] - load column metadata for table=t4 use 500.384ms
[INFO IndexMetaDataLoader:62] - load index metadata for table=t4 use 38.3369ms
```
Using 5.0-RC1 -SNAPSHOT, add some metric code in ColumnMetaDataLoader.load and IndexMetaDataLoader.load.
The time is not related to the number of columns .
Properties:
```
max.connections.size.per.query: '10'
sql.show: 'true'
check.table.metadata.enabled: 'false'
```
Client pings to db server: 29ms
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] tuohai666 commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
tuohai666 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-650942958
Hi @18511699755
1. Please provide your hardware environment.
2. And check is there any other service running on this machine.
Please don't just ignore my question, the answer is also important reference to me.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] tuohai666 commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
tuohai666 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651087811
Compare to
`2020-06-24 11:58:01.251 INFO 61443 --- [ main] ShardingSphere-metadata : Meta data load finished, cost 1222709 milliseconds.
`
What's the cost this time?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] tuohai666 commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
tuohai666 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-650890486
Actually, we don't expect 1222709 milliseconds for meta data loading for 7169 tables.
Time cost for one query: 1222709/7169 = 170ms
IMO, this kind of query usually cost 1~2ms or even less.
There're two possibilities:
1. There's bug in ShardingSphere. I'll double check.
2. You machine is two slow. Please provide your hardware environment. And check is there any other service running on this machine.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] tuohai666 commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
tuohai666 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-652763557
Duplicate with https://github.com/apache/shardingsphere/issues/6212 .
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] 18511699755 commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
18511699755 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-650964619
There are also services that use this database, but monitoring has little impact on performance.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] 18511699755 commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
18511699755 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651086268
The average server load in ShardingSphere is around 1.1
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] tuohai666 edited a comment on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
tuohai666 edited a comment on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-650890486
Actually, we don't expect 1222709 milliseconds for meta data loading for 7169 tables.
Time cost for one query: 1222709/7169 = 170ms
IMO, this kind of query usually cost 1~2ms or even less.
There're two possibilities:
1. There's bug in ShardingSphere. I'll double check.
2. You machine is too slow. Please provide your hardware environment. And check is there any other service running on this machine.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] tuohai666 commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
tuohai666 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651173667
Yes, will exist in next release.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] tuohai666 commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
tuohai666 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651136146
@hand515 There are 3 more:

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] 18511699755 commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
18511699755 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651020856
The local delay is relatively high within 20ms, so I will apply for a daily machine and test it again.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] tuohai666 commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
tuohai666 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651086450
What's the total time this time?
Set the property spring.shardingsphere.props.max.connections.size.per.query to 1/2/4/8/16/32/64, record the log and show me the total time.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] 18511699755 commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
18511699755 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-650700051
Do you mean a machine where the application is located or a database machine?
There are 6 machines in our production environment, but there is only one database instance, and 7169 tables will be used in the production environment.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] 18511699755 commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
18511699755 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-650970102
Yes, the machine on which the program runs is mac, but the database is a database instance based on Alibaba Cloud.
The machine load is below 2.0.
mac os 6 core 16G.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] tristaZero commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
tristaZero commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-698199538
Hi @hand515 @18511699755 ,
I am sorry to give my comment late. The good news that the performance of starting ShardingProxy has been greatly improved already! Thanks for @xbkaishui, who took much effort in #6212.
Presently, welcome your any test for the `master branch` (Package it local firstly). Your feedback will be the best gift for the community.
Best,
Trista
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] 18511699755 commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
18511699755 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-650728161
That is, if there are 7169 tables, do you need to use multiple instances (machines) in the database? If so, the cost may be higher. Is there any other solution?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] 18511699755 commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
18511699755 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651081701
load average: 1.27, 0.51, 0.22
The load of the machine where the application is located is about 35ms.
Machine and database delay is about 0.09ms
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] tuohai666 commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
tuohai666 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651084167
What's the load average for? MySQL or ShardingSphere? Please record the load of servers for both MySQL and ShardingSphere.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] tuohai666 commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
tuohai666 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651122681
I have captured some packets and studied the codes. There're 7 SQLs sent to MySQL every table for meta data purpose. In your case, there're 7 * 7169 = 50183 SQLs to be executed. The average response time is 258084 / 50183 = 5 ms. It's slow but acceptable if your server has only 4 cores.
The conclusion is that you can adjust spring.shardingsphere.props.max.connections.size.per.query to a suitable value to make the initialization faster without full load. Meanwhile, I will try to reduce the interaction times during meta data procedure.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] tuohai666 commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
tuohai666 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-648161735
1. Have you closed check.table.metadata.enabled property?
2. How many databases and hosts hold that 7000 tables?
3. Please show the detail configurations of ShardingSphere.
4. Please fill in the template following.
## Bug Report
**For English only**, other languages will not accept.
Before report a bug, make sure you have:
- Searched open and closed [GitHub issues](https://github.com/apache/shardingsphere/issues).
- Read documentation: [ShardingSphere Doc](https://shardingsphere.apache.org/document/current/en/overview).
Please pay attention on issues you submitted, because we maybe need more details.
If no response anymore and we cannot reproduce it on current information, we will **close it**.
Please answer these questions before submitting your issue. Thanks!
### Which version of ShardingSphere did you use?
### Which project did you use? ShardingSphere-JDBC or ShardingSphere-Proxy?
### Expected behavior
### Actual behavior
### Reason analyze (If you can)
### Steps to reproduce the behavior, such as: SQL to execute, sharding rule configuration, when exception occur etc.
### Example codes for reproduce this issue (such as a github link).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] tuohai666 commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
tuohai666 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-650702299
I mean database machine.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] 18511699755 removed a comment on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
18511699755 removed a comment on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651081701
load average: 1.27, 0.51, 0.22
The load of the machine where the application is located is about 35ms.
Machine and database delay is about 0.09ms
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] 18511699755 commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
18511699755 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651096863
Set the property spring.shardingsphere.props.max.connections.size.per.query to 64, database load is basically running at full load, and the cpu is full
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] 18511699755 commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
18511699755 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651079940
load average: 1.27, 0.51, 0.22
ShardingSphere-metadata - rt : 34ms
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] 18511699755 commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
18511699755 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651153939
Well, I'll try debugging. Will the optimization you mentioned be iterated in subsequent versions?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] 18511699755 commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
18511699755 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-650963959
Type of database: MySQL 5.7
Cpu: 4 cores
Database memory: 16384MB
The application machine mac os 10.15.3
At present, debug found this exception, and the source code exception was ignore.
java.sql.SQLFeatureNotSupportedException
at com.alibaba.druid.pool.DruidPooledConnection.getSchema(DruidPooledConnection.java:1191)
at org.apache.shardingsphere.sql.parser.binder.metadata.util.JdbcUtil.getSchema(JdbcUtil.java:41)
Every time I load metadata, I log it, and the time is between 90ms and 400ms
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] 18511699755 commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
18511699755 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651082518
load average: 1.27, 0.51, 0.22
On average, it takes 35m's to load metadata every time.
Machine and database delay is about 0.09ms
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] 18511699755 commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
18511699755 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651096162
Set the property spring.shardingsphere.props.max.connections.size.per.query to 1, cost 258084 milliseconds
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] tuohai666 commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
tuohai666 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-648752493
OK. Yes, ShardingSphere will load all table names of actual datasources. The **7169 tables** in the log indicates that there are 7169 tables in ttt, although 6145 of them are not present in config file.
I noticed that you use only one machine. If your hardware environment is not good, the meta data loading procedure will cost much time.
Can you create another database like **sss** contains only 1024 tables you really want to use and have a test?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] 18511699755 commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
18511699755 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-650970281
At present, it is in the testing stage, and there are no machines produced on it
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] 18511699755 commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
18511699755 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-648568756
2020-06-24 11:37:38.592 INFO 61443 --- [ main] ShardingSphere-metadata : Loading 1 logic tables' meta data.
2020-06-24 11:37:39.538 INFO 61443 --- [ main] ShardingSphere-metadata : Loading 7169 tables' meta data.
2020-06-24 11:58:01.251 INFO 61443 --- [ main] ShardingSphere-metadata : Meta data load finished, cost 1222709 milliseconds.
2020-06-24 11:58:01.741 INFO 61443 --- [ main] o.s.s.concurrent.ThreadPoolTaskExecutor : Initializing ExecutorService 'applicationTaskExecutor'
2020-06-24 11:58:02.004 INFO 61443 --- [ main] o.s.b.w.embedded.tomcat.TomcatWebServer : Tomcat started on port(s): 8085 (http) with context path ''
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] 18511699755 removed a comment on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
18511699755 removed a comment on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651079940
load average: 1.27, 0.51, 0.22
ShardingSphere-metadata - rt : 34ms
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] tuohai666 commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
tuohai666 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-650967516
Is the mac your personal machine for working? What's the average load of it?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] 18511699755 commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
18511699755 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-648567372
configļ¼
spring.shardingsphere.datasource.names=db0
spring.shardingsphere.datasource.db0.type=com.alibaba.druid.pool.DruidDataSource
spring.shardingsphere.datasource.db0.driver-class-name=com.mysql.cj.jdbc.Driver
spring.shardingsphere.datasource.db0.url=jdbc:mysql://localhost:3306/ttt?useUnicode=true&characterEncoding=utf-8
spring.shardingsphere.datasource.db0.username=root
spring.shardingsphere.datasource.db0.password=root
spring.shardingsphere.props.sql.show=true
spring.shardingsphere.props.max.connections.size.per.query=1
spring.shardingsphere.sharding.tables.demo.actual-data-nodes=db0.demo_$->{0..1023}
spring.shardingsphere.sharding.tables.demo.database-strategy.inline.sharding-column=id
spring.shardingsphere.sharding.tables.demo.database-strategy.inline.algorithm-expression=db0
spring.shardingsphere.sharding.tables.demo.table-strategy.inline.sharding-column=id
spring.shardingsphere.sharding.tables.demo.table-strategy.inline.algorithm-expression=demo_$->{id % 1024}
The application needs more than 10 minutes to start
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] tuohai666 closed issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
tuohai666 closed issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] 18511699755 commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
18511699755 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651007116
Are you referring to the cloud service database?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] tuohai666 commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
tuohai666 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651009239
You can ping the cloud host from your mac.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] tuohai666 commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
tuohai666 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-650968425
You said there's one machine in production environment, why you provide a mac hardware environment?
Is all data in this issue based on the mac?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] tuohai666 commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
tuohai666 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651004586
What's the latency between the cloud service and your mac?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] tuohai666 commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
tuohai666 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651041743
@hand515 I noticed that ColumnMetaDataLoader.load is more slower than IndexMetaDataLoader.load. I'll check.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] tristaZero commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
tristaZero commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-698199538
Hi @hand515 @18511699755 ,
I am sorry to give my comment late. The good news that the performance of starting ShardingProxy has been greatly improved already! Thanks for @xbkaishui, who took much effort in #6212.
Presently, welcome your any test for the `master branch` (Package it local firstly). Your feedback will be the best gift for the community.
Best,
Trista
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] tuohai666 commented on issue #6179: max.connections.size.per.query affects database performance
Posted by GitBox <gi...@apache.org>.
tuohai666 commented on issue #6179:
URL: https://github.com/apache/shardingsphere/issues/6179#issuecomment-651112682
Not only the 1 and 64. Please try 1/2/4/8/16/32/64.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org