You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@shardingsphere.apache.org by GitBox <gi...@apache.org> on 2019/11/26 16:57:00 UTC
[GitHub] [incubator-shardingsphere] wyt1128 commented on issue #3581:
version 4.0.0-RC4 , how to make the application launch faster ,
when the sharding tables has millions data ?
wyt1128 commented on issue #3581: version 4.0.0-RC4 , how to make the application launch faster , when the sharding tables has millions data ?
URL: https://github.com/apache/incubator-shardingsphere/issues/3581#issuecomment-558722646
the log output
```
tables:
SHARDING_TABLE:
actualDataNodes: db.SHARDING_TABLE_2010_01,db.SHARDING_TABLE_2010_02,db.SHARDING_TABLE_2010_03,db.SHARDING_TABLE_2010_04,db.SHARDING_TABLE_2010_05,db.SHARDING_TABLE_2010_06,db.SHARDING_TABLE_2010_07,db.SHARDING_TABLE_2010_08,db.SHARDING_TABLE_2010_09,db.SHARDING_TABLE_2010_10,db.SHARDING_TABLE_2010_11,db.SHARDING_TABLE_2010_12,db.SHARDING_TABLE_2011_01,db.SHARDING_TABLE_2011_02,db.SHARDING_TABLE_2011_03,db.SHARDING_TABLE_2011_04,db.SHARDING_TABLE_2011_05,db.SHARDING_TABLE_2011_06,db.SHARDING_TABLE_2011_07,db.SHARDING_TABLE_2011_08,db.SHARDING_TABLE_2011_09,db.SHARDING_TABLE_2011_10,db.SHARDING_TABLE_2011_11,db.SHARDING_TABLE_2011_12,db.SHARDING_TABLE_2012_01,db.SHARDING_TABLE_2012_02,db.SHARDING_TABLE_2012_03,db.SHARDING_TABLE_2012_04,db.SHARDING_TABLE_2012_05,db.SHARDING_TABLE_2012_06,db.SHARDING_TABLE_2012_07,db.SHARDING_TABLE_2012_08,db.SHARDING_TABLE_2012_09,db.SHARDING_TABLE_2012_10,db.SHARDING_TABLE_2012_11,db.SHARDING_TABLE_2012_12,db.SHARDING_TABLE_2013_01,db.SHARDING_TABLE_2013_02,db.SHARDING_TABLE_2013_03,db.SHARDING_TABLE_2013_04,db.SHARDING_TABLE_2013_05,db.SHARDING_TABLE_2013_06,db.SHARDING_TABLE_2013_07,db.SHARDING_TABLE_2013_08,db.SHARDING_TABLE_2013_09,db.SHARDING_TABLE_2013_10,db.SHARDING_TABLE_2013_11,db.SHARDING_TABLE_2013_12,db.SHARDING_TABLE_2014_01,db.SHARDING_TABLE_2014_02,db.SHARDING_TABLE_2014_03,db.SHARDING_TABLE_2014_04,db.SHARDING_TABLE_2014_05,db.SHARDING_TABLE_2014_06,db.SHARDING_TABLE_2014_07,db.SHARDING_TABLE_2014_08,db.SHARDING_TABLE_2014_09,db.SHARDING_TABLE_2014_10,db.SHARDING_TABLE_2014_11,db.SHARDING_TABLE_2014_12,db.SHARDING_TABLE_2015_01,db.SHARDING_TABLE_2015_02,db.SHARDING_TABLE_2015_03,db.SHARDING_TABLE_2015_04,db.SHARDING_TABLE_2015_05,db.SHARDING_TABLE_2015_06,db.SHARDING_TABLE_2015_07,db.SHARDING_TABLE_2015_08,db.SHARDING_TABLE_2015_09,db.SHARDING_TABLE_2015_10,db.SHARDING_TABLE_2015_11,db.SHARDING_TABLE_2015_12,db.SHARDING_TABLE_2016_01,db.SHARDING_TABLE_2016_02,db.SHARDING_TABLE_2016_03,db.SHARDING_TABLE_2016_04,db.SHARDING_TABLE_2016_05,db.SHARDING_TABLE_2016_06,db.SHARDING_TABLE_2016_07,db.SHARDING_TABLE_2016_08,db.SHARDING_TABLE_2016_09,db.SHARDING_TABLE_2016_10,db.SHARDING_TABLE_2016_11,db.SHARDING_TABLE_2016_12,db.SHARDING_TABLE_2017_07,db.SHARDING_TABLE_2017_08,db.SHARDING_TABLE_2018_01,db.SHARDING_TABLE_2018_02,db.SHARDING_TABLE_2018_03,db.SHARDING_TABLE_2018_04,db.SHARDING_TABLE_2018_05,db.SHARDING_TABLE_2018_06,db.SHARDING_TABLE_2018_07,db.SHARDING_TABLE_2018_08,db.SHARDING_TABLE_2018_09,db.SHARDING_TABLE_2018_10,db.SHARDING_TABLE_2018_11,db.SHARDING_TABLE_2018_12,db.SHARDING_TABLE_2019_01,db.SHARDING_TABLE_2019_02,db.SHARDING_TABLE_2019_03,db.SHARDING_TABLE_2019_04,db.SHARDING_TABLE_2019_05,db.SHARDING_TABLE_2019_06,db.SHARDING_TABLE_2019_07,db.SHARDING_TABLE_2019_08,db.SHARDING_TABLE_2019_09,db.SHARDING_TABLE_2019_10,db.SHARDING_TABLE_2019_11,db.SHARDING_TABLE_2019_12
logicTable: SHARDING_TABLE
tableStrategy:
complex:
algorithmClassName: com.qualitycontrol.config.ShardingConfiguration$$Lambda$440/1060283828
shardingColumns: TIME,TYPE
2019-11-26 17:59:25.111 INFO 139876 --- [on(3)-127.0.0.1] o.a.s.core.util.ConfigurationLogger : Properties
sql.show: 'false'
actualTableName:SHARDING_TABLE_2010_01, cost=190
actualTableName:SHARDING_TABLE_2010_01, cost=16
actualTableName:SHARDING_TABLE_2010_01, cost=15
actualTableName:SHARDING_TABLE_2010_02, cost=127
actualTableName:SHARDING_TABLE_2010_03, cost=127
actualTableName:SHARDING_TABLE_2010_04, cost=133
actualTableName:SHARDING_TABLE_2010_05, cost=128
actualTableName:SHARDING_TABLE_2010_06, cost=126
actualTableName:SHARDING_TABLE_2010_07, cost=130
actualTableName:SHARDING_TABLE_2010_08, cost=128
actualTableName:SHARDING_TABLE_2010_09, cost=126
actualTableName:SHARDING_TABLE_2010_10, cost=133
actualTableName:SHARDING_TABLE_2010_11, cost=130
actualTableName:SHARDING_TABLE_2010_12, cost=127
actualTableName:SHARDING_TABLE_2011_01, cost=129
actualTableName:SHARDING_TABLE_2011_02, cost=132
actualTableName:SHARDING_TABLE_2011_03, cost=128
actualTableName:SHARDING_TABLE_2011_04, cost=127
actualTableName:SHARDING_TABLE_2011_05, cost=127
actualTableName:SHARDING_TABLE_2011_06, cost=127
actualTableName:SHARDING_TABLE_2011_07, cost=127
actualTableName:SHARDING_TABLE_2011_08, cost=130
actualTableName:SHARDING_TABLE_2011_09, cost=128
actualTableName:SHARDING_TABLE_2011_10, cost=137
actualTableName:SHARDING_TABLE_2011_11, cost=125
actualTableName:SHARDING_TABLE_2011_12, cost=127
actualTableName:SHARDING_TABLE_2012_01, cost=129
actualTableName:SHARDING_TABLE_2012_02, cost=125
actualTableName:SHARDING_TABLE_2012_03, cost=122
actualTableName:SHARDING_TABLE_2012_04, cost=124
actualTableName:SHARDING_TABLE_2012_05, cost=123
actualTableName:SHARDING_TABLE_2012_06, cost=126
actualTableName:SHARDING_TABLE_2012_07, cost=128
actualTableName:SHARDING_TABLE_2012_08, cost=128
actualTableName:SHARDING_TABLE_2012_09, cost=123
actualTableName:SHARDING_TABLE_2012_10, cost=125
actualTableName:SHARDING_TABLE_2012_11, cost=126
actualTableName:SHARDING_TABLE_2012_12, cost=122
actualTableName:SHARDING_TABLE_2013_01, cost=126
actualTableName:SHARDING_TABLE_2013_02, cost=131
actualTableName:SHARDING_TABLE_2013_03, cost=124
actualTableName:SHARDING_TABLE_2013_04, cost=122
actualTableName:SHARDING_TABLE_2013_05, cost=133
actualTableName:SHARDING_TABLE_2013_06, cost=134
actualTableName:SHARDING_TABLE_2013_07, cost=135
actualTableName:SHARDING_TABLE_2013_08, cost=124
actualTableName:SHARDING_TABLE_2013_09, cost=127
actualTableName:SHARDING_TABLE_2013_10, cost=125
actualTableName:SHARDING_TABLE_2013_11, cost=128
actualTableName:SHARDING_TABLE_2013_12, cost=128
actualTableName:SHARDING_TABLE_2014_01, cost=130
actualTableName:SHARDING_TABLE_2014_02, cost=126
actualTableName:SHARDING_TABLE_2014_03, cost=125
actualTableName:SHARDING_TABLE_2014_04, cost=124
actualTableName:SHARDING_TABLE_2014_05, cost=127
actualTableName:SHARDING_TABLE_2014_06, cost=123
actualTableName:SHARDING_TABLE_2014_07, cost=125
actualTableName:SHARDING_TABLE_2014_08, cost=128
actualTableName:SHARDING_TABLE_2014_09, cost=125
actualTableName:SHARDING_TABLE_2014_10, cost=125
actualTableName:SHARDING_TABLE_2014_11, cost=127
actualTableName:SHARDING_TABLE_2014_12, cost=132
actualTableName:SHARDING_TABLE_2015_01, cost=472999
actualTableName:SHARDING_TABLE_2015_02, cost=439579
...
```
the table SHARDING_TABLE_2015_01 and SHARDING_TABLE_2015_02 has 13,808,757 records
i tracking code found that in the oracle driver will execute
`analyze table SHARDING_TABLE_2015_02 compute statistics`
execute once will take about 7.8 min .
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services