You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@shardingsphere.apache.org by GitBox <gi...@apache.org> on 2020/02/26 03:04:50 UTC
[GitHub] [incubator-shardingsphere] yxf18551704641 opened a new issue #4480:
Shardingsphere takes a long time to parse simple SQL for the first time
yxf18551704641 opened a new issue #4480: Shardingsphere takes a long time to parse simple SQL for the first time
URL: https://github.com/apache/incubator-shardingsphere/issues/4480
Shardingsphere takes about 5S to parse simple SQL for the first time. I know that it takes a little time to parse SQL for the first time, but it feels too slow when the parsing reaches 3-5 seconds. I know that shardingsphere will cache the SQL after the first parsing. What's the reason for the slow first parsing? Is there a good solution
version：Shardingsphere-4.0.0-RC2
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-shardingsphere] xfyang1988 commented on issue #4480:
Shardingsphere takes a long time to parse simple SQL for the first time
Posted by GitBox <gi...@apache.org>.
xfyang1988 commented on issue #4480: Shardingsphere takes a long time to parse simple SQL for the first time
URL: https://github.com/apache/incubator-shardingsphere/issues/4480#issuecomment-593093439
> Can you use skywalking or other OpenTracing supported project to trace your SQL parser time?
Skywalking is not currently configured to monitor SQL parsing time? 4.0.0 can be directly configured
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-shardingsphere] terrymanu closed issue #4480:
Shardingsphere takes a long time to parse simple SQL for the first time
Posted by GitBox <gi...@apache.org>.
terrymanu closed issue #4480: Shardingsphere takes a long time to parse simple SQL for the first time
URL: https://github.com/apache/incubator-shardingsphere/issues/4480
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-shardingsphere] xfyang1988 commented on issue #4480:
Shardingsphere takes a long time to parse simple SQL for the first time
Posted by GitBox <gi...@apache.org>.
xfyang1988 commented on issue #4480: Shardingsphere takes a long time to parse simple SQL for the first time
URL: https://github.com/apache/incubator-shardingsphere/issues/4480#issuecomment-599830246
> Any update about this issue?
No, I hope there will be a better parser in the later version. Although ANTLR parser has been cached after the first parsing, it took a little time to parse for the first time. The average time is 1 to 3S, especially in the high concurrency scenario. The support is not very good. I will always pay attention to it. Thank you. You can turn it off
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-shardingsphere] xfyang1988 commented on issue #4480:
Shardingsphere takes a long time to parse simple SQL for the first time
Posted by GitBox <gi...@apache.org>.
xfyang1988 commented on issue #4480: Shardingsphere takes a long time to parse simple SQL for the first time
URL: https://github.com/apache/incubator-shardingsphere/issues/4480#issuecomment-593093630
> Your time cost maybe not SQL parse only, it seems like the cost of load metadata are added too.
> Can you use skywalking or other OpenTracing supported project to trace your SQL parser time?
In the sharingsphere configuration item, I only see "check.table.metadata.enabled". The default is false. Is this configuration only checked without preloading?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-shardingsphere] xfyang1988 commented on issue #4480:
Shardingsphere takes a long time to parse simple SQL for the first time
Posted by GitBox <gi...@apache.org>.
xfyang1988 commented on issue #4480: Shardingsphere takes a long time to parse simple SQL for the first time
URL: https://github.com/apache/incubator-shardingsphere/issues/4480#issuecomment-593093246
> I'm not sure the parser cost 5s.
> As the log show, 10:39:11->10:39:17，the operation log is masked, what does it do?
This is a simple SQL query with an index, which should be fast
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-shardingsphere] terrymanu commented on issue #4480:
Shardingsphere takes a long time to parse simple SQL for the first time
Posted by GitBox <gi...@apache.org>.
terrymanu commented on issue #4480: Shardingsphere takes a long time to parse simple SQL for the first time
URL: https://github.com/apache/incubator-shardingsphere/issues/4480#issuecomment-591396084
Your time cost maybe not SQL parse only, it seems like the cost of load metadata are added too.
Can you use skywalking or other OpenTracing supported project to trace your SQL parser time?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-shardingsphere] xfyang1988 commented on issue #4480:
Shardingsphere takes a long time to parse simple SQL for the first time
Posted by GitBox <gi...@apache.org>.
xfyang1988 commented on issue #4480: Shardingsphere takes a long time to parse simple SQL for the first time
URL: https://github.com/apache/incubator-shardingsphere/issues/4480#issuecomment-593093111
> Your time cost maybe not SQL parse only, it seems like the cost of load metadata are added too.
> Can you use skywalking or other OpenTracing supported project to trace your SQL parser time?
OK, I also saw that the connection delay of MySQL is very small. It should not be caused by this problem. Can the metadata be preloaded?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-shardingsphere] terrymanu commented on issue #4480:
Shardingsphere takes a long time to parse simple SQL for the first time
Posted by GitBox <gi...@apache.org>.
terrymanu commented on issue #4480: Shardingsphere takes a long time to parse simple SQL for the first time
URL: https://github.com/apache/incubator-shardingsphere/issues/4480#issuecomment-596333495
Any update about this issue?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-shardingsphere] terrymanu commented on issue #4480:
Shardingsphere takes a long time to parse simple SQL for the first time
Posted by GitBox <gi...@apache.org>.
terrymanu commented on issue #4480: Shardingsphere takes a long time to parse simple SQL for the first time
URL: https://github.com/apache/incubator-shardingsphere/issues/4480#issuecomment-608373313
No plan to change SQL parser engine
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-shardingsphere] xfyang1988 commented on issue #4480:
Shardingsphere takes a long time to parse simple SQL for the first time
Posted by GitBox <gi...@apache.org>.
xfyang1988 commented on issue #4480: Shardingsphere takes a long time to parse simple SQL for the first time
URL: https://github.com/apache/incubator-shardingsphere/issues/4480#issuecomment-591224947
> @xfyang1988 I suggest you can upgrade the version to 4.0.0 stable version.
"sharding-core-parse-mysql" does not have version 4.0.0?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-shardingsphere] xfyang1988 commented on issue #4480:
Shardingsphere takes a long time to parse simple SQL for the first time
Posted by GitBox <gi...@apache.org>.
xfyang1988 commented on issue #4480: Shardingsphere takes a long time to parse simple SQL for the first time
URL: https://github.com/apache/incubator-shardingsphere/issues/4480#issuecomment-593094123
> > sharding-core-parse-common
>
> I understand your mean, **sharding-core-parse-common** doesn't have 4.0.0 version, because it maybe rename after project refactor.
>
> How does this matter to you?
It does n’t matter, just ask, it is wrong after upgrading, and it is OK to remove it.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-shardingsphere] dongzl commented on issue #4480:
Shardingsphere takes a long time to parse simple SQL for the first time
Posted by GitBox <gi...@apache.org>.
dongzl commented on issue #4480: Shardingsphere takes a long time to parse simple SQL for the first time
URL: https://github.com/apache/incubator-shardingsphere/issues/4480#issuecomment-591218134
Hi @xfyang1988 , please reference this issue #3676 . Maybe they are same question.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-shardingsphere] dongzl edited a comment on issue #4480:
Shardingsphere takes a long time to parse simple SQL for the first time
Posted by GitBox <gi...@apache.org>.
dongzl edited a comment on issue #4480: Shardingsphere takes a long time to parse simple SQL for the first time
URL: https://github.com/apache/incubator-shardingsphere/issues/4480#issuecomment-591267419
> sharding-core-parse-common
I understand your mean, **sharding-core-parse-common** doesn't have 4.0.0 version, because it maybe rename after project refactor.
How does this matter to you?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-shardingsphere] terrymanu commented on issue #4480:
Shardingsphere takes a long time to parse simple SQL for the first time
Posted by GitBox <gi...@apache.org>.
terrymanu commented on issue #4480: Shardingsphere takes a long time to parse simple SQL for the first time
URL: https://github.com/apache/incubator-shardingsphere/issues/4480#issuecomment-593219692
The document about SkyWalking, please read document of them
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-shardingsphere] kimmking commented on issue #4480:
Shardingsphere takes a long time to parse simple SQL for the first time
Posted by GitBox <gi...@apache.org>.
kimmking commented on issue #4480: Shardingsphere takes a long time to parse simple SQL for the first time
URL: https://github.com/apache/incubator-shardingsphere/issues/4480#issuecomment-591370752
I'm not sure the parser cost 5s.
As the log show, 10:39:11->10:39:17，the operation log is masked, what does it do?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-shardingsphere] dongzl commented on issue #4480:
Shardingsphere takes a long time to parse simple SQL for the first time
Posted by GitBox <gi...@apache.org>.
dongzl commented on issue #4480: Shardingsphere takes a long time to parse simple SQL for the first time
URL: https://github.com/apache/incubator-shardingsphere/issues/4480#issuecomment-591267419
> sharding-core-parse-common
I understand your mean, **sharding-core-parse-common** doesn't have 4.0.0 version, because it maybe rename after project refactor.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-shardingsphere] dongzl commented on issue #4480:
Shardingsphere takes a long time to parse simple SQL for the first time
Posted by GitBox <gi...@apache.org>.
dongzl commented on issue #4480: Shardingsphere takes a long time to parse simple SQL for the first time
URL: https://github.com/apache/incubator-shardingsphere/issues/4480#issuecomment-591265839
> > @xfyang1988 I suggest you can upgrade the version to 4.0.0 stable version.
>
> "sharding-core-parse-common" does not have version 4.0.0?
what‘s your mean? 4.0.0 is a release version, all module have 4.0.0 version.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-shardingsphere] dongzl commented on issue #4480:
Shardingsphere takes a long time to parse simple SQL for the first time
Posted by GitBox <gi...@apache.org>.
dongzl commented on issue #4480: Shardingsphere takes a long time to parse simple SQL for the first time
URL: https://github.com/apache/incubator-shardingsphere/issues/4480#issuecomment-591220043
@xfyang1988 I suggest you can upgrade the version to 4.0.0 stable version.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-shardingsphere] xfyang1988 edited a comment on issue
#4480: Shardingsphere takes a long time to parse simple SQL for the first
time
Posted by GitBox <gi...@apache.org>.
xfyang1988 edited a comment on issue #4480: Shardingsphere takes a long time to parse simple SQL for the first time
URL: https://github.com/apache/incubator-shardingsphere/issues/4480#issuecomment-591224947
> @xfyang1988 I suggest you can upgrade the version to 4.0.0 stable version.
"sharding-core-parse-common" does not have version 4.0.0?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-shardingsphere] xfyang1988 commented on issue #4480:
Shardingsphere takes a long time to parse simple SQL for the first time
Posted by GitBox <gi...@apache.org>.
xfyang1988 commented on issue #4480: Shardingsphere takes a long time to parse simple SQL for the first time
URL: https://github.com/apache/incubator-shardingsphere/issues/4480#issuecomment-593111545
Is there any documentation for ShardingSphere and SkyWalking integration? I see the official website document is not very detailed
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services