You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@shardingsphere.apache.org by GitBox <gi...@apache.org> on 2022/10/10 06:30:28 UTC
[GitHub] [shardingsphere] menghaoranss opened a new issue, #15113: New syntax to support batch execution of DistSQL
menghaoranss opened a new issue, #15113:
URL: https://github.com/apache/shardingsphere/issues/15113
## background
We can use DistSQL to create/drop/alter ... data sources and rules since 5.x, and these changes are effective immediately, so ShardingSphere has to refresh the meta data for each execution. In registry center, the configurations persisted in single node just as follows, once modified, they will be overwritten and there's no way to rollback.
```
namespace:
metadata:
sharding_db:
dataSources
rules
tables
```
There are some problems for batch execution scenarios of DistSQL:
1. Batch execution scenario involves frequent metadata refresh, which will greatly affect the performance, and without the support of distributed locks, the metadata may be incorrect
2. It is not friendly to scaling scenario. At present, modifying the configuration directly triggers the scaling task, batch execution will trigger scaling task frequently
3. Execution cannot be terminated
## design
Consider designing a new syntax to support delayed entry into force for batch execution of DistSQL, the snapshot configuration will be persisted to registry center until apply it.
1. `PREPARE DISTSQL; `
Start a new version control for DistSQL, any DistSQL executed after this statement will not take effect immediately. If non-DistSQL is executed at this time, an exception will be thrown directly.
2. `APPLY DISTSQL; `
Apply all executed DistSQL and refresh meta data now.
3. `DISCARD DISTSQL; `
Discard all executed DistSQL before applying.
## task list
- [ ] support `PREPARE DISTSQL; `
- [ ] support `APPLY DISTSQL; `
- [ ] support `DISCARD DISTSQL; `
- [x] provide API for above syntax, and refactor the registry center data structure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@shardingsphere.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] github-actions[bot] closed issue #15113: New syntax to support batch execution of DistSQL
Posted by GitBox <gi...@apache.org>.
github-actions[bot] closed issue #15113: New syntax to support batch execution of DistSQL
URL: https://github.com/apache/shardingsphere/issues/15113
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@shardingsphere.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] RaigorJiang commented on issue #15113: New syntax to support batch execution of DistSQL
Posted by "RaigorJiang (via GitHub)" <gi...@apache.org>.
RaigorJiang commented on issue #15113:
URL: https://github.com/apache/shardingsphere/issues/15113#issuecomment-1582662673
This solution cannot be advanced, I will close this issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@shardingsphere.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] RaigorJiang closed issue #15113: New syntax to support batch execution of DistSQL
Posted by "RaigorJiang (via GitHub)" <gi...@apache.org>.
RaigorJiang closed issue #15113: New syntax to support batch execution of DistSQL
URL: https://github.com/apache/shardingsphere/issues/15113
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@shardingsphere.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] RaigorJiang commented on issue #15113: New syntax to support batch execution of DistSQL
Posted by GitBox <gi...@apache.org>.
RaigorJiang commented on issue #15113:
URL: https://github.com/apache/shardingsphere/issues/15113#issuecomment-1100690510
Hi guys, in the investigation of transaction scenarios, it may be a more friendly way to manage DistSQL and standard SQL in the same transaction manager.
Therefore, the current issue will be updated to pending and new features will start in #16777 .
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@shardingsphere.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [shardingsphere] github-actions[bot] commented on issue #15113: New syntax to support batch execution of DistSQL
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #15113:
URL: https://github.com/apache/shardingsphere/issues/15113#issuecomment-1272350417
Hello , this issue has not received a reply for several days.
This issue is supposed to be closed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@shardingsphere.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org