[GitHub] [shardingsphere] sandynz opened a new issue, #16657: Make sure there is no concurrent creation of tables when preparing target tables in scaling job

[GitBox <gi...@apache.org>]

sandynz opened a new issue, #16657:
URL: https://github.com/apache/shardingsphere/issues/16657

   ## Feature Request
   
   ### Is your feature request related to a problem?
   Yes, sometimes. Scaling job on PostgreSQL, the fetched statements include: create table, drop index, create index.
   
   ### Describe the feature you would like.
   Currently, scaling job will be sharded and run concurrently, include preparing target tables (create tables and constraints), so there might be duplicated tables and constraints creation, it might cause error. And there's some strange issue in ShardingSphereDataSource metadata when creating index just after creating table, it's still not resolved.
   
   Possible solution:
   Limit concurrency, make sure there's only one thread to do create tables and constraints at the same time, other threads should ignore creating tables and constraints. But it should support retry of creation in case of scaling job restarting.
   We could try `PipelineSimpleLock` for now.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@shardingsphere.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [shardingsphere] sandynz closed issue #16657: Make sure there is no concurrent creation of tables when preparing target tables in scaling job

[GitBox <gi...@apache.org>]

sandynz closed issue #16657: Make sure there is no concurrent creation of tables when preparing target tables in scaling job
URL: https://github.com/apache/shardingsphere/issues/16657


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@shardingsphere.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org