[GitHub] [incubator-doris] ccoffline opened a new issue #4973: [Proposal] Support overlapping range of temporary partitions

[GitBox <gi...@apache.org>]

ccoffline opened a new issue #4973:
URL: https://github.com/apache/incubator-doris/issues/4973


   **Is your feature request related to a problem? Please describe.**
   
   When doing atomic load, it may occurs that temporary partitions haven‘t been replace but the load application goes wrong. The load app couldn't remove temporary partitions because it doesn't know if the previous load is still going. And if it goes wrong, the next load couldn't start until remaining temporary partitions are removed manually.
   
   We have problem removing temporary partitions after exception. The outer app will send -9 sig to kill removing action. We only have 10s to do the cleaning. Doris doesn't support removing temporary partitions in batch or asynchronously.
   
   **Describe the solution you'd like**
   
   Since it needs to specify which temporary partitions when doing load, we thought it’s ok to overlap range of temporary partitions, and do the replace if anyone finished. There's no need to do such limit.
   
   **Describe alternatives you've considered**
   
   If Doris can support schema change in general to go asynchronously will also solve our problem 
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org