[I] [Feature] Create new loops combinations to support distributed queue [skywalking]

["hanahmily (via GitHub)" <gi...@apache.org>]

hanahmily opened a new issue, #13288:
URL: https://github.com/apache/skywalking/issues/13288

   ### Search before asking
   
   - [x] I had searched in the [issues](https://github.com/apache/skywalking/issues?q=is%3Aissue) and found no similar feature requirement.
   
   
   ### Description
   
   
   
   We need to enhance the functionality of the retry queue by separating the existing three-loop combination for writing, flushing, and merging data files into distinct client-side and server-side processes. This implementation involves two new combinations, ensuring that the existing standalone mode remains unaffected.
   
   **Client-Side (Liaison Node):**
   - Tasks: Writing, flushing, and sending data files.
   - Functionality: 
     - The sending loop will manage sending data files to remote data nodes.
     - After successful transmission, it will clear the sent files from the queue.
     - It will include retry mechanisms to handle any sending failures effectively.
   
   **Server-Side (Data Node):**
   - Tasks: Receiving, flushing, and merging data files.
   - Functionality:
     The receiving process will differ from writing, as it involves parsing binary files according to the wire protocol.
     - It will incorporate any new data into the subsequent snapshot.
   
   **Note:** 
   The standalone mode will continue to utilize the current combination, so it's crucial that these two new combinations are implemented independently to avoid any disruptions.
   
   **Additional Requirement:**
   New test cases should be created to thoroughly cover the functionalities of these new loops and combinations.
   
   
   
   ### Use case
   
   _No response_
   
   ### Related issues
   
   #12870
   
   ### Are you willing to submit a pull request to implement this on your own?
   
   - [ ] Yes I am willing to submit a pull request on my own!
   
   ### Code of Conduct
   
   - [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Feature] Create new loops combinations to support distributed queue [skywalking]

["hanahmily (via GitHub)" <gi...@apache.org>]

hanahmily closed issue #13288: [Feature] Create new loops combinations to support distributed queue
URL: https://github.com/apache/skywalking/issues/13288


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org