You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@samza.apache.org by GitBox <gi...@apache.org> on 2019/11/07 01:02:44 UTC

[GitHub] [samza] mynameborat opened a new pull request #1213: SAMZA-2305: Stream processor should ensure previous container is stopped during a rebalance

mynameborat opened a new pull request #1213: SAMZA-2305: Stream processor should ensure previous container is stopped during a rebalance
URL: https://github.com/apache/samza/pull/1213
 
 
   **Symptom**: Duplicate processing, Inconsistent checkpoints for inputs, Inconsistent changelog state
   **Cause**: We have a bug in the state machine inside stream processor that can result in processors running containers with old job model version after rebalances in Standalone deployment model. 
   **Fix**: We interrupt the container and wait for container to shutdown gracefully within a timeout (task.shutdown.ms) and fail the stream processor if the container doesn’t shut down within the timeout
   **Tests**: Added unit tests for StreamProcessor and SamzaContainer. Working on integration tests.
   
   More details about the bug can be found [here](https://docs.google.com/document/d/1gWjKsbNoRwuSexjAxgqw_1R9MaJEckMIZY0cX2_NoaY/edit#).

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services