You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "Lakshmi Manasa Gaduputi (Jira)" <ji...@apache.org> on 2022/05/31 19:24:00 UTC

[jira] [Created] (SAMZA-2745) [Elasticity] handle processing of watermark and end of stream when elasticity is enabled

Lakshmi Manasa Gaduputi created SAMZA-2745:
----------------------------------------------

             Summary: [Elasticity] handle processing of watermark and end of stream when elasticity is enabled
                 Key: SAMZA-2745
                 URL: https://issues.apache.org/jira/browse/SAMZA-2745
             Project: Samza
          Issue Type: Sub-task
            Reporter: Lakshmi Manasa Gaduputi
            Assignee: Lakshmi Manasa Gaduputi


When elasticity is enabled, watermark or end of stream message throws SSP not registered within TaskInstance. This is because, these two types of messages need to be routed to all tasks consuming an SSP irrespective of the exact key bucket of the SSP the task is processing. However, TaskInstance does not look out for these types of messages outside of its SSPKeyBucket and throws an exception. 

 

Fix: Update TaskInstance class to accept watermark or end of stream messages even if they are outside the exact key bucket of the task.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)