You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by GitBox <gi...@apache.org> on 2020/09/23 21:45:18 UTC

[GitHub] [samza] mynameborat opened a new pull request #1433: SAMZA-2593: Update task callback to store only necessary fields instead of the message envelope

mynameborat opened a new pull request #1433:
URL: https://github.com/apache/samza/pull/1433


   **Problem**: TaskCallbackImpl currently stores the entire message envelope. In case of jobs that have 1000s of pending callbacks, this adds up to significant memory pressure. The only use for message envelope is to trace the SSP information and the offset associated with it so that we commit the right offset during our commit cycle.
   
   ![image](https://user-images.githubusercontent.com/46942335/94072332-4e691a80-fdaa-11ea-8e5b-556c586da838.png)
   
   **Changes**: Modify TaskCallbackImpl to only store SSP and Offset information.
   **API Changes**: None
   **Tests**: None
   **Upgrade Instructions**: None
   **Usage Instructions**: None


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [samza] mynameborat merged pull request #1433: SAMZA-2593: Update task callback to store only necessary fields instead of the message envelope

Posted by GitBox <gi...@apache.org>.
mynameborat merged pull request #1433:
URL: https://github.com/apache/samza/pull/1433


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [samza] mynameborat merged pull request #1433: SAMZA-2593: Update task callback to store only necessary fields instead of the message envelope

Posted by GitBox <gi...@apache.org>.
mynameborat merged pull request #1433:
URL: https://github.com/apache/samza/pull/1433


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org