You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by GitBox <gi...@apache.org> on 2022/04/15 21:55:25 UTC
[GitHub] [samza] lakshmi-manasa-g opened a new pull request, #1596: SAMZA-2732: [Elasticity] Add elasticityFactor into the TaskName when elasticity is enabled
lakshmi-manasa-g opened a new pull request, #1596:
URL: https://github.com/apache/samza/pull/1596
Feature: Elasticity (SAMZA-2687) for a Samza job allows job to have more tasks than the number of input SystemStreamPartition(SSP). Thus, a job can scale up beyond its input partition count without needing the repartition the input stream.
Changes:
When elasticity is enabled, change the task name as follows
1. GroupByPartition SSP grouper: from "Partition 0 1" to "Partition 0_1_2" where 0 is the input partition, 1 is the keyBucket and 2 is the elasticity factor.
2. GroupBySystemStreamPartition SSP grouper: from "SystemStreamPartition [systemA, streamB, 0, 1]" to "SystemStreamPartition [systemA, streamB, 0, 1]_2" where 0 is the input partition, 1 is the keyBucket and 2 is the elasticity factor.
Tests: updated existing tests
API changes: none
Usage/ upgrade instructions: applicable when "job.elasticity.factor" is set to >1
Backwards compatible: yes. does not affect task name format when elasticity is disabled.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@samza.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [samza] rayman7718 merged pull request #1596: SAMZA-2732: [Elasticity] Add elasticityFactor into the TaskName when elasticity is enabled
Posted by GitBox <gi...@apache.org>.
rayman7718 merged PR #1596:
URL: https://github.com/apache/samza/pull/1596
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@samza.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [samza] xiefan46 commented on pull request #1596: SAMZA-2732: [Elasticity] Add elasticityFactor into the TaskName when elasticity is enabled
Posted by GitBox <gi...@apache.org>.
xiefan46 commented on PR #1596:
URL: https://github.com/apache/samza/pull/1596#issuecomment-1107948814
lgtm
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@samza.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org