[jira] [Commented] (KAFKA-8611) Add KStream#repartition operation

["ASF GitHub Bot (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KAFKA-8611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17081716#comment-17081716 ] 

ASF GitHub Bot commented on KAFKA-8611:
---------------------------------------

lkokhreidze commented on pull request #8470: KAFKA-8611 / Refactor KStreamRepartitionIntegrationTest
URL: https://github.com/apache/kafka/pull/8470
 
 
   Follow-up PR on https://github.com/apache/kafka/pull/7170 that implements @mjsax 's [suggestions](https://github.com/apache/kafka/pull/7170#discussion_r406535443) regarding integration test parameters.
   ### Committer Checklist (excluded from commit message)
   - [ ] Verify design and implementation 
   - [ ] Verify test coverage and CI build status
   - [ ] Verify documentation (including upgrade notes)
   
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> Add KStream#repartition operation
> ---------------------------------
>
>                 Key: KAFKA-8611
>                 URL: https://issues.apache.org/jira/browse/KAFKA-8611
>             Project: Kafka
>          Issue Type: New Feature
>          Components: streams
>            Reporter: Levani Kokhreidze
>            Assignee: Levani Kokhreidze
>            Priority: Minor
>              Labels: kip
>             Fix For: 2.6.0
>
>
> When using DSL in Kafka Streams, data re-partition happens only when key-changing operation is followed by stateful operation. On the other hand, in DSL, stateful computation can happen using _transform()_ operation as well. Problem with this approach is that, even if any upstream operation was key-changing before calling _transform()_, no auto-repartition is triggered. If repartitioning is required, a call to _through(String)_ should be performed before _transform()_. With the current implementation, burden of managing and creating the topic falls on user and introduces extra complexity of managing Kafka Streams application.
> KIP-221: [https://cwiki.apache.org/confluence/display/KAFKA/KIP-221%3A+Enhance+DSL+with+Connecting+Topic+Creation+and+Repartition+Hint]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)