[GitHub] [inlong] Yizhou-Yang opened a new issue, #7900: [Feature][Sort] Kafka Sink Single Table Partition Strategy

["Yizhou-Yang (via GitHub)" <gi...@apache.org>]

Yizhou-Yang opened a new issue, #7900:
URL: https://github.com/apache/inlong/issues/7900

   ### Description
   
   Currently, Kafka sink single table partition strategy is defaulted to round-robin.
   This will cause binlogs to be in different partitions, unordered. Data will be lost when consuming kafka.
   
   TODO:
   Kafka single table support:
   1) partition by primary key
   2) partition by custum hash function (including letting the user pick one given partition)
   
   ddl: 2 weeks, but should submit pr by this week's end.
   
   
   
   ### Use case
   
   Kafka sink single table support partition strategy.
   
   ### Are you willing to submit PR?
   
   - [X] Yes, I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@inlong.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [inlong] dockerzhang closed issue #7900: [Feature][Sort] Support partition by custom fields when upsert single table of Kafka

["dockerzhang (via GitHub)" <gi...@apache.org>]

dockerzhang closed issue #7900: [Feature][Sort] Support partition by custom fields when upsert single table of Kafka
URL: https://github.com/apache/inlong/issues/7900


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@inlong.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org