You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@inlong.apache.org by GitBox <gi...@apache.org> on 2022/10/26 09:14:12 UTC
[GitHub] [inlong] yunqingmoswu opened a new issue, #6296: [Improve][Sort] Split one record to multiple records when the physical data has more records for KafkaLoadNode
yunqingmoswu opened a new issue, #6296:
URL: https://github.com/apache/inlong/issues/6296
### Description
Split one record to multiple records when the physical data has more records for KafkaLoadNode.
It is only used for multiple sink scenario, for example, the raw data is:
``` {
"data":[
{
"id":352,
"price":1.14,
"currency":"US",
"order_time":"2022-08-16 18:59:09"
},
{
"id":353,
"price":1.22,
"currency":"US",
"order_time":"2022-08-16 18:59:09"
}
],
"type":"INSERT",
"pkNames":[
"id"
],
"database":"inlong",
"ts":1666772931248,
"table":"orders"
}
```
and then it will be split into two records when writing as follows:
```
{
"data":[
{
"id":352,
"price":1.14,
"currency":"US",
"order_time":"2022-08-16 18:59:09"
}
],
"type":"INSERT",
"pkNames":[
"id"
],
"database":"inlong",
"ts":1666772931248,
"table":"orders"
}
{
"data":[
{
"id":353,
"price":1.22,
"currency":"US",
"order_time":"2022-08-16 18:59:09"
}
],
"type":"INSERT",
"pkNames":[
"id"
],
"database":"inlong",
"ts":1666772931248,
"table":"orders"
}
```
### InLong Component
InLong Sort
### Are you willing to submit PR?
- [X] Yes, I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@inlong.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [inlong] healchow closed issue #6296: [Improve][Sort] Split one record to multiple records when the physical data has more records for KafkaLoadNode
Posted by GitBox <gi...@apache.org>.
healchow closed issue #6296: [Improve][Sort] Split one record to multiple records when the physical data has more records for KafkaLoadNode
URL: https://github.com/apache/inlong/issues/6296
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org