You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@inlong.apache.org by GitBox <gi...@apache.org> on 2022/10/18 13:40:06 UTC

[GitHub] [inlong] yunqingmoswu opened a new issue, #6212: [Feature][Sort] Support multiple sink for DorisLoadNode

yunqingmoswu opened a new issue, #6212:
URL: https://github.com/apache/inlong/issues/6212

   ### Description
   
   Support multiple sink for DorisLoadNode.
   In this scenario, we agree that the upstream data stream is binary data in a certain format such as 'canal-json' or 'debezium', 
   and the main processing steps as follows:
   1. Deserialize the binary data by the format specified with 'sink.multiple.format'
   2. Dynamic extract the database and table from it used with 'sink.multiple.database-pattern' and 'sink.multiple.table-pattern'
   3. Convert the deserialized data to the json data that is used for Doris StreamLoad
   4. Use StreamLoad load data to Doris used with the database and table that is extracted earlier.
   
   ### Use case
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [X] Yes, I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@inlong.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [inlong] healchow closed issue #6212: [Feature][Sort] Support multiple sink for DorisLoadNode

Posted by GitBox <gi...@apache.org>.
healchow closed issue #6212: [Feature][Sort] Support multiple sink for DorisLoadNode
URL: https://github.com/apache/inlong/issues/6212


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@inlong.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org