[GitHub] [inlong] liaorui opened a new issue, #7391: [Improve][Sort]StarRocks connector support csv format and dirty data collection when whole db migration

["liaorui (via GitHub)" <gi...@apache.org>]

liaorui opened a new issue, #7391:
URL: https://github.com/apache/inlong/issues/7391

   ### Description
   
   When migrating the whole db, the records are composed with JSON format to submit to StarRocks Server. JSON data may cause StarRocks Server high CPU loads. Data with CSV format will reduce CPU loads.
   
   Records will be lost if an exception threw by StarRocks Server.  We may upload the records to S3 bucket as dirty data. This is useful when auditing and checking.
   
   ### InLong Component
   
   InLong Sort
   
   ### Are you willing to submit PR?
   
   - [X] Yes, I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@inlong.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [inlong] gong closed issue #7391: [Improve][Sort] Support CSV format and dirty data collecting for StarRocks connector

["gong (via GitHub)" <gi...@apache.org>]

gong closed issue #7391: [Improve][Sort] Support CSV format and dirty data collecting for StarRocks connector
URL: https://github.com/apache/inlong/issues/7391


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@inlong.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org