[I] [Bug][Sort] Infinite log growth causes insufficient disk space on sort-flink-v1.13 [inlong]

["XiaoYou201 (via GitHub)" <gi...@apache.org>]

XiaoYou201 opened a new issue, #9925:
URL: https://github.com/apache/inlong/issues/9925

   ### What happened
   
   ### Infinite log growth causes insufficient disk space
   When I use inlong mysql cdc tp clickhouse(ck), The taskmanager log has abnormal as follow picture ans description.
   
   ![EOH97W5GT4ZK5 TDAUP TC5](https://github.com/apache/inlong/assets/58425449/8ca198dc-ec38-4ae4-9e60-5845e6c1800a)
   
   ![H`XU}_C7}ML}~HLCTSF4(G](https://github.com/apache/inlong/assets/58425449/c37f6008-044e-4dc8-b6b4-362804107694)
   
   The log keeps printing the same message. This message should be printed when There is update or delete operation for ck and should not appear so many times.
   
   When I use inlong web ui to run official test case  through docker, several hours later, my disk is full.
   
   ![image](https://github.com/apache/inlong/assets/58425449/6fb2f13a-c77c-4746-85a3-1d2b28a66309)
   
   But before run mysql to ck test case, my disk has enough space.
   
   ![4_{X~QVVEHH%B9JZ7KBG$9V](https://github.com/apache/inlong/assets/58425449/ace804eb-d71a-40ff-9f2e-90661037aac8)
   
   
   ### What you expected to happen
   
   - Logs should not grow indefinitely.
   - Logs should not print out operations that do not exist
   
   The above instructions are only for mysql to clickhouse
   
   ### How to reproduce
   
   mysql to clickhouse use two module as follow.
   ### Mysql-cdc
   I onle tested mysql cdc module. It's log has not exception.
   ### JDBC
   The inlong use JDBC to connect clickhouse and execute operation(select, insert, update,delete...). I guess the implement of JDBC module has a little problem lead to this bug happen.So, I try to check JDBC module code.
   
   ### Environment
   
   Ubuntu 22.04
   Docker Server Version: 25.0.3
   
   ### InLong version
   
   master
   
   ### InLong Component
   
   InLong Sort
   
   ### Are you willing to submit PR?
   
   - [X] Yes, I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@inlong.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Bug][Sort] Infinite log growth causes insufficient disk space on sort-flink-v1.13(Mysql to Clickhouse) [inlong]

["dockerzhang (via GitHub)" <gi...@apache.org>]

dockerzhang closed issue #9925: [Bug][Sort] Infinite log growth causes insufficient disk space on sort-flink-v1.13(Mysql to Clickhouse)
URL: https://github.com/apache/inlong/issues/9925


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@inlong.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org