You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Infinite log growth causes insufficient disk space
When I use inlong mysql cdc to clickhouse(ck), The taskmanager log has abnormal as follow picture description.
The log keeps printing the same message. This message should be printed when There is update or delete operation for ck and should not appear so many times.
When I use inlong web ui to run official test case through docker, several hours later, my disk is full.
But before run mysql to ck test case, my disk has enough space.
What you expected to happen
Logs should not grow indefinitely.
Logs should not print out operations that do not exist
The above instructions are only for mysql to clickhouse
How to reproduce
mysql to clickhouse use two module as follow.
Mysql-cdc
I only tested mysql cdc module. It's log has not exception.
JDBC
The inlong use JDBC to connect clickhouse and execute operation(select, insert, update,delete...). I guess the implement of JDBC module has a little problem lead to this bug happen.So, I try to check JDBC module code.
XiaoYou201
changed the title
[Bug][Sort] Infinite log growth causes insufficient disk space on sort-flink-v1.13
[Bug][Sort] Infinite log growth causes insufficient disk space on sort-flink-v1.13(Mysql to Clickhouse)
Apr 5, 2024
What happened
Infinite log growth causes insufficient disk space
When I use inlong mysql cdc to clickhouse(ck), The taskmanager log has abnormal as follow picture description.
The log keeps printing the same message. This message should be printed when There is update or delete operation for ck and should not appear so many times.
When I use inlong web ui to run official test case through docker, several hours later, my disk is full.
But before run mysql to ck test case, my disk has enough space.
What you expected to happen
The above instructions are only for mysql to clickhouse
How to reproduce
mysql to clickhouse use two module as follow.
Mysql-cdc
I only tested mysql cdc module. It's log has not exception.
JDBC
The inlong use JDBC to connect clickhouse and execute operation(select, insert, update,delete...). I guess the implement of JDBC module has a little problem lead to this bug happen.So, I try to check JDBC module code.
Environment
Ubuntu 22.04
Docker Server Version: 25.0.3
InLong version
master
InLong Component
InLong Sort
Are you willing to submit PR?
Code of Conduct
The text was updated successfully, but these errors were encountered: