Support inserting a single proto.block #1408
zdyj3170101136
started this conversation in
Feature requests
Replies: 2 comments 3 replies
-
@jkaflik cc |
Beta Was this translation helpful? Give feedback.
0 replies
-
@zdyj3170101136 this sounds you are more interested with API like https://github.com/ClickHouse/ch-go does provide. What do you think? |
Beta Was this translation helpful? Give feedback.
3 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Currently, an insert is implemented like this.
Usually, inserts are aggregated in the backend and inserted once every 100,000 records, which leads to very high memory usage of the service.
The block and user's []slice structures need to be released only after all data is successfully inserted, this would cost 10~ seconds.
If block-level insertion is allowed, the user's []slice structure can be released as soon as possible to reduce memory usage.
1, convert []slice to block
2, release []slice
3, send block to backend.
Beta Was this translation helpful? Give feedback.
All reactions