TextChunker CPU usage #690
xkzhud
started this conversation in
2. Feature requests
Replies: 3 comments
-
|
Could you provide a file to reproduce the problem? |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
sure .here is the doc |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
TODO: work with tokens, chunking/counting only once. To be part of semantic chunker feature. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Context / Scenario
finally,i found the problem. when excuting partition.
What happened?
when excuting partition step , the cpu increae from 0.06% to 46.6%. and the speed is slow. this perfomance problem may make km unusable.
the cpu cost should be reduce and the time cost should be reduce.
Importance
I cannot use Kernel Memory
Platform, Language, Versions
.net8
Relevant log output
No response
Beta Was this translation helpful? Give feedback.
All reactions