Replies: 1 comment 1 reply
-
In NodeJS you cannot really trigger the garbage collector and most likely it won't make any difference anyway, since one of the times it gets triggered automatic is before you run out of memory. So either there are leaks in the code or you are just having too much data loaded at the same time... |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
First of all, sorry for bad English.
I try to use bull within massive batch process in cron to make small pieces of batch.
There are so many db columns per batch (1M+) so I need to devide small pieces of batch.
(Definitely without deviding small pieces of batch, out of memory will come out.)
My concern is, garbage collector can be garbaged in process callback function?
If not, still there will be same memory issue on my problem.
FYI)
I plan to build batch process like java's spring batch process using bull.
DB Counting -> Devide small pieces of batch (simply 100 db columns per job) -> DB Inserting What Job is -> Queueing pass through job db id -> process callback
Beta Was this translation helpful? Give feedback.
All reactions