error on loading data in NeDB

[punkish]

I am trying to load bulk records (about 200K) into NedB. I get the following error

/path/to/node_modules/nedb/lib/persistence.js:195
toPersist += self.afterSerialization(model.serialize(doc)) + '\n';
                                                        
RangeError: Invalid string length

[JamesMGreene]

Although NeDB does do its updates in append mode, it also does a full datafile rewrite at the end of the initial loading process and during every compaction operation. If your total record size, when represented as a string, exceeds 256MB, then it will fail as Node.js/V8/JS does not support that large of a string.

See PR #463 for one proposed change that might fix this for you.

I've been working on resolving this in my fork, NestDB, (see JamesMGreene/nestdb#6) but my work is currently stalled out due to lack of free time and a temporary deprioritization of my related at-work project.