JSON stream parser (SAX parser)
SAX (Simple API for XML) is an event-driven online algorithm for lexing and parsing XML documents (wiki). Same kind of algorithm works also for JSON documents.
This is pure Python implementation, so if you are looking for a high performance parser, it is not the right choice. Take a look at the C, C++, Rust and even C# which have highly optimizing compilers, or to third-party packages based on C/C++ modules.
- extremely low memory consuming: only the small JSON piece being parsed is loaded in the memory every time
- no third-party package dependencies: you just need to copy the
json_sax.pymodule into your application - can parse an infinite stream
These features may be valuable for embedded development, and for prototyping
See in the examples folder
captor_data: analyzing a time series stored as an array of objects. When processing, only one object is loaded in the memory