Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Investigate library to stream read JSON #1

Open
DmitryMK opened this issue Aug 26, 2022 · 2 comments
Open

Investigate library to stream read JSON #1

DmitryMK opened this issue Aug 26, 2022 · 2 comments
Labels
question Further information is requested

Comments

@DmitryMK
Copy link
Contributor

Check if Pandas can be used to reading JSON as a stream
@DmitryMK DmitryMK added the question Further information is requested label Aug 26, 2022
@CimimUxMaio
Copy link
Contributor

CimimUxMaio commented Aug 30, 2022 •
edited
Loading

Found this library: ijson that may be a bit more to the point.

Update:

Found other, maybe useful, info and tools:

@mbringas
Copy link
Contributor

mbringas commented Sep 1, 2022

Hi!
I'm not sure how efficient this is, but json-stream library is quite easy to use and allows us to iterate only over "inner sections" of json structure.

https://pypi.org/project/json-stream/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
question Further information is requested
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@DmitryMK @CimimUxMaio @mbringas