This repository has been archived by the owner on Mar 23, 2023. It is now read-only.

Load directly from S3 #7

Open

dobesv opened this issue Dec 28, 2019 · 3 comments

Contributor

dobesv commented Dec 28, 2019

It would be nice to port over the S3 support from https://github.com/ZJONSSON/parquetjs

Would you accept a PR for this?

moltar commented Apr 25, 2021

Seems like unrelated concerns. I don't feel like a transform library should know about storage mechanisms.

Contributor Author

dobesv commented Apr 25, 2021

If it isn't aware of the storage mechanism, it might need some kind of plugin system for random access reads instead.

berenddeboer commented Sep 23, 2021

I think what it needs is simply support for Readable, just like it has for Writable?

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.