Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

CSV reader #200

Open
TomNicholas opened this issue Jul 22, 2024 · 0 comments
Open

CSV reader #200

TomNicholas opened this issue Jul 22, 2024 · 0 comments
Labels
enhancement New feature or request references generation Reading byte ranges from archival files

Comments

@TomNicholas
Copy link
Collaborator

It should be possible to write a reader for CSV files, which uses either separate files or chunks within the files as the different chunks in the manifest.

There is some interesting discussion on this on kerchunk, especially this more recent comment about using pyarrow

fsspec/kerchunk#66 (comment)

There is (unfortunately) a lot of scientific data in CSV format, perhaps this can also be represented as Zarr...

cc @itcarroll
@TomNicholas TomNicholas added enhancement New feature or request references generation Reading byte ranges from archival files labels Jul 22, 2024
@TomNicholas TomNicholas mentioned this issue Aug 8, 2024
Open
13 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request references generation Reading byte ranges from archival files
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@TomNicholas