Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Read multiple files/folders using read_csv #4909

Closed
saikrishna1-bidgely opened this issue Jan 14, 2023 · 0 comments · Fixed by #4908
Closed

Read multiple files/folders using read_csv #4909

saikrishna1-bidgely opened this issue Jan 14, 2023 · 0 comments · Fixed by #4908
Labels
enhancement New feature or request

Comments

@saikrishna1-bidgely
Copy link
Contributor

Is your feature request related to a problem or challenge? Please describe what you are trying to do.
I want to load files from multiple locations. In Spark, I can just give a list of paths and it works. Would like to do the same with read_csv, read_avro and read_parquet methods.

Describe the solution you'd like
Read a list of files using methods like so: read_csv(vec![String::new()])

Describe alternatives you've considered
I can read the paths one by one and then concatenate the dataframes but not sure if it is ok to do so.

Additional context
I have files from S3 in multiple locations and use the above methods to read them.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant