Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FEATURE] Migrate from fs to fsspec #488

Closed
goodwanghan opened this issue Jul 12, 2023 · 0 comments · Fixed by #523
Closed

[FEATURE] Migrate from fs to fsspec #488

goodwanghan opened this issue Jul 12, 2023 · 0 comments · Fixed by #523
Labels
core feature enhancement New feature or request refactoring
Milestone
0.8.7

Comments

@goodwanghan
Copy link
Collaborator

  1. fsspec is a lot more popular than the package fs (based on pkg downloads).
  2. fsspec is used by pandas and dask
  3. cloud storage extensions of fsspec are up tp date. In contrast fs-s3fs latest release is in 2019...

In addition, there is not very strong coupling with fs in Fugue. We need to remove the usage of triad.FileSystem, replace with fsspec, and also remove fs property from ExecutionEngine.
@goodwanghan goodwanghan added enhancement New feature or request refactoring labels Jul 12, 2023
@goodwanghan goodwanghan added this to the 0.8.7 milestone Oct 31, 2023
@goodwanghan goodwanghan linked a pull request Oct 31, 2023 that will close this issue
Replace fs with fsspec #523
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
core feature enhancement New feature or request refactoring
Projects
None yet
Milestone
0.8.7
Development

Successfully merging a pull request may close this issue.

Replace fs with fsspec fugue-project/fugue
1 participant
@goodwanghan