Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Moving from ARFF to Parquet #1032

Open
PGijsbers opened this issue Mar 2, 2021 · 0 comments
Open

Moving from ARFF to Parquet #1032

PGijsbers opened this issue Mar 2, 2021 · 0 comments
Labels
Data OpenML concept enhancement in progress priority serverside These issues are present in the rest API and not fixable by the Python package.
Milestone

Comments

@PGijsbers
Copy link
Collaborator

PGijsbers commented Mar 2, 2021

Roadmap (when #1029 is merged):

  • wait for production server to include minio references in the dataset description (hence serverside)
  • update the unit tests when the test server has a separate dedicated minio instance
  • do an investigation to see if, or for which datasets, pickle support should be maintained (see Should the pickle speed up be supported after Parquet integration? #1027)
  • remove downloading and processing of arff files by default
  • determine if manual download of arff file should still be supported (I'd argue at least in the immediate feature that's a good thing)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Data OpenML concept enhancement in progress priority serverside These issues are present in the rest API and not fixable by the Python package.
Projects
None yet
Development

No branches or pull requests

2 participants