Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Session serialization to zipped yaml/tsv #149

Merged
merged 7 commits into from
Feb 25, 2025
Merged

Session serialization to zipped yaml/tsv #149

merged 7 commits into from
Feb 25, 2025

Conversation

dweindl
Copy link
Member

@dweindl dweindl commented Feb 12, 2025

Serialize session data to a zipped yaml file and tsv files instead of pickling, so the data is portable across different versions of Python and other dependencies.

Added as an optional, more portable, but significantly slower alternative to numpy/pickle.

Closes #24.

@dweindl dweindl force-pushed the gh24_yaml branch 5 times, most recently from 18b6b93 to 0389e19 Compare February 25, 2025 18:23
Related to #24. Serialize session data to a zipped yaml file and tsv files instead of pickling, so the data is portable across different versions of Python and other dependencies.

Currently, this is still too slow. If we can reduce the amount of data without losing much, this could be become viable.
@dweindl dweindl marked this pull request as ready for review February 25, 2025 21:27
@dweindl dweindl merged commit a6cb3c1 into main Feb 25, 2025
9 checks passed
@dweindl dweindl deleted the gh24_yaml branch February 25, 2025 21:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Consider a different serialization format for saving sessions
1 participant