Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Optimizations and clean up #24

Open
widberg opened this issue Oct 10, 2023 · 0 comments
Open

Optimizations and clean up #24

widberg opened this issue Oct 10, 2023 · 0 comments
Assignees
Milestone

Comments

@widberg
Copy link
Owner

widberg commented Oct 10, 2023

Avoid recompressing resource bodies when writing to the pool

Parallelize reading/writing the actual BigFile file by only scanning for resource offsets the first time through and not actually reading/decompressing anything

Store binary versions of resources in a hidden folder and use those to avoid redoing work when importing if none of the exported files were modified.

Use arrayfire or similar for reverse crc

Use rayon for sorting and filtering in the GUI, and potentially other places

Use base64 for large byte arrays when serializing (https://docs.rs/serde_with/latest/serde_with/base64/index.html ?).

@widberg widberg added this to bff Oct 8, 2023
@widberg widberg converted this from a draft issue Oct 10, 2023
@widberg widberg self-assigned this Oct 10, 2023
@widberg widberg changed the title Optimizations Optimizations and clean up Nov 1, 2023
@widberg widberg added this to the v0.1.0 milestone Nov 15, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: Todo
Development

No branches or pull requests

1 participant