Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add packer and terraform for running a dev server in Hetzner #640

Closed
wants to merge 3 commits into from

Conversation

alexklibisz
Copy link
Owner

Related Issue

...

Changes

...

Testing and Validation

...

@alexklibisz
Copy link
Owner Author

alexklibisz commented Feb 3, 2024

Results on cx41 were:

Model Parameters Recall Queries per Second
eknn-l2lsh L=100 k=4 w=1024 candidates=500 probes=0 0.379 133.326
eknn-l2lsh L=100 k=4 w=1024 candidates=1000 probes=0 0.446 118.878
eknn-l2lsh L=100 k=4 w=1024 candidates=500 probes=3 0.635 101.896
eknn-l2lsh L=100 k=4 w=1024 candidates=1000 probes=3 0.717 94.297
eknn-l2lsh L=100 k=4 w=2048 candidates=500 probes=0 0.767 115.363
eknn-l2lsh L=100 k=4 w=2048 candidates=1000 probes=0 0.846 104.785
eknn-l2lsh L=100 k=4 w=2048 candidates=500 probes=3 0.921 79.075
eknn-l2lsh L=100 k=4 w=2048 candidates=1000 probes=3 0.960 73.672

@alexklibisz
Copy link
Owner Author

Performance in Hetzner was terrible compared to AWS. I'll open a PR shortly that adds a terraform file for spinning up a development and benchmarking instance in AWS.

@alexklibisz alexklibisz deleted the hetzner branch March 17, 2024 03:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant