This repository was archived by the owner on Jul 4, 2025. It is now read-only.
This repository was archived by the owner on Jul 4, 2025. It is now read-only.
epic: Basic Automated test for Installation & Inference on compatible Hardware & OS #1147
Description
Goal
- We should test for full e2e lifecycle of Cortex's main use case
- This only covers llama.cpp for v0.1
Existing Work
- Current e2e test
- Previous Google Spreadsheet
- Nicole to add Hardware Compatibility Matrix
- Cortex.cpp: Hardware & OS Compatibility Matrix [WIP] #1125
Existing Bugs
- Prev bug with appimage and Fedora bug: Cortex exited with code null immediately after loading a model #1105
Test Cases
Test Harness
Installation & Uninstallation
- Test successful installation on all OS and hardware Cortex.cpp: Hardware & OS Compatibility Matrix [WIP] #1125
Starting
- Starts within X seconds (previous bug: bug: Slow load on Windows on first time run of Cortex #929)
Model Running
- Successful load of cached model (e.g. tinyllama)
- Successful inference request of cached model
- Error messages are tested
- Successful unloading of model
- Ensure
dylibissue is covered bug: libengine.dylib not found #953
Stopping
- Successfully stops with no dangling processes
Uninstallation
- Successfully uninstalls with no dangling files