Show file tree

Hide file tree

Changes from all commits

Commits

Show all changes

10 commits

Select commit Hold shift + click to select a range

86c4eb4

WIP HTTP server for streaming inferences

jack-michaud Mar 18, 2023

2cd1cf2

feat: HTTP server with streaming and full inference requests

jack-michaud Mar 19, 2023

1608a56

format

jack-michaud Mar 19, 2023

e65d8f6

docs: fix reference to old name in comment

jack-michaud Mar 19, 2023

2621c7e

Merge branch 'main' of github.com:setzer22/llama-rs into jm/llama-http

jack-michaud Mar 26, 2023

5906227

fix: update http cli args to be more accurate

jack-michaud Mar 26, 2023

7b52b83

feat: use log crate in http

jack-michaud Mar 26, 2023

3a9a44d

chore: fix the major versions in cargo.toml

jack-michaud Mar 26, 2023

541b498

feat: add env_logger to http

jack-michaud Mar 26, 2023

8940107

refactor: move model and session instantiation into InferenceSessionM…

jack-michaud Mar 26, 2023

File filter

Filter by extension

Filter by extension

.lock  (1) .rs  (3) .toml  (2) All 3 file types selected

---

Only manifest files

---

Viewed files

Jump to

Jump to file

Failed to load files. Retry

Loading