bug: Fail to get list model information: Unable to create model.list file

[freelerobot]

A bit of a regression because models.list is still in progress.
I know this is WiP, but I wanted to create this issue anyway, so we remember to check it works later on.

Cortex version

v75

Describe the Bug

• use v75 to download models
• run models list

❯ ls
llama3.1                          llama3.1.yaml                     stable-code-instruct-3b-GGUF      stable-code-instruct-3b-GGUF.yaml

❯ cortex-nightly models list
Fail to get list model information: Unable to create model.list file: /Users/nicolezhu/cortexcpp-nightly/models/model.list
+---------+----+-------------+--------+---------+
| (Index) | ID | model alias | engine | version |
+---------+----+-------------+--------+---------+
❯ ls
Applications            Movies                  Postman Agent           cortexcpp-nightly       homebrewltd             package-lock.json
Desktop                 Music                   Public                  deleteme.js             jan                     settings.json
Documents               Pictures                Screen Studio Projects  docs                    janhq                   uploads
Downloads               Portia                  Sites                   experiments             llama.log               zk
Library                 Postman                 cortex-web              go                      mambaforge              zsh-syntax-highlighting

Steps to Reproduce

1. Download a few models
2. run models list
3. Doesn't work

Screenshots / Logs

see above

What is your OS?

• MacOS
• Windows
• Linux

What engine are you running?

• cortex.llamacpp (default)
• cortex.tensorrt-llm (Nvidia GPUs)
• cortex.onnx (NPUs, DirectML)

[freelerobot]

Questions:

• when do we create the models.list file?
• dynamically? i.e. only when some commands are executed
• along with the cortex installation? i.e. comes with cortexcpp folder?
• many edge cases on this front depending on our choices.

[namchuai]

@0xSage , this issue will be solved when this epic is finished.

[freelerobot]

@0xSage , this issue will be solved when this epic is finished.

Noted - thank you!

[freelerobot]

fixed