Skip to content

A basic C++ implementation of Llama inference

License

Notifications You must be signed in to change notification settings

mbeier96/LowLlamaBasic

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

15 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Llama C++ playground

Setup:

apt install ninja-build
mkdir third-party
wget -P third_party https://github.com/nlohmann/json/raw/refs/tags/v3.11.3/single_include/nlohmann/json.hpp

VSCode

.vscode/c_cpp_properties.json:

{
  "configurations": [
    {
      "name": "default",
      "cppStandard": "c++20",
      "intelliSenseMode": "linux-gcc-x64",
      "compilerPath": "/usr/bin/gcc",
      "includePath": ["${workspaceFolder}/third_party"]
    }
  ],
  "version": 4
}

About

A basic C++ implementation of Llama inference

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • C++ 77.9%
  • Python 22.1%