Skip to content

Commit c8bd351

Browse files
author
anzz1
committed
Revert "🚀 Dockerize llamacpp (antimatter15#132)"
This reverts commit 2af23d3.
1 parent 5bdf5dc commit c8bd351

File tree

8 files changed

+4
-306
lines changed

8 files changed

+4
-306
lines changed

‎.devops/full.Dockerfile

-17
This file was deleted.

‎.devops/main.Dockerfile

-18
This file was deleted.

‎.devops/tools.sh

-46
This file was deleted.

‎.dockerignore

-24
This file was deleted.

‎.github/workflows/build.yml

+4-41
Original file line numberDiff line numberDiff line change
@@ -17,7 +17,7 @@ env:
1717
BRANCH_NAME: ${{ github.head_ref || github.ref_name }}
1818

1919
jobs:
20-
ubuntu-latest-make:
20+
ubuntu-latest:
2121
runs-on: ubuntu-latest
2222

2323
steps:
@@ -36,27 +36,8 @@ jobs:
3636
run: |
3737
make
3838
39-
ubuntu-latest-cmake:
40-
runs-on: ubuntu-latest
41-
42-
steps:
43-
- name: Clone
44-
uses: actions/checkout@v1
45-
46-
- name: Dependencies
47-
run: |
48-
sudo apt-get update
49-
sudo apt-get install build-essential
50-
51-
- name: Build
52-
run: |
53-
mkdir build
54-
cd build
55-
cmake ..
56-
cmake --build . --config Release
57-
58-
macOS-latest-make:
59-
runs-on: macos-latest
39+
macOS-latest:
40+
runs-on: macOS-latest
6041

6142
steps:
6243
- name: Clone
@@ -73,25 +54,7 @@ jobs:
7354
run: |
7455
make
7556
76-
macOS-latest-cmake:
77-
runs-on: macOS-latest
78-
79-
steps:
80-
- name: Clone
81-
uses: actions/checkout@v1
82-
83-
- name: Dependencies
84-
run: |
85-
brew update
86-
87-
- name: Build
88-
run: |
89-
mkdir build
90-
cd build
91-
cmake ..
92-
cmake --build . --config Release
93-
94-
windows-latest-cmake:
57+
windows-latest:
9558
runs-on: windows-latest
9659

9760
steps:

‎.github/workflows/docker.yml

-61
This file was deleted.

‎README.md

-33
Original file line numberDiff line numberDiff line change
@@ -32,7 +32,6 @@ Supported platforms:
3232
- [X] Mac OS
3333
- [X] Linux
3434
- [X] Windows (via CMake)
35-
- [X] Docker
3635

3736
---
3837

@@ -237,38 +236,6 @@ Finally, copy the `llama` binary and the model files to your device storage. Her
237236

238237
https://user-images.githubusercontent.com/271616/225014776-1d567049-ad71-4ef2-b050-55b0b3b9274c.mp4
239238

240-
### Docker
241-
242-
#### Prerequisites
243-
* Docker must be installed and running on your system.
244-
* Create a folder to store big models & intermediate files (in ex. im using /llama/models)
245-
246-
#### Images
247-
We have two Docker images available for this project:
248-
249-
1. `ghcr.io/ggerganov/llama.cpp:full`: This image includes both the main executable file and the tools to convert LLaMA models into ggml and convert into 4-bit quantization.
250-
2. `ghcr.io/ggerganov/llama.cpp:light`: This image only includes the main executable file.
251-
252-
#### Usage
253-
254-
The easiest way to download the models, convert them to ggml and optimize them is with the --all-in-one command which includes the full docker image.
255-
256-
```bash
257-
docker run -v /llama/models:/models ghcr.io/ggerganov/llama.cpp:full --all-in-one "/models/" 7B
258-
```
259-
260-
On complete, you are ready to play!
261-
262-
```bash
263-
docker run -v /llama/models:/models ghcr.io/ggerganov/llama.cpp:full --run -m /models/7B/ggml-model-q4_0.bin -p "Building a website can be done in 10 simple steps:" -n 512
264-
```
265-
266-
or with light image:
267-
268-
```bash
269-
docker run -v /llama/models:/models ghcr.io/ggerganov/llama.cpp:light -m /models/7B/ggml-model-q4_0.bin -p "Building a website can be done in 10 simple steps:" -n 512
270-
```
271-
272239
## Limitations
273240

274241
- We don't know yet how much the quantization affects the quality of the generated text

‎download-pth.py

-66
This file was deleted.

0 commit comments

Comments
 (0)