Skip to content

change default temperature of OAI compat API from 0 to 1 #1335

change default temperature of OAI compat API from 0 to 1

change default temperature of OAI compat API from 0 to 1 #1335

Triggered via pull request May 12, 2024 00:26
@KartoffelsaftKartoffelsaft
synchronize #7226
Status Success
Total duration 2h 15m 30s
Artifacts 3

bench.yml

on: pull_request_target
Matrix: bench-server-baseline
Fit to window
Zoom out
Zoom in

Annotations

15 warnings
bench-server-baseline (phi-2, f16)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: Sibz/github-status-action@v1, devicons/public-upload-to-imgur@v2.2.2. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
bench-server-baseline (phi-2, f16)
The following actions uses node12 which is deprecated and will be forced to run on node16: Sibz/github-status-action@v1, devicons/public-upload-to-imgur@v2.2.2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
bench-server-baseline (phi-2, f16)
Restore cache failed: Dependencies file is not found in /github-runner/_work/llama.cpp/llama.cpp. Supported file pattern: go.sum
bench-server-baseline (phi-2, f16)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
bench-server-baseline (phi-2, f16)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
bench-server-baseline (phi-2, q8_0)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: Sibz/github-status-action@v1, devicons/public-upload-to-imgur@v2.2.2. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
bench-server-baseline (phi-2, q8_0)
The following actions uses node12 which is deprecated and will be forced to run on node16: Sibz/github-status-action@v1, devicons/public-upload-to-imgur@v2.2.2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
bench-server-baseline (phi-2, q8_0)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
bench-server-baseline (phi-2, q8_0)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
bench-server-baseline (phi-2, q8_0)
Restore cache failed: Dependencies file is not found in /github-runner/_work/llama.cpp/llama.cpp. Supported file pattern: go.sum
bench-server-baseline (phi-2, q4_0)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: Sibz/github-status-action@v1, devicons/public-upload-to-imgur@v2.2.2. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
bench-server-baseline (phi-2, q4_0)
The following actions uses node12 which is deprecated and will be forced to run on node16: Sibz/github-status-action@v1, devicons/public-upload-to-imgur@v2.2.2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
bench-server-baseline (phi-2, q4_0)
Restore cache failed: Dependencies file is not found in /github-runner/_work/llama.cpp/llama.cpp. Supported file pattern: go.sum
bench-server-baseline (phi-2, q4_0)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
bench-server-baseline (phi-2, q4_0)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/

Artifacts

Produced during runtime
Name Size
bench-server-bench-server-baseline-Standard_NC4as_T4_v3-phi-2-f16 Expired
194 KB
bench-server-bench-server-baseline-Standard_NC4as_T4_v3-phi-2-q4_0 Expired
168 KB
bench-server-bench-server-baseline-Standard_NC4as_T4_v3-phi-2-q8_0 Expired
202 KB