Skip to content

Commit

Permalink
ci: 1.19.0 release (#61)
Browse files Browse the repository at this point in the history
* ci: 1.19.0 release

* ci: update test fixture download url

* ci: cuda 12.x not supported
  • Loading branch information
kibae authored Aug 17, 2024
1 parent 75e16c5 commit 600bd8a
Show file tree
Hide file tree
Showing 11 changed files with 24 additions and 32 deletions.
12 changes: 4 additions & 8 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# ONNX Runtime Server

[![ONNX Runtime](https://img.shields.io/github/v/release/microsoft/onnxruntime?filter=v1.18.1&label=ONNX%20Runtime)](https://github.com/microsoft/onnxruntime)
[![ONNX Runtime](https://img.shields.io/github/v/release/microsoft/onnxruntime?filter=v1.19.0&label=ONNX%20Runtime)](https://github.com/microsoft/onnxruntime)
[![CMake on Linux](https://github.com/kibae/onnxruntime-server/actions/workflows/cmake-linux.yml/badge.svg)](https://github.com/kibae/onnxruntime-server/actions/workflows/cmake-linux.yml)
[![CMake on MacOS](https://github.com/kibae/onnxruntime-server/actions/workflows/cmake-macos.yml/badge.svg)](https://github.com/kibae/onnxruntime-server/actions/workflows/cmake-macos.yml)
[![License](https://img.shields.io/github/license/kibae/onnxruntime-server)](https://github.com/kibae/onnxruntime-server/blob/main/LICENSE)
Expand Down Expand Up @@ -158,15 +158,11 @@ sudo cmake --install build --prefix /usr/local/onnxruntime-server
# Docker

- Docker hub: [kibaes/onnxruntime-server](https://hub.docker.com/r/kibaes/onnxruntime-server)
- [`1.18.1-linux-cuda11`](https://github.com/kibae/onnxruntime-server/blob/main/deploy/build-docker/linux-cuda11.dockerfile)
amd64
- [`1.18.1-linux-cuda12`](https://github.com/kibae/onnxruntime-server/blob/main/deploy/build-docker/linux-cuda12.dockerfile)
amd64
- [`1.18.1-linux-cpu`](https://github.com/kibae/onnxruntime-server/blob/main/deploy/build-docker/linux-cpu.dockerfile)
amd64, arm64
- [`1.19.0-linux-cuda11`](https://github.com/kibae/onnxruntime-server/blob/main/deploy/build-docker/linux-cuda11.dockerfile) amd64(CUDA 11.x, cuDNN 8.x)
- [`1.19.0-linux-cpu`](https://github.com/kibae/onnxruntime-server/blob/main/deploy/build-docker/linux-cpu.dockerfile) amd64, arm64

```shell
DOCKER_IMAGE=kibae/onnxruntime-server:1.18.1-linux-cuda11 # or kibae/onnxruntime-server:1.18.1-linux-cpu
DOCKER_IMAGE=kibae/onnxruntime-server:1.19.0-linux-cuda11 # or kibae/onnxruntime-server:1.19.0-linux-cpu

docker pull ${DOCKER_IMAGE}

Expand Down
2 changes: 1 addition & 1 deletion deploy/build-docker/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@

## x64 with CUDA

- [ONNX Runtime Binary](https://github.com/microsoft/onnxruntime/releases) v1.18.1(latest) requires CUDA 11/12, cudnn 8.
- [ONNX Runtime Binary](https://github.com/microsoft/onnxruntime/releases) v1.19.0(latest) requires CUDA 11/12, cudnn 8.
```
$ ldd libonnxruntime_providers_cuda.so
linux-vdso.so.1 (0x00007fffa4bf8000)
Expand Down
2 changes: 1 addition & 1 deletion deploy/build-docker/VERSION
Original file line number Diff line number Diff line change
@@ -1,2 +1,2 @@
export VERSION=1.18.1
export VERSION=1.19.0
export IMAGE_PREFIX=kibaes/onnxruntime-server
10 changes: 5 additions & 5 deletions deploy/build-docker/build.sh
Original file line number Diff line number Diff line change
Expand Up @@ -37,11 +37,11 @@ if [ "$1" != "--target=cpu" ]; then
docker buildx build --platform linux/amd64 -t ${IMAGE_NAME} -f deploy/build-docker/${POSTFIX}.dockerfile --push . || exit 1


POSTFIX=linux-cuda12
IMAGE_NAME=${IMAGE_PREFIX}:${VERSION}-${POSTFIX}
# POSTFIX=linux-cuda12
# IMAGE_NAME=${IMAGE_PREFIX}:${VERSION}-${POSTFIX}

docker buildx build --platform linux/amd64 -t ${IMAGE_NAME} -f deploy/build-docker/${POSTFIX}.dockerfile --load . || exit 1
./deploy/build-docker/docker-image-test.sh ${IMAGE_NAME} 1 || exit 1
docker buildx build --platform linux/amd64 -t ${IMAGE_NAME} -f deploy/build-docker/${POSTFIX}.dockerfile --push . || exit 1
# docker buildx build --platform linux/amd64 -t ${IMAGE_NAME} -f deploy/build-docker/${POSTFIX}.dockerfile --load . || exit 1
# ./deploy/build-docker/docker-image-test.sh ${IMAGE_NAME} 1 || exit 1
# docker buildx build --platform linux/amd64 -t ${IMAGE_NAME} -f deploy/build-docker/${POSTFIX}.dockerfile --push . || exit 1
fi

4 changes: 2 additions & 2 deletions deploy/build-docker/docker-compose.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ services:
onnxruntime_server_simple:
# After the docker container is up, you can use the REST API (http://localhost:8080).
# API documentation will be available at http://localhost:8080/api-docs.
image: kibaes/onnxruntime-server:1.18.1-linux-cuda11
image: kibaes/onnxruntime-server:1.19.0-linux-cuda11
ports:
- "8080:80" # for http backend
volumes:
Expand All @@ -29,7 +29,7 @@ services:
onnxruntime_server_advanced:
# After the docker container is up, you can use the REST API (http://localhost, https://localhost).
# API documentation will be available at http://localhost/api-docs.
image: kibaes/onnxruntime-server:1.18.1-linux-cuda11
image: kibaes/onnxruntime-server:1.19.0-linux-cuda11
ports:
- "80:80" # for http backend
- "443:443" # for https backend
Expand Down
14 changes: 5 additions & 9 deletions docs/docker.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,12 +5,8 @@

# Supported tags and respective Dockerfile links

- [`1.18.1-linux-cuda11`](https://github.com/kibae/onnxruntime-server/blob/main/deploy/build-docker/linux-cuda11.dockerfile)
amd64
- [`1.18.1-linux-cuda12`](https://github.com/kibae/onnxruntime-server/blob/main/deploy/build-docker/linux-cuda12.dockerfile)
amd64
- [`1.18.1-linux-cpu`](https://github.com/kibae/onnxruntime-server/blob/main/deploy/build-docker/linux-cpu.dockerfile)
amd64, arm64
- [`1.19.0-linux-cuda11`](https://github.com/kibae/onnxruntime-server/blob/main/deploy/build-docker/linux-cuda11.dockerfile) amd64(CUDA 11.x, cuDNN 8.x)
- [`1.19.0-linux-cpu`](https://github.com/kibae/onnxruntime-server/blob/main/deploy/build-docker/linux-cpu.dockerfile) amd64, arm64

# How to use this image

Expand All @@ -32,7 +28,7 @@
- API documentation will be available at http://localhost/api-docs.

```shell
DOCKER_IMAGE=kibae/onnxruntime-server:1.18.1-linux-cuda11 # or kibae/onnxruntime-server:1.18.1-linux-cpu
DOCKER_IMAGE=kibae/onnxruntime-server:1.19.0-linux-cuda11 # or kibae/onnxruntime-server:1.19.0-linux-cpu

docker pull ${DOCKER_IMAGE}

Expand Down Expand Up @@ -73,7 +69,7 @@ services:
onnxruntime_server_simple:
# After the docker container is up, you can use the REST API (http://localhost:8080).
# API documentation will be available at http://localhost:8080/api-docs.
image: kibaes/onnxruntime-server:1.18.1-linux-cuda11
image: kibaes/onnxruntime-server:1.19.0-linux-cuda11
ports:
- "8080:80" # for http backend
volumes:
Expand Down Expand Up @@ -105,7 +101,7 @@ services:
onnxruntime_server_advanced:
# After the docker container is up, you can use the REST API (http://localhost, https://localhost).
# API documentation will be available at http://localhost/api-docs.
image: kibaes/onnxruntime-server:1.18.1-linux-cuda11
image: kibaes/onnxruntime-server:1.19.0-linux-cuda11
ports:
- "80:80" # for http backend
- "443:443" # for https backend
Expand Down
2 changes: 1 addition & 1 deletion docs/swagger/openapi.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@ openapi: 3.0.3
info:
title: ONNX Runtime Server
description: |-
version: 1.18.1
version: 1.19.0
externalDocs:
description: ONNX Runtime Server
url: https://github.com/kibae/onnxruntime-server
Expand Down
2 changes: 1 addition & 1 deletion src/test/test_lib_version.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -6,5 +6,5 @@
#include "./test_common.hpp"

TEST(test_lib_version, LibVersion) {
EXPECT_EQ(onnxruntime_server::onnx::version(), "1.18.1");
EXPECT_EQ(onnxruntime_server::onnx::version(), "1.19.0");
}
4 changes: 2 additions & 2 deletions test/fixture/download-test-fixtures.sh
Original file line number Diff line number Diff line change
Expand Up @@ -2,5 +2,5 @@

cd "$(dirname "$0")" || exit

curl -o sample/1/model.onnx "https://kibae.blob.core.windows.net/static/model1.onnx"
curl -o sample/2/model.onnx "https://kibae.blob.core.windows.net/static/model2.onnx"
curl -o sample/1/model.onnx "http://server.11math.com/static/onnxruntime-server/sample/model1.onnx"
curl -o sample/2/model.onnx "http://server.11math.com/static/onnxruntime-server/sample/model2.onnx"
2 changes: 1 addition & 1 deletion test/fixture/sample/1/README.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
# Sample model 1

- test/sample-onnx-generator/sample-model1.py
- https://kibae.blob.core.windows.net/static/model1.onnx
- http://server.11math.com/static/onnxruntime-server/sample/model1.onnx
2 changes: 1 addition & 1 deletion test/fixture/sample/2/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,4 +2,4 @@

- https://huggingface.co/alimazhar-110/website_classification
- test/sample-onnx-generator/website_classification.py
- https://kibae.blob.core.windows.net/static/model2.onnx
- http://server.11math.com/static/onnxruntime-server/sample/model2.onnx

0 comments on commit 600bd8a

Please sign in to comment.