diff --git a/MyApp/MyApp.csproj b/MyApp/MyApp.csproj index 8221dc97..5cc282e7 100644 --- a/MyApp/MyApp.csproj +++ b/MyApp/MyApp.csproj @@ -33,6 +33,10 @@ + + + + diff --git a/MyApp/Pages/Index.cshtml b/MyApp/Pages/Index.cshtml index 20917f02..754f1794 100644 --- a/MyApp/Pages/Index.cshtml +++ b/MyApp/Pages/Index.cshtml @@ -33,7 +33,7 @@ What's new - Just shipped v8.4 + Just shipped v8.5 diff --git a/MyApp/_podcasts/2024-11-27_kamal-deployments.md b/MyApp/_podcasts/2024-11-27_kamal-deployments.md index ac3031d2..189f7c52 100644 --- a/MyApp/_podcasts/2024-11-27_kamal-deployments.md +++ b/MyApp/_podcasts/2024-11-27_kamal-deployments.md @@ -14,7 +14,6 @@ templates utilize Kamal, a CLI tool simplifying deployments to any Linux server Kamal automates tasks such as reverse proxy setup and TLS certificate management. The integration with GitHub Actions maintains CI/CD benefits while improving local management via Kamal's commands. -The authors express enthusiasm for Kamal's ease of use and potential for community growth. ### Videos diff --git a/MyApp/_posts/2024-11-26_ai-server.md b/MyApp/_posts/2024-11-26_ai-server.md index 7cdd555c..e90b7768 100644 --- a/MyApp/_posts/2024-11-26_ai-server.md +++ b/MyApp/_posts/2024-11-26_ai-server.md @@ -20,7 +20,7 @@ Introducing AI Server Designed as a one-stop solution to manage an organization's AI integrations for all their System Apps, by utilizing developer friendly HTTP JSON APIs that supports any programming language or framework. -[![](https://openai.servicestack.net/img/overview.svg)](https://openai.servicestack.net) +[![](/img/svgs/ai-server-overview.svg)](https://openai.servicestack.net) ### Distribute load across multiple Ollama, Open AI Gateway and Comfy UI Agents diff --git a/MyApp/_whatsnew/2024-11-26_v8.5/ai-server.md b/MyApp/_whatsnew/2024-11-26_v8.5/ai-server.md new file mode 100644 index 00000000..77d918ce --- /dev/null +++ b/MyApp/_whatsnew/2024-11-26_v8.5/ai-server.md @@ -0,0 +1,20 @@ +--- +title: Introducing AI Server +url: /posts/ai-server +image: /img/posts/ai-server/ai-server-splash.png +order: 1 +--- + +We're excited to announce AI Server - an open-source, self-hosted Docker gateway for managing API access +to various AI services. It offers centralized management of LLMs, Ollama endpoints, media APIs, Comfy UI +and FFmpeg agents, distributing loads across multiple servers. + +It's initial V1 release comes packed with features, including: + + - **Centralized Management**: Manage all your AI services from a single Admin UI + - **Load Balancing**: Distribute loads across multiple servers + - **Native Typed Integrations**: For 11 popular programming languages + - **Synchronous, Queued, and Callback-based APIs**: For different use-cases + - **Monitoring and Analytics**: Live monitoring, analytics and full history + - **Protected Access**: With simple API keys + \ No newline at end of file diff --git a/MyApp/_whatsnew/2024-11-26_v8.5/kamal-deployments.md b/MyApp/_whatsnew/2024-11-26_v8.5/kamal-deployments.md new file mode 100644 index 00000000..9f860e35 --- /dev/null +++ b/MyApp/_whatsnew/2024-11-26_v8.5/kamal-deployments.md @@ -0,0 +1,16 @@ +--- +title: .NET 8 Templates now using Kamal for deployments +url: /posts/kamal-deployments +image: /img/posts/kamal-deployments/kamal-splash.png +order: 2 +--- + +We've updated the built-in GitHub Actions for all Identity Auth templates to use the [Kamal deployment](https://kamal-deploy.org/) tool +for customers considering their potential [cloud exit cost savings](https://world.hey.com/dhh/our-cloud-exit-savings-will-now-top-ten-million-over-five-years-c7d9b5bd) +by exploring the shift in deployment strategy for self-hosting their .NET Docker Apps on their own servers or +in-expensive cloud providers like [hetzner.com](https://www.hetzner.com) + +Previously, a less streamlined process involving [SSH and Docker Compose](https://docs.servicestack.net/kamal-deploy) was used. +Now, all Identity Auth templates utilize Kamal, a CLI tool simplifying deployments to any Linux server accessible via SSH. +Kamal automates tasks such as reverse proxy setup and TLS certificate management whilst providing useful +local management tools via Kamal's commands. diff --git a/MyApp/_whatsnew/2024-11-26_v8.5/swift-6.md b/MyApp/_whatsnew/2024-11-26_v8.5/swift-6.md new file mode 100644 index 00000000..bd9e46fa --- /dev/null +++ b/MyApp/_whatsnew/2024-11-26_v8.5/swift-6.md @@ -0,0 +1,13 @@ +--- +title: ServiceStack.Swift client library rewritten for Swift 6 +url: /posts/swift6-upgrade +image: https://docs.servicestack.net/img/pages/servicestack-reference/swift-logo-banner.jpg +order: 4 +--- + +All generic service client libraries have been upgraded to support multiple file uploads with API requests +to take advantage of AI Server APIs that accept file uploads like Image to Image, Speech to Text or its +FFmpeg Image and Video Transforms. + +ServiceStack.Swift received the biggest upgrade, which was also rewritten to take advantage of Swift 6 features, +including Swift promises which replaced the previous PromiseKit dependency - making it now dependency-free! \ No newline at end of file diff --git a/MyApp/_whatsnew/2024-11-26_v8.5/typed-openai-chat-apis.md b/MyApp/_whatsnew/2024-11-26_v8.5/typed-openai-chat-apis.md new file mode 100644 index 00000000..3db70556 --- /dev/null +++ b/MyApp/_whatsnew/2024-11-26_v8.5/typed-openai-chat-apis.md @@ -0,0 +1,15 @@ +--- +title: Typed Open AI Chat & Ollama APIs in 11 Languages +url: /posts/typed-openai-chat-ollama-apis +image: /img/posts/ai-server/ai-server-languages.png +order: 3 +--- + +AI Server's `OpenAiChatCompletion` API - is an OpenAI compatible Chat API with ChatGPT and +other LLMs like Ollama, the benefit of which allows developers to use its Typed DTOs and ServiceStack +generic Service Clients to call any Open AI Chat compatible API directly, in all of ServiceStack's +11 supported popular programming languages. + +This allows developers to easily integrate typed access to different LLMs into their applications. +Instructions are provided for each language demonstrating how to install necessary packages, download DTOs, +and send API requests. diff --git a/MyApp/wwwroot/img/posts/ai-server/ai-server-splash.png b/MyApp/wwwroot/img/posts/ai-server/ai-server-splash.png new file mode 100644 index 00000000..03eca2fc Binary files /dev/null and b/MyApp/wwwroot/img/posts/ai-server/ai-server-splash.png differ diff --git a/MyApp/wwwroot/img/posts/kamal-deployments/kamal-splash.png b/MyApp/wwwroot/img/posts/kamal-deployments/kamal-splash.png new file mode 100644 index 00000000..2914bee2 Binary files /dev/null and b/MyApp/wwwroot/img/posts/kamal-deployments/kamal-splash.png differ diff --git a/MyApp/wwwroot/img/svgs/ai-server-overview.svg b/MyApp/wwwroot/img/svgs/ai-server-overview.svg new file mode 100644 index 00000000..acd4387e --- /dev/null +++ b/MyApp/wwwroot/img/svgs/ai-server-overview.svg @@ -0,0 +1 @@ +

AI Server

LLM APIs

Ollama

Media APIs

Comfy UI
+
FFmpeg

OpenRouter / OpenAI / Mistral / Anthropic / Google Cloud / Groq

Replicate / dall-e-3 / Text to speech

Diffusion / Whisper / TTS

 \ No newline at end of file