Ollama Straico API Proxy

Project Description

StraicoAPIProxy implements the same API endpoints but redirects the requests to the Straico API Server. We now support Ollama, LMStudio/OpenAI and Anthropic Claude API Endpoints.

This allows you to use any application that supports Ollama, LMStudio/OpenAI and Anthropic Claude while leveraging Straico's available cloud LLM models instead of running a local LLM.

Disclaimer: This is not an official Ollama or Straico product.

Setup

Please follow the Setup Guide.

Usage

Once the container is running, you can use any Ollama, LMStudio/OpenAI and Anthropic Claude-compatible application by pointing it to the proxy base url. By default the port is 11434 unless modified in the docker-compose.yml file.

Base URL for each provider

1. Ollama
   • http://127.0.0.1:11434
2. LMStudio/OpenAI
   • http://127.0.0.1:11434/v1
3. Anthropic Claude
   • http://127.0.0.1:11434

API Endpoints

List and describe the main API endpoints here.

Ollama

1. /api/generate
2. /api/chat
3. /api/tags
4. /api/embeddings

LM Studio

1. /v1/chat/completions
   • alias: /chat/completions
2. /v1/completions
3. /v1/models
4. /v1/embeddings

OpenAI

1. /v1/chat/completions
2. /v1/audio/speech
3. /v1/images/generations

Anthopic Claude

1. /v1/messages

Known Working Integrations

OllamaStraicoAPIProxy has been tested and confirmed to work with the following applications and integrations:

1. Home Assistant

   • Integration: Ollama for Home Assistant
   • Description: Use OllamaStraicoAPIProxy with Home Assistant for AI-powered home automation tasks.

2. Logseq

   • Plugin: ollama-logseq
   • Description: Integrate OllamaStraicoAPIProxy with Logseq for enhanced note-taking and knowledge management.

3. Obsidian

   • Plugin: obsidian-ollama
   • Description: Use OllamaStraicoAPIProxy within Obsidian for AI-assisted note-taking and writing.

4. Snippety

   • Website: https://snippety.app/
   • Description: Leverage OllamaStraicoAPIProxy with Snippety for AI assisted snippet management and generation.

5. Rivet

   • Website: https://rivet.ironcladapp.com/
   • Description: Allows using Ollama Chat and OpenAI Chat (via LM Studio)

6. Continue.dev

   • Website: https://www.continue.dev/
   • Description: Generate code using Ollama and LM Studio

7. Open WebUI

   • Website: https://docs.openwebui.com/
   • Description: Allows using Ollama with Open WebUI
   • Sample Configuration: docker-compose.yaml

8. Flowise

   • Website: https://flowiseai.com/
   • Description: Allows using Ollama with Flowise
   • Sample Configuration: docker-compose.yaml

9. Aider Chat

   • Website: https://aider.chat/
   • Description: Pair Programming / Coding Assistant.

10. Cline

    • Website: https://github.com/cline/cline
    • Description: Pair Programming / Coding Assistant.

11. Enconvo

    • Website: https://www.enconvo.com/
    • Description: Desktop app

Please note that while these integrations have been tested, you may need to adjust settings or configurations to point to your OllamaStraicoAPIProxy instance instead of a local Ollama installation.

To-Do List

1. Add Tests
2. Add Documentation

Contributing

Contributions are welcome! Please feel free to submit a Pull Request.

License

This project is licensed under the MIT License.

Acknowledgements

• Ollama
• Straico

Referal Link to digitalocean