Oracle AI Explorer for Apps

🚧 The AI Explorer is currently in Beta

Description

The Oracle AI Explorer for Apps (the AI Explorer) provides a streamlined environment where developers and data scientists can explore the potential of Generative Artificial Intelligence (GenAI) combined with Retrieval-Augmented Generation (RAG) capabilities. By integrating Oracle Database 23ai AI Vector Search, the Sandbox enables users to enhance existing Large Language Models (LLMs) through RAG.

AI Explorer Features

• Configuring Embedding and Chat Models
• Splitting and Embedding Documentation
• Modifying System Prompts (Prompt Engineering)
• Experimenting with LLM Parameters
• Testbed for auto-generated or existing Q&A datasets

Getting Started

The AI Explorer is available to install in your own environment, which may be a developer's desktop, on-premises data center environment, or a cloud provider. It can be run either on bare-metal, within a container, or in a Kubernetes Cluster.

For more information, including more details on Setup and Configuration please visit the documentation.

Prerequisites

• Oracle Database 23ai incl. Oracle Database 23ai Free
• Python 3.11 (for running Bare-Metal)
• Container Runtime e.g. docker/podman (for running in a Container)
• Access to an Embedding and Chat Model:
  • API Keys for Third-Party Models
  • On-Premises Models_*

_{*Oracle recommends running On-Premises Models on hardware with GPUs. For more information, please review the Infrastructure documentation.}

Bare-Metal Installation

To run the application on bare-metal; download the source and from src/:

1. Create and activate a Python Virtual Environment:

   cd src/
   python3.11 -m venv .venv --copies
   source .venv/bin/activate
   pip3.11 install --upgrade pip wheel setuptools

2. Install the Python modules:

   pip3.11 install -e ".[all]"
   source .venv/bin/activate

3. Start Streamlit:

   streamlit run launch_client.py --server.port 8501

4. Navigate to http://localhost:8501.

5. Configure the Explorer.

Container Installation

To run the application in a container; download the source:

1. Build the all-in-one image.

   From the src/ directory, build image:

   cd src/
   podman build -t ai-explorer-aio .

2. Start the Container:

   podman run -p 8501:8501 -it --rm ai-explorer-aio

3. Navigate to http://localhost:8501.

4. Configure the Explorer.

Contributing

This project welcomes contributions from the community. Before submitting a pull request, please review our contribution guide.

Security

Please consult the security guide for our responsible security vulnerability disclosure process.

License

Copyright (c) 2024 Oracle and/or its affiliates. Released under the Universal Permissive License v1.0 as shown at https://oss.oracle.com/licenses/upl/

See LICENSE for more details.