The GitHub Models agent offers a chat interface to use the capabilities of GitHub Models. It lets you ask about and interact with the LLMs listed on the GitHub Marketplace through Copilot Chat.

Capabilities

Allows users to interact with the LLMs listed on the GitHub Marketplace through Copilot Chat

• List all LLMs currently supported on the GitHub Marketplace
• Ask for a recommendation for an LLM based on constraints
• Run inferences against a particular model

Benefits

• Streamlined interaction with Models: Provides a list of models on GitHub Marketplace that one can interact with
• Model recommendation: Provides feedback on which model is best suited for a specified task
• Drop-in use of a desired model: Swap in and out different desired models for running an inference task

Getting Started

Availability: Limited public beta

Setup Process:

1. Navigate to the GitHub Models listing page on the Marketplace
2. Click the "Add" Button
3. Follow the instructions to authorize the app

Example Prompts

Try these prompts with @models:

• List all LLMs currently supported on the GitHub Marketplace
  @models What models are available?
• Ask for a recommendation for an LLM based on constraints
  @models I don't have a lot of money - what model should I use that is small, costs the least, but still has function calling?
• Run inferences against a particular model
  @models: Using o1-mini: what is the capital of France?