Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

LMStudio Model #705

Closed
wants to merge 11 commits into from
Closed

LMStudio Model #705

wants to merge 11 commits into from

Conversation

YanSte
Copy link
Contributor

@YanSte YanSte commented Jan 16, 2025

This pull request integrates the LMStudioModel into PydanticAI, enabling the use of local models from LM Studio within the framework.

LMStudio is a desktop application that allows users to discover, download, and run Large Language Models (LLMs) entirely offline on their computers.

Changes Introduced:

  • Added the LMStudioModel.
  • Updated documentation.
  • Added unit tests.

Usage Instructions:

  1. Install LM Studio: Download and install the latest version of LM Studio from the official website:
  2. Download Models: Use the "Discover" tab in LM Studio to search for and download the desired models.
  3. Configure in PydanticAI: Initialize an agent by specifying LMStudioModel as the model.

@YanSte YanSte marked this pull request as draft January 16, 2025 20:40
Copy link
Contributor

@hyperlint-ai hyperlint-ai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The style guide flagged several spelling errors that seemed like false positives. We skipped posting inline suggestions for the following words:

  • Groq
  • LLMLite
  • Ollama

@YanSte YanSte changed the title LLMLite Model LMStudio Model Jan 16, 2025
Copy link
Contributor

@hyperlint-ai hyperlint-ai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The style guide flagged several spelling errors that seemed like false positives. We skipped posting inline suggestions for the following words:

  • LMStudio

@YanSte YanSte marked this pull request as ready for review January 16, 2025 21:50
@YanSte YanSte closed this Jan 16, 2025
@YanSte YanSte reopened this Jan 16, 2025
@sydney-runkle
Copy link
Member

Hi @YanSte,

It doesn't look like LMStudio meets our requirements for adding new models, see here for more details.

We're happy to accept a PR adding docs indicating how you can use LMStudio with the existing OpenAI model :).

@YanSte
Copy link
Contributor Author

YanSte commented Jan 23, 2025

Okay 🥲

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants