Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FEATURE] Apple Silicon: Add support of the mlx-lm #754

Open
qdrddr opened this issue Jun 10, 2024 · 1 comment
Open

[FEATURE] Apple Silicon: Add support of the mlx-lm #754

qdrddr opened this issue Jun 10, 2024 · 1 comment
Labels
type/feature Feature request

Comments

@qdrddr
Copy link

qdrddr commented Jun 10, 2024 •
edited
Loading

🚀 Feature

Hi, can you please consider adding Apple Silicon support?
mlx-lm makes it very easy to fine-tune LLM. That'll be great having UI for this framework from H2O LLM Studio.
pip install mlx-lm torch sentencepiece
https://medium.com/@anchen.li/fine-tune-llama3-with-function-calling-via-mlx-lm-5ebbee41558f

Motivation

Utilize powerful M-Ultra GPUs
@qdrddr qdrddr added the type/feature Feature request label Jun 10, 2024
@qdrddr qdrddr changed the title [FEATURE] Apple Simicone: Add support of the mlx-lm [FEATURE] Apple Silicon: Add support of the mlx-lm Jun 14, 2024
@qdrddr
Copy link
Author

qdrddr commented Jun 18, 2024 •
edited
Loading

To answer why:

  • Powerful macs: MaxStudio or Mac Pro with M2 Ultra and 196GB RAM available for GPU with 60 cores.
  • Apple is developing Apple Silicon Project ACDC designed specifically for server farms dedicated to AI processing.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
type/feature Feature request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@qdrddr