Chrome AI is a demo project that runs large language models locally within the browser. It showcases the capabilities of modern web technologies to leverage advanced AI functionalities directly in the browser environment without needing server-side processing.
- Local Execution: Runs large language models directly in the browser.
- Real-time Processing: Provides instant responses and interactions.
- Privacy-focused: Processes data locally, ensuring user privacy and data security.
- Latest version of Google Chrome (127+) or any compatible Chromium-based browser.
- Install Chrome Canary: Ensure you have version 127. Download Chrome Canary.
- Enable Prompt API: Open
chrome://flags/#prompt-api-for-gemini-nano, set it to "Enabled". - Enable Optimization Guide: Open
chrome://flags/#optimization-guide-on-device-model, set it to "Enabled BypassPerfRequirement". Restart the browser. - Login to Google: Make sure you are logged in to Chrome. For now, Incognito and Guest mode are not supported.
- Download Model: Go to
chrome://components/, find "Optimization Guide On Device Model", ensure it’s fully downloaded. If the version is "0.0.0.0", click "Check for update". - Troubleshoot: If the "Optimization Guide On Device Model" is not displayed, disable the settings in steps 2 and 3, restart your browser and re-enable it.
- Verify Setup: Open a webpage, press F12, and check
window.aiin the console.
Clone the repository:
git clone git@github.com:debugtheworldbot/chromegemini.git
cd chromegemini
pnpm i
pnpm devOpen localhost:3000 in your browser to start using the AI.
We welcome contributions! Please fork the repository and submit pull requests. For major changes, please open an issue first to discuss what you would like to change.
This project is licensed under the MIT License - see the LICENSE file for details.
If you want to know more about chrome ai or have any feedback, please join ours Discord.
This project is based on chromeai by Lightning Joyce.
The original project is licensed under the MIT License. See the LICENSE file for more details.
- Generate DANK Replies with Chrome Built in AI
- Gmail Plugin for Managers
- LangChain Integrates ChromeAI for On Device AI Applications
- Offline Document Chat with Chrome Built in AI
- Summarize Selected Text with Chrome Built in AI
- Use Chrome Built in AI to interpret weather data
- VoiceAI Transcriber with Whisper and Chrome AI
- Web Distiller AI: Summarize Web Pages with Chrome's Built in AI