Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Watch AI support in JavaScript (Gemini, Transformers.js, etc.) [❌ awaiting support tracking] #2300

Open
chrisblakley opened this issue Nov 4, 2024 · 5 comments
Labels
Frontend (Script) Related to the client-side JavaScript. Low Priority Not of great importance, and certainly not urgent. Plugin / Library / API For third-party resources such as WordPress plugins, external APIs, and other libraries. 💭 Question / Research Additional research/discussion is needed to answer this question.
Milestone

Comments

@chrisblakley
Copy link
Owner

This is just a ticket to track browser AI support such as Gemini in Chrome and log ideas of feature integration.

Nebula demo here using Gemini in Google Chrome:
https://nebula.gearside.com/examples/chrome-ai-apis/

Quick note on how to activate it during the development phase:

  • Go to chrome://flags to enable the various Gemini AI flags as well setting the "Enables optimization guide on device" flag to Enabled BypassPerfRequirement.
  • Restart Chrome
  • Go to chrome://components to install/update the "Optimization Guide On Device Model" component

If you don't see the "Optimization Guide On Device Model" listed in the Chrome Components list, try running one of the AI commands in the console (ignoring any errors) and reload the components page.

Potential ideas for AI integration will be in separate comments below for now. May eventually separate them into their own individual issues if this feature becomes that large/supported.

@chrisblakley chrisblakley added 💭 Question / Research Additional research/discussion is needed to answer this question. Low Priority Not of great importance, and certainly not urgent. Plugin / Library / API For third-party resources such as WordPress plugins, external APIs, and other libraries. Frontend (Script) Related to the client-side JavaScript. labels Nov 4, 2024
@chrisblakley chrisblakley added this to the 13.0 Bubble milestone Nov 4, 2024
@chrisblakley
Copy link
Owner Author

chrisblakley commented Nov 4, 2024

Maybe the 404 page suggestions can be further enhanced with AI if it can be fed the sitemap?

However, I would not want the AI to recommend things to the user that aren't 100% accurate- which is a problem with AI. So each recommendation would need to be programmatically reviewed and sanitized...

Feasibility: 🤖/5

@chrisblakley
Copy link
Owner Author

chrisblakley commented Nov 4, 2024

Use the Summarizer AI to summarize contact form submissions.

In the Nebula CF7 Submission storage section, when clicking on a submission we could have the AI summarize the request. This could speed up the review process.

This could also provide another perspective on if the submission is spam. Maybe have the AI return a one-word response to "Is this message spam?" from a choice of "Definitely", "Likely", "Inconclusive", "Unlikely", "No".

Feasibility: 🤖🤖🤖🤖🤖/5

@chrisblakley
Copy link
Owner Author

chrisblakley commented Nov 4, 2024

When using Nebula Audit Mode (or maybe in the WP admin when editing a page/post/CPT), use AI to try writing a meta description for the page content.

This could give content managers a chance to see alternative approaches to their meta descriptions.

The challenge is that AI does not always understand things like "no more than 150 characters".

Feasibility: 🤖🤖/5

@chrisblakley
Copy link
Owner Author

chrisblakley commented Nov 4, 2024

Create a new AI metabox in the WP Dashboard that can be prompted like ChatGPT or Gemini itself.

It wouldn't know all that much about the current website (unless there was a massive system prompt), and also would not be as feature rich as ChatGPT itself because it is not worth reinventing the wheel here.

Feasibility: 🤖🤖/5

Not going to pursue this unless there is a way in the future to enhance the system prompt to make responses more useful to developers and content managers using the WordPress DB.

@chrisblakley
Copy link
Owner Author

Also check out transformers.js as it has entirely client-side AI capabilities with a super easy to use API that can do all sorts of functionality from many different models.

https://huggingface.co/docs/transformers.js/tutorials/vanilla-js

Available models: https://huggingface.co/models?library=transformers.js&sort=trending

https://github.com/huggingface/transformers

@chrisblakley chrisblakley changed the title Watch AI support in JavaScript (Gemini, etc.) [❌ awaiting support tracking] Watch AI support in JavaScript (Gemini, Transformers.js, etc.) [❌ awaiting support tracking] Nov 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Frontend (Script) Related to the client-side JavaScript. Low Priority Not of great importance, and certainly not urgent. Plugin / Library / API For third-party resources such as WordPress plugins, external APIs, and other libraries. 💭 Question / Research Additional research/discussion is needed to answer this question.
Projects
None yet
Development

No branches or pull requests

1 participant