Finetune and configure the AI option dropdown

[rielzzapps]

Feature Request

I think it could be done with a configuration or env that describes the options and prompts that are used to use AI in Docs. Currently I deployed a model that does not give satisfying results. With a bit of finetuning we could have more freedom on the LLM used. In our test we deployed a small, local LLM.

Also, you might want to have custom options, e.g. create a summary, or list options based on the text, etc. It could be valuable to configure that dropdown.

Do you want to work on it through a Pull Request?
Sure.

[virgile-dev]

Hey,
Having experimented with it, it definitly works better with a large model.
The prompts used for each actions are in the code base if you want to make your own.
BlockNote is working on AI toolbar that will let you insert your own prompts.

[rielzzapps]

I saw they were hardcoded.

If one was to deploy docs for end-customers, then it would make sense to be able to finetune them (instead of having the prompts hardcoded). Would it make sense to have these prompts in a configuration somewhere?

[virgile-dev]

Finetuned by the admin right ?
Woulld make sense to make them editable in the django admin ?

[rielzzapps]

Yes, by the admin or even the MSP - which essentally is admin.

For now a lot of settings in .env (domainnames, etc) will be centralized in some sort of custom admin going forward, but managing django would be an option as well.

[virgile-dev]

Hey @rielzzapps AI on Docs is about to change a lot with #1016
BlockNote AI now makes it super easy to customize system prompts and add custom actions.