-
Notifications
You must be signed in to change notification settings - Fork 312
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat: generate 100k tokens llms.txt #1042
base: main
Are you sure you want to change the base?
Conversation
|
✅ Deploy Preview for solid-docs ready!
To edit notification comments on pull requests, go to your Netlify site configuration. |
Hi @peterje, thank you for the time and effort in this pull request. For the time being, I'm going to close it because this is not something currently planned with the docs. |
Hi @peterje! I'm repopening this because I brought this up to some people on the team and they agree that it's a good idea to get in place. I'm going to specifically bring in this PR to get some feedback from the team, so you might see some activity in this PR (via comments or requests for changes) in the next little bit. |
thanks @LadyBluenotes! happy to own this work if requested. |
Description(required)
summary
implemented a spec-compliant llms.txt generator. This implementation was inspired by vercel/ai's implementation and adapted for our documentation structure.
changes
scripts/generate-llms.mjs
generate:llms
script topackage.json
public/llms.txt
to follow the standard web path specificationnotes
to stay under a ~100k token limit, some docs have to be omitted. it's not clear how this decision should be made. to start, i've omitted the directories
['pt-br', 'guides', 'solid-router', 'solid-meta', 'configuration']
.Related issues & labels