New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

automate robots.txt #13

Open

ZoeBijl opened this issue Dec 27, 2024 · 2 comments

Labels

Member

ZoeBijl commented Dec 27, 2024

it would be nice if robots.txt was updated automatically on build.

can we reference robot.txt directly somehow?

ZoeBijl added the enhancement label

Member Author

ZoeBijl commented Dec 27, 2024 •

edited

Loading

In #14 the relevant files are generated from bots.json. Perhaps this can be made to work with robots.json from ai.robots.txt?

Member Author

ZoeBijl commented Dec 27, 2024

If we do this we should take #18 into account.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment