feat: add crawling settings

[manuel-rw]

Homarr

Thank you for your contribution. Please ensure that your pull request meets the following pull request:

• Builds without warnings or errors (pnpm buid, autofix with pnpm format:fix)
• Pull request targets dev branch
• Commits follow the conventional commits guideline
• No shorthand variable names are used (eg. x, y, i or any abbrevation)

https://nextjs.org/learn-pages-router/seo/crawling-and-indexing/metatags

[deepsource-io]

Here's the code health analysis summary for commits d20384d..9336f6b. View details on DeepSource ↗.

Analysis Summary

Analyzer	Status	Summary	Link
JavaScript	✅ Success		View Check ↗

---

💡 If you’re a repository administrator, you can configure the quality gates from the settings.

[github-actions]

Coverage Report

Status	Category	Percentage	Covered / Total
🔵	Lines	39.67%	11784 / 29703
🔵	Statements	39.67%	11784 / 29703
🔵	Functions	36.32%	283 / 779
🔵	Branches	70.95%	1082 / 1525

File Coverage

File	Stmts	% Branch	% Funcs	% Lines	Uncovered Lines
Changed Files
apps/nextjs/src/app/[locale]/layout.tsx	0%	0%	0%	0%	1-2, 4-7, 9-12, 14-21, 23-26, 28-45, 47-52, 54-56, 58-67, 69, 71-82, 84
apps/nextjs/src/app/[locale]/manage/about/page.tsx	0%	0%	0%	0%	1-2, 19-20, 22, 24-27, 30, 32-33, 35-38, 40-43, 45-46, 48-54, 56-58, 60-67, 69-74, 76-143, 145, 147-153, 155, 163-174, 176
apps/nextjs/src/app/[locale]/manage/settings/page.tsx	0%	0%	0%	0%	1, 3-4, 6-8, 10-12, 14-17, 19-30, 32
apps/nextjs/src/app/[locale]/manage/settings/_components/analytics.settings.tsx	0%	0%	0%	0%	1, 4, 6-7, 9, 11-12, 18-25, 27-34, 36-41, 43-47, 49-51, 53-83, 85
apps/nextjs/src/app/[locale]/manage/settings/_components/crawling-and-indexing.settings.tsx	0%	0%	0%	0%	1, 4, 6-7, 9, 11-12, 18-25, 27-32, 34-38, 40-42, 44-66, 68
apps/nextjs/src/app/[locale]/manage/settings/_components/setting-switch.tsx	0%	0%	0%	0%	1-2, 4, 8-15, 24-28, 30-31, 33-44, 46
apps/nextjs/src/app/api/about/contributors/crowdin/route.ts	0%	0%	0%	0%	1, 3, 5-7, 9
apps/nextjs/src/app/api/about/contributors/github/route.ts	0%	0%	0%	0%	1, 3, 5-7, 9
apps/nextjs/src/components/layout/search-engine-optimization.tsx	0%	0%	0%	0%	1, 3-4, 7-10, 12-14, 16-18, 20, 22-25, 27-31, 33
packages/server-settings/src/index.ts	100%	100%	100%	100%
packages/translation/src/lang/en.ts	100%	100%	100%	100%

Generated in workflow #2792