-
-
Notifications
You must be signed in to change notification settings - Fork 361
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat: update robots.txt #6286
feat: update robots.txt #6286
Conversation
✅ Deploy Preview for koda-canary ready!
To edit notification comments on pull requests, go to your Netlify site settings. |
AI-Generated Summary: This pull request updates the |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
robots.txt guide
ref: https://developers.google.com/search/docs/crawling-indexing/robots/robots_txt#syntax
Could u pls take a look? @preschian |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Missing:
*/collection/
- sitemap
otherwise lgtm
if still error I think we need to downgrade the version again in the meantime |
Code Climate has analyzed commit 2e870ee and detected 0 issues on this pull request. View more on Code Climate. |
updated |
I'm not sure if we are going to disallow the collection details page. @yangwao |
for now yes probably, later we will use The current goal is to have top10 great pages to show, rather 1000 sub-optimal ones. We will be selecting pages to put online up |
pay 30 usd |
😍 Perfect, I’ve sent the payout 🪅 Let’s grab another issue and get rewarded! |
Thank you for your contribution to the KodaDot - One Stop Shop for Polkadot NFTs.
👇 __ Let's make a quick check before the contribution.
PR Type
Context
Before submitting pull request, please make sure:
Optional
Did your issue had any of the "$" label on it?
Community participation
Screenshot 📸
Copilot Summary
🤖 Generated by Copilot at e0dff1c
Updated
robots.txt
to block unwanted crawlers and optimize site visibility.🤖 Generated by Copilot at e0dff1c