🕷️ Indexation (tracker)

[teolemon]

What

• Ensure Open Food Facts is well indexed by search engine in a timely manner
• We should aim for
  • near-real time indexation of new products (after Robotoff and the users have added it)
  • live reindexation of edited products
  • 100% indexation of existing products in all languages relevant to the countries they are sold in + English

Why

• Maximize impact (more/new people get answer to their questions)
• 🎁 Drive more donations to Open Food Facts (tracker) #5720 (a fraction of additional users will donate, become contributors…)
• 🔎 Search (Tracking bug) #5492 (Good SEO solves part of the search issue by allowing Search Engine and LLMs to index our data)

Tasklist

Tasks

Preview Give feedback

1. Create a Sitemap for ProductOpener #442
   help wanted 🕷️ SEO +2
2. feat: Add sitemap for taxonomized fields #2878
   dependencies ✨ Feature 🕷️ SEO +3
   
3. Duplicated product pages might harm SEO, consider using rel="canonical" to point English pages to world #5416
   ⏰ Stale 🕷️ SEO +2
4. Add a crawl delay for search engines #7965
   ⏰ Stale ✅ Task 🚅 Performance +3
5. 🕷️ The web crawler issue #8751
   ⭐ 🐛 top bug 🐛 bug 🚅 Performance +3
6. Add Schema.org markup for images #8330
   microformats ⏰ Stale 🕷️ SEO +3
7. Adding schema.org markup to producer information on the Packaging code page #9
   good first issue microformats 🏭 Producers Platform 📍🏭 Packager codes 🕷️ SEO +5
8. Return a 404 for tag pages that have 0 products #3361
   404 Outreachy ⏲️ 5 minute fix 🐛 bug 🕷️ SEO +5
   
9. Do not execute expensive queries from robots (e.g. 2 levels facets) #969
   MongoDB facets 🕷️ SEO +3
10. Yandex uses sidebar or navigation text as a summary for all pages #555
    Russian 🕷️ SEO +2
11. Ensure our snippet description includes Nutri-Score and Eco-Score for a better Search Engine CTR #4877
    non tech ⏰ Stale ⏲️ 5 minute fix 🌱 Eco-Score 🎯 P1 🕷️ SEO +6
12. We're loosing out on packager codes SEO for Germany #465
    German 🇩🇪 Germany 📍🏭 Packager codes 🔎 Search 🕷️ SEO +5
13. Product canonical URL should not change when product name is updated #8778
    URL 🕷️ SEO +2
14. Disable completely indexation on subdomains with unusal cc-lc pairs (ex: fr-it, uk-es,...) #8779
    indexing +1

Part of

• 🎯 What can I work on ? #5529

[github-actions]

This issue is stale because it has been open 90 days with no activity.