Add the ability for exclusions

[jdillard]

Whether through a config value array, sitemap_exclude, and/or metadata on the page, :nositemap:, to be excluded.

[msbt]

Hey @jdillard, awesome work on the extension, any chance that the sitemap_exclude feature is still somewhere on the roadmap?

[jdillard]

I can try and make an attempt at it "soon", but no promises. Were you thinking something like this would work for you?

sitemap_excludes = [
    "/path/to/page1.rst",
    "/path/to/page2.rst",
]

Where path's are relative to the source directory?

[msbt]

Thanks for the quick reply! In theory yes, but for my use-case it's more about the search.html and genindex.html which are basically empty and recognized as soft 404s by search engines, so I would target system pages instead of rendered .rsts

[kryskool]

Hi @msbt for sphinx basic theme and furo, the meta robot have no index value.

• basic theme
• furo

[msbt]

@kryskool thanks, but I'd rather not have it in the sitemap in the first place, this piles up the "discovered but not indexed" pages in various analytics tools.

[jdillard]

@msbt How does this PR look? #91

[msbt]

@jdillard oh wow, thanks so much for the addition and quick implementation, appreciate it a lot! PR looks great, exactly how I imagined it would work!