Based on discussions in: https://github.com/python/devguide/issues/114 Seems like docsbuild script doesn't remove html for docs that have been deleted. Thanks @ned-deily and @zware for pointing me this way.