Remove Allow/Disallow directives from robots.txt
Not interested in controlling where crawlers go, aim to inform them about sitemaps as most important
CEHCIG-879-sitemaps
Not interested in controlling where crawlers go, aim to inform them about sitemaps as most important
CEHCIG-879-sitemaps