Add robots.txt and sitemap.txt (!139) · Merge requests · EIP / Metadata Catalogue

Rod Scott requested to merge CEHCIG-879-sitemaps into develop Jan 25, 2018

Enhancing the catalogues appeal to search engines by adding a robots.txt file and sitemap.txt for each catalogue.

robots.txt at the root points to each catalogues sitemap Each sitemap is a list of urls of public documents in the catalogue

Add robots.txt and sitemap.txt