Add a sitemap.txt for popular public repos

and reference it from the robots.txt
This commit is contained in:
Jake Moshenko 2016-06-17 13:52:27 -04:00
parent c712be05e2
commit a1cf12e460
11 changed files with 146 additions and 52 deletions

2
templates/robots.txt Normal file
View file

@ -0,0 +1,2 @@
User-agent: *
Disallow: /