X-Git-Url: https://git.openstreetmap.org./rails.git/blobdiff_plain/501d13e1c0936cc3ba3d9639620517bae34e5784..71cbb003f8a8db1b077ebeefb776033a3e31ee9a:/public/robots.txt diff --git a/public/robots.txt b/public/robots.txt index f248bb1ed..169c5a9dc 100644 --- a/public/robots.txt +++ b/public/robots.txt @@ -1,6 +1,7 @@ Sitemap: http://www.openstreetmap.org/sitemap.xml.gz User-agent: * +Disallow: /user/*/diary Disallow: /user/*/traces/ Allow: /user/ Disallow: /traces/tag/ @@ -8,6 +9,7 @@ Disallow: /traces/page/ Disallow: /api/ Disallow: /edit Disallow: /browse +Disallow: /diary Disallow: /login Disallow: /geocoder Disallow: /history @@ -17,3 +19,5 @@ Disallow: /*lat= Disallow: /*node= Disallow: /*way= Disallow: /*relation= + +Host: www.openstreetmap.org