X-Git-Url: https://git.openstreetmap.org./rails.git/blobdiff_plain/bbf30e76e4bfcd70e62fc84ecd32c5e494506e9e..569f3cbe9bac4e0f42313a5c3ed8e2dfe4a0e099:/public/robots.txt?ds=sidebyside diff --git a/public/robots.txt b/public/robots.txt index 8d2bea7ea..c0e70dfd8 100644 --- a/public/robots.txt +++ b/public/robots.txt @@ -22,13 +22,16 @@ Disallow: /*relation= User-agent: Slurp Disallow: /user/*/traces/ -Disallow: /user/*/edits/ +Disallow: /user/*/edits Disallow: /user/*/diary/ Allow: /user/ Disallow: /traces/tag/ Disallow: /traces/page/ Disallow: /api/ Disallow: /edit +Disallow: /browse/node/*/history +Disallow: /browse/way/*/history +Disallow: /browse/relation/*/history Allow: /browse/node/ Allow: /browse/way/ Allow: /browse/relation/ @@ -45,13 +48,16 @@ Disallow: /*relation= User-agent: Googlebot Disallow: /user/*/traces/ -Disallow: /user/*/edits/ +Disallow: /user/*/edits Disallow: /user/*/diary/ Allow: /user/ Disallow: /traces/tag/ Disallow: /traces/page/ Disallow: /api/ Disallow: /edit +Disallow: /browse/node/*/history +Disallow: /browse/way/*/history +Disallow: /browse/relation/*/history Allow: /browse/node/ Allow: /browse/way/ Allow: /browse/relation/