X-Git-Url: https://git.openstreetmap.org./rails.git/blobdiff_plain/06f3473d1c64d2e0a1ecc6f1a9c4679a52bc4761..3c7b7cef70bbe705498a7f322374ff33e2a19142:/public/robots.txt diff --git a/public/robots.txt b/public/robots.txt index 4ab9e89fe..058db57c6 100644 --- a/public/robots.txt +++ b/public/robots.txt @@ -1 +1,19 @@ -# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file \ No newline at end of file +User-agent: * +Disallow: /user/*/traces/ +Allow: /user/ +Disallow: /traces/tag/ +Disallow: /traces/page/ +Disallow: /api/ +Disallow: /edit +Disallow: /browse +Disallow: /login +Disallow: /geocoder +Disallow: /history +Disallow: /message +Disallow: /trace/ +Disallow: /*lat= +Disallow: /*node= +Disallow: /*way= +Disallow: /*relation= + +Host: www.openstreetmap.org