X-Git-Url: https://git.openstreetmap.org./rails.git/blobdiff_plain/06f3473d1c64d2e0a1ecc6f1a9c4679a52bc4761..d0b8278c4a9e35c527db097baf8b05516753dc76:/public/robots.txt?ds=sidebyside diff --git a/public/robots.txt b/public/robots.txt index 4ab9e89fe..2edd47453 100644 --- a/public/robots.txt +++ b/public/robots.txt @@ -1 +1,25 @@ -# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file \ No newline at end of file +# OpenStreetMap's data is available for free in bulk from https://planet.openstreetmap.org +# For regional extracts and documentation, see https://wiki.openstreetmap.org/wiki/Planet.osm +# We encourage you to use these instead of scraping our site. +# Scraping puts a high load on our donated resources and will lead to your IP being blocked. +# Please respect our resources, and help us keep the service free and accessible for everyone. + +User-agent: * +Disallow: /user/*/traces/ +Allow: /user/ +Disallow: /traces/tag/ +Disallow: /traces/page/ +Disallow: /api/ +Disallow: /edit +Disallow: /browse +Disallow: /login +Disallow: /geocoder +Disallow: /history +Disallow: /message +Disallow: /trace/ +Disallow: /*lat= +Disallow: /*node= +Disallow: /*way= +Disallow: /*relation= + +Host: www.openstreetmap.org