X-Git-Url: https://git.openstreetmap.org./rails.git/blobdiff_plain/31e1204dfab9b81346a2881ac0943ba37a76a323..79c306ad06155549ff6e5929ff20a1149b4862c4:/public/robots.txt diff --git a/public/robots.txt b/public/robots.txt index bb5605ea2..2edd47453 100644 --- a/public/robots.txt +++ b/public/robots.txt @@ -1,5 +1,10 @@ +# OpenStreetMap's data is available for free in bulk from https://planet.openstreetmap.org +# For regional extracts and documentation, see https://wiki.openstreetmap.org/wiki/Planet.osm +# We encourage you to use these instead of scraping our site. +# Scraping puts a high load on our donated resources and will lead to your IP being blocked. +# Please respect our resources, and help us keep the service free and accessible for everyone. + User-agent: * -Disallow: /user/*/diary Disallow: /user/*/traces/ Allow: /user/ Disallow: /traces/tag/ @@ -7,7 +12,6 @@ Disallow: /traces/page/ Disallow: /api/ Disallow: /edit Disallow: /browse -Disallow: /diary Disallow: /login Disallow: /geocoder Disallow: /history