X-Git-Url: https://git.openstreetmap.org./rails.git/blobdiff_plain/fc67e63589536b0d8fa3a92aa7eff57ebeceb3a6..7b05c1c060f3f85f47413ec7db984180514d3ba6:/public/robots.txt diff --git a/public/robots.txt b/public/robots.txt index bb5605ea2..2edd47453 100644 --- a/public/robots.txt +++ b/public/robots.txt @@ -1,5 +1,10 @@ +# OpenStreetMap's data is available for free in bulk from https://planet.openstreetmap.org +# For regional extracts and documentation, see https://wiki.openstreetmap.org/wiki/Planet.osm +# We encourage you to use these instead of scraping our site. +# Scraping puts a high load on our donated resources and will lead to your IP being blocked. +# Please respect our resources, and help us keep the service free and accessible for everyone. + User-agent: * -Disallow: /user/*/diary Disallow: /user/*/traces/ Allow: /user/ Disallow: /traces/tag/ @@ -7,7 +12,6 @@ Disallow: /traces/page/ Disallow: /api/ Disallow: /edit Disallow: /browse -Disallow: /diary Disallow: /login Disallow: /geocoder Disallow: /history