X-Git-Url: https://git.openstreetmap.org./rails.git/blobdiff_plain/7f61fc22de8d46bfcdcce44edcfdc912d951070e..005add9f491305d2625224e2efb4c6e17a5bd210:/public/robots.txt diff --git a/public/robots.txt b/public/robots.txt index ec4d051c3..2edd47453 100644 --- a/public/robots.txt +++ b/public/robots.txt @@ -1,3 +1,9 @@ +# OpenStreetMap's data is available for free in bulk from https://planet.openstreetmap.org +# For regional extracts and documentation, see https://wiki.openstreetmap.org/wiki/Planet.osm +# We encourage you to use these instead of scraping our site. +# Scraping puts a high load on our donated resources and will lead to your IP being blocked. +# Please respect our resources, and help us keep the service free and accessible for everyone. + User-agent: * Disallow: /user/*/traces/ Allow: /user/ @@ -6,7 +12,6 @@ Disallow: /traces/page/ Disallow: /api/ Disallow: /edit Disallow: /browse -Disallow: /diary Disallow: /login Disallow: /geocoder Disallow: /history