public/robots.txt

   1 Sitemap: http://www.openstreetmap.org/sitemap.xml.gz
   2
   3 User-agent: *
   4 Disallow: /user/*/diary
   5 Disallow: /user/*/traces/
   6 Allow: /user/
   7 Disallow: /traces/tag/
   8 Disallow: /traces/page/
   9 Disallow: /api/
  10 Disallow: /edit
  11 Disallow: /browse
  12 Disallow: /diary
  13 Disallow: /login
  14 Disallow: /geocoder
  15 Disallow: /history
  16 Disallow: /message
  17 Disallow: /trace/
  18 Disallow: /*lat=
  19 Disallow: /*node=
  20 Disallow: /*way=
  21 Disallow: /*relation=
  22
  23 Host: www.openstreetmap.org