public/robots.txt

   1 Sitemap: http://www.openstreetmap.org/sitemap.xml.gz
   2
   3 User-agent: *
   4 Disallow: /user/*/traces/
   5 Allow: /user/
   6 Disallow: /traces/tag/
   7 Disallow: /traces/page/
   8 Disallow: /api/
   9 Disallow: /edit
  10 Disallow: /browse
  11 Disallow: /login
  12 Disallow: /geocoder
  13 Disallow: /history
  14 Disallow: /message
  15 Disallow: /trace/
  16 Disallow: /*lat=
  17 Disallow: /*node=
  18 Disallow: /*way=
  19 Disallow: /*relation=
  20
  21 Host: www.openstreetmap.org