# robots.txt for http://www.bw.fh-jena.de # last modified (YMD): 2009-08-18, Michael Gollmick # generated by TIMETOWEB v7.70 0 see http://www.timetoweb.de # generic for every Domino server # we don't want to get any of these directories to be indexed # maybe some files below html need to be indexed, so you have to put them in a directory not listed here or you have to modify the list User-agent: * Disallow: /cache/ Disallow: /html/ Disallow: /DAOS/ Disallow: /download/ Disallow: /inotes5/ Disallow: /lotus/ Disallow: /sametime/ Disallow: /SametimeApplet/ Disallow: /icons/ Disallow: /java/ Disallow: /plugins/ Disallow: /template/ # tell search crawlers what to crawl on this Domain! Sitemap: http://www.bw.fh-jena.de/www/cms.nsf/id/sitemap.xml