User-agent: * Disallow: /include/ Disallow: /home/ Disallow: /template_code/ Disallow: /proxy-mac.pac Disallow: /proxy.pac Disallow: /proxy-pc.pac Disallow: /wpad.dat Disallow: /virtual/proxy/ Disallow: /its/servicedesk/ Disallow: /dsa/qms/ Disallow: /dsa/QMS/ Disallow: /international/prospective/ Disallow: /vc/senior-executive/ Disallow: /vc/universities-australia/ #Disallow: /arts/ #Disallow: /education/ Disallow: /dro/login.php Disallow: /dro/stat_details.php Disallow: /dro/stats.php Disallow: /dro/history.php Disallow: /dro/adv_search.php Disallow: /dro/list/ Disallow: /dro/js/ Disallow: /dro/flviewer/ Disallow: /dro/css/ Disallow: /glossary/terms/ User-agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot) Disallow: /ike/ User-agent: WebReaper Disallow: / User-agent: WebLyzard Crawler Disallow: / User-agent: WebCopier v4.3 Disallow: / User-agent: Vagabondo Disallow: / User-agent: Shim-Crawler Disallow: / User-agent: OmniExplorer_Bot Disallow: / User-agent: NimbleCrawler Disallow: / User-agent: hl_ftien_spider_v1.1 Disallow: / User-agent: EMPAS_ROBOT Disallow: / User-agent: EDI/1.4.1 (Edacious & Intelligent Web Crawler) Disallow: / User-agent: (compatible; hetrix/1.8.0+http://www.accelobot.com) Disallow: / User-agent: WebReaper [info@webreaper.net] Disallow: / User-agent: WebReaper [webcreaper@otway.com] Disallow: / User-agent: Mozilla/5.0 (compatible; Vagabondo/Kliksafe; webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl/) Disallow: / User-agent: Vagabondo/3.0 (webagent at wise-guys dot nl) Disallow: / Sitemap: http://deakin.edu.au/sitemap.xm