User-agent: * Disallow: /admin/ Disallow: /redir.php Disallow: /settings/ Disallow: /gallery/ Disallow: /albums/ Disallow: /images/ Disallow: /show_manual.php Disallow: /calendar/ Disallow: /external_files/ Disallow: /search/ Disallow: /archives/ Disallow: /profile/ Disallow: /media/ Disallow: /viewprofile/ Disallow: /filebase/ Disallow: /myng/ Disallow: /acornuser/ Disallow: /forum/ # Stuff that stops idiots trying to get the entire site. # Please don't ask about the multiple use of *, no *, etc. # all I can say is some software out there is utter crap. User-Agent: MSIECrawler Disallow: / User-Agent:psbot Disallow: / User-Agent:Web Downloader Disallow: / User-Agent:LinkWalker Disallow: / User-Agent: NPBot Disallow: / User-Agent: WebStripper Disallow: / User-Agent:Wget Disallow: / User-Agent: UbiCrawler Disallow: /myng Disallow: /archives User-Agent: Wget Disallow: / Disallow: /archives User-Agent:Webget Disallow: / User-Agent:HTTrack Disallow: / User-Agent:Teleport Disallow: / User-Agent:Teleport Pro Disallow: /