#robots file for http://www.spacemarc.it #last update 09/Dec/2006 by webmaster #fuck this spider User-agent: atSpider/1.0 Disallow: / User-agent: BackDoorBot/1.0 Disallow: / User-agent: BotRightHere Disallow: / User-agent: CherryPickerSE/1.0 Disallow: / User-agent: CherryPickerElite/1.0 Disallow: / User-agent: CopyRightCheck Disallow: / User-agent: Crescent Disallow: / User-agent: Crescent Internet ToolPak HTTP OLE Control v.1.0 Disallow: / User-agent: DA 3.5 (www.lidan.com) Disallow: / User-agent: Download Express 1.0 Disallow: / User-agent: eCatch/3.0 Disallow: / User-agent: EmailCollector Disallow: / User-agent: EmailSiphon Disallow: / User-agent: EmailWolf Disallow: / User-agent: ExtractorPro Disallow: / User-agent: Flaming AttackBot Disallow: / User-agent: FlashGet Disallow: / User-agent: Franklin Locator 1.8 Disallow: / User-agent: GetRight/4.2 Disallow: / User-agent: GetRight/5.0beta2 Disallow: / User-agent: Keyword Density/0.9 Disallow: / User-agent: lwp-trivial Disallow: / User-agent: lwp-trivial/1.34 Disallow: / User-agent: Mass Downloader 2.2 Disallow: / User-agent: Microsoft URL Control - 5.01.4511 Disallow: / User-agent: Microsoft URL Control - 6.00.8169 Disallow: / User-agent: Missigua Locator 1.9 Disallow: / User-agent: Mozilla/4.0 (compatible; BullsEye; Windows 95) Disallow: / User-agent: NetMechanic Disallow: / User-agent: Net Vampire/4.0 Disallow: / User-agent: Offline Explorer Disallow: / User-agent: PagmIEDownload Disallow: / User-agent: pavuk/0.9pl29b i686-pc-linux-gnu Disallow: / User-agent: RealDownload/4.0.0.42 Disallow: / User-agent: SiteSnagger Disallow: / User-agent: spanner Disallow: / User-agent: Teleport Disallow: / User-agent: TeleportPro Disallow: / User-agent: Teleport Pro/1.29.1718 Disallow: / User-agent: Teleport Pro/1.29.1632 Disallow: / User-agent: Teleport Pro/1.29.1590 Disallow: / User-agent: Teleport Pro/1.29.2079 Disallow: / User-agent: Telesoft Disallow: / User-agent: UbiCrawler Disallow: / User-agent: UbiCrawler/v0.4beta (http://ubi0.iit.cnr.it/projects/ubicrawler/) Disallow: / User-agent: WebAuto Disallow: / User-agent: webbandit/3.50 Disallow: / User-agent: WebBandit/4.00.0 Disallow: / User-agent: WebCapture 3.0 Disallow: / User-agent: WebCopier 4.1 Disallow: / User-agent: WebCopier v3.2 Disallow: / User-agent: WebCopy Disallow: / User-agent: Web Downloader/5.4 Disallow: / User-agent: WebDownloader for X 1.30 Disallow: / User-agent: WebEMailExtractor/1.0B Disallow: / User-agent: webmirror Disallow: / User-agent: WebPix 1.0 (www.netwu.com) Disallow: / User-agent: WebReaper Disallow: / User-agent: WebReaper v9.8 Disallow: / User-agent: WebSauger Disallow: / User-agent: Website Quester Disallow: / User-agent: Webster Pro Disallow: / User-agent: WebStripper Disallow: / User-agent: WebStripper/2.16 Disallow: / User-agent: WebZip Disallow: / User-agent: WebZip/4.0 Disallow: / User-agent: WebZIP/6.0 Disallow: / User-agent: Wget Disallow: / User-agent: Wget/1.6 Disallow: / User-agent: Wget 1.9.1 Disallow: / User-agent: WinHTTrack Disallow: / User-agent: WWW-Collector-E Disallow: / User-agent: Xenu's Disallow: / User-agent: Xenu's Link Sleuth 1.1c Disallow: / User-agent: Zeus Disallow: / User-agent: Zeus 2.6 Disallow: / User-agent: Zeus Link Scout Disallow: / User-agent: Zeus.*Webster Disallow: / User-agent: Zeus 32297 Webster Pro V2.9 Win32 Disallow: / User-agent: * Disallow: /cazzeggio/ Disallow: /cgi-bin/