User-agent: HTTrack 3.0 User-agent: GetWeb! User-agent: URLy Warning User-agent: asterias User-agent: ReGet User-agent: sp_auditbot User-agent: LNSpiderguy User-agent: dotbot User-agent: lwp-trivial User-agent: WebReaper User-agent: WebCopier User-agent: JamesBOT User-agent: Download\ Demon User-agent: HMView User-agent: WebZIP User-agent: Octopus User-agent: Kenjin Spider User-agent: hloader User-agent: WebSauger User-agent: TightTwatBot User-agent: TinEye User-agent: Keyword Density/0.9 User-agent: CherryPicker User-agent: AhrefsBot User-agent: MJ12bot User-agent: SpankBot User-agent: Grafula User-agent: mozbot User-agent: ProPowerBot/2.14 User-agent: DittoSpyder User-agent: LinkScan/8.1a Unix User-agent: CheeseBot User-agent: Go!Zilla User-agent: Mass\ Downloader User-agent: HTTrack User-agent: WebWhacker User-agent: Offline\ Explorer User-agent: SemrushBot User-agent: CopyRightCheck User-agent: EirGrabber User-agent: NetAnts User-agent: Indy\ Library User-agent: WebAuto User-agent: RepoMonkey User-agent: BlekkoBot User-agent: Widow User-agent: humanlinks User-agent: WWWOFFLE User-agent: InfoNaviRobot User-agent: Bookmark search tool User-agent: LexiBot User-agent: Surfbot User-agent: SurveyBot User-agent: SuperBot User-agent: psbot User-agent: spyfu User-agent: Python-urllib User-agent: aipbot User-agent: Majestic-12 User-agent: NearSite User-agent: FlashGet User-agent: Web\ Sucker User-agent: NetSpider User-agent: EmailWolf User-agent: Net\ Vampire User-agent: NerdyBot User-agent: Foobot User-agent: Bullseye/1.0 User-agent: JennyBot User-agent: WebFetch User-agent: BackDoorBot/1.0 User-agent: Flaming AttackBot User-agent: Copernic User-agent: sistrix User-agent: serpstat User-agent: VoidEYE User-agent: GrabNet User-agent: Ezooms User-agent: SemrushBot-SA User-agent: LinkextractorPro User-agent: Papa\ Foto User-agent: Web\ Image\ Collector User-agent: PerMan User-agent: pavuk User-agent: Website\ Quester User-agent: meanpathbot User-agent: larbin User-agent: Baiduspider User-agent: Rogerbot User-agent: RMA User-agent: b2w/0.1 User-agent: Crescent User-agent: JOC\ Web\ Spider User-agent: becomebot User-agent: ia_archiver User-agent: Aboundexbot User-agent: SearchmetricsBot User-agent: WebLeacher User-agent: Website\ eXtractor User-agent: Offline\ Navigator Disallow: /