$Id: spiders.txt bot crawl grub search seek slurp spider end-short-spider-list almaden.ibm.com appie 1.1 architext ask jeeves asterias2.0 augurfind bdcindexer crawler docomo gulliver ia_archiver ingrid kit_fireball lachesis mantraagent mercator moget/1.0 muscatferret ncsa beta ng/1.0 osis-project ocelli pompos scooter seventwentyfour sidewinder siteuptime steeler/1.3 szukacz t-h-u-n-d-e-r-s-t-o-n-e teoma vagabondo w3c_validator yahoo zao/0 zyborg/1.0