phpLinkBid Directory Script

Search Engine Spiders List


When search engine spiders crawl your Web site you may want to identify them by their name, user agent, or IP address. This list was compiled to provide a reference sheet of information for the most popular search engine spiders.

Bot Name User Agent Spider IP addresses
Googlebot Googlebot 216.239.46., 64.68.8, 64.68.9, 164.71.1., 192.51.44.
Alexa ia_archiver 66.28.250., 209.237.238.
Inktomi Slurp/ 216.35.116., 66.196., 66.94.230., 202.212.5.
Infoseek Infoseek 204.162.9, 205.226.203, 206.3.30., 210.236.233.
AltaVista Scooter 194.221.84., 204.123.28., 208.221.35, 212.187.226., 66.17.148.
Lycos Lycos 208.146.27., 209.202.19, 209.67.22, 202.232.118.
FAST alltheweb 146.101.142.2, 216.35.112., 64.41.254.2, 213.188.8.
WiseNut WISEnut 64.241.243., 209.249.67.1, 216.34.42., 66.35.208.
MSN msnbot 131.107.3., 204.95.98., 131.107.1, 65.54.164.95
Looksmart MARTINI 64.241.242., 207.138.42.212
Ask Jeeves teoma 216.200.130., 216.34.121., 63.236.92.1, 64.55.148., 65.192.195., 65.214.36.

Write a Comment

Take a moment to comment and tell us what you think. Some basic HTML is allowed for formatting.

Reader Comments

Be the first to leave a comment!



SEO Scripts
37 SEO Scripts
PageRank Script
PageRank Script
Directory Script
Directory Script
BidVerve Directory
BidVerve Directory
Nerve Directories
Nerve Directories