Search Engine Spiders List

When search engine spiders crawl your Web site you may want to identify them by their name, user agent, or IP address. This list was compiled to provide a reference sheet of information for the most popular search engine spiders.

Bot Name User Agent Spider IP addresses
Googlebot Googlebot 216.239.46., 64.68.8, 64.68.9, 164.71.1., 192.51.44.
Alexa ia_archiver 66.28.250., 209.237.238.
Inktomi Slurp/ 216.35.116., 66.196., 66.94.230., 202.212.5.
Infoseek Infoseek 204.162.9, 205.226.203, 206.3.30., 210.236.233.
AltaVista Scooter 194.221.84., 204.123.28., 208.221.35, 212.187.226., 66.17.148.
Lycos Lycos 208.146.27., 209.202.19, 209.67.22, 202.232.118.
FAST alltheweb 146.101.142.2, 216.35.112., 64.41.254.2, 213.188.8.
WiseNut WISEnut 64.241.243., 209.249.67.1, 216.34.42., 66.35.208.
MSN msnbot 131.107.3., 204.95.98., 131.107.1, 65.54.164.95
Looksmart MARTINI 64.241.242., 207.138.42.212
Ask Jeeves teoma 216.200.130., 216.34.121., 63.236.92.1, 64.55.148., 65.192.195., 65.214.36.

No comments yet.

Leave a Reply