This is a technical article about the different parts and pieces of a search engine web spider. If I lose you in the technical babble that is this description, I apologize ahead of time. I will try to keep the explanations simple by using analogies where necessary. If you are not familiar with what a search engine or web spider is, here a general definition. A spider is an automated computer program that prowls the Internet looking for publicly accessible resources and websites that can be added to it’s database. Now, lets dive into the dissection of our biological friend; the spider.