Spiders are essentially programs that “crawl” sites and report back to their search engine what their findings are. Their purpose is to make it easy for sites to get listed in search engines.