SEO-Lexicon
Spider
Spiders are programs used by search engines. They automatically search all websites, which are registered to the certain search engine. At the first visit, the content of the website will be read and recorded to the database. Usually, the spider re-visits the sites periodically; the interval depends on the importance of the page rank and the importance of the site, and searches the website for updates and data. Regular updates of your website - which are found by the program - effects the ranking positively. If you want to optimize your website for search engines, you should organize it as spider friendly as possible. Regular updates can also effect the ranking positively. The operator of the website can view and analyze the visit of spider programs using the log files. If you discover, that the intervals of the visits of the spiders are getting bigger, you should take action to improve the page rank of your website and thus its position.
