SEO-Lexicon
Focused Crawling
Capturing and indexing some millions of website is an enormous effort for the search engines. Take Google as an example: Google needs approximately a whole month for a new index. For minimizing the effort and the time of the indexing, focused crawling is being used. Hereby, only the most important sites are checked by robots and only a certain amount of these sites are actualized regularly. Very rarely actualized sites are checked more seldom by the Googlebots. Firstly, search engines measure the extent of the actualization of a site. The more often you actualize your own website, the more often takes indexing place.
© 2012, Webconomy
Focused Crawling: lexicon search engine optimization