Google Spiders crawl the Web!

By Ahmed Elbortoukaly on April 10th, 2010

Google spiders crawling the web

The spiders ‘crawl the web looking for new pages to collect and add to the search engine indices’.

False. In reality, the spider doesn’t  ‘crawl’ or ‘visit’  web pages. It requests pages from a website in the same way your browser requests pages to display on your screen.

The difference is that the spider doesn’t collect images or formatting – it only sees text, links, and the URL, (for example, http://bortokali.com)

Remember, Google spiders loves links because they lead them to other web pages. So, always pay a great deal of attention to your anchor links, make it easy for the spiders to find your next page & get it indexed.

Would you like to add something?

Categorized under: Anchor text, Blog, crawlers of the web.
Tagged with: no tags.
blog comments powered by Disqus