Crawlers – Ivy Capital Inc
October 21, 2008
Crawlers – Ivy Capital Inc
Overview
- What are crawlers?
- Submitting to Google
- Submitting to Ask Jeeves/Teoma
- Submitting to Gigablast
What are search engine crawlers?
- Crawlers are search engines that utilize “spider” technology to find and rank web pages. Each crawler search engine has its own algorithm or ranking formula for finding and ranking web pages. These algorithms are kept secret to prevent webmasters from manipulating search results, however, most search engines follow general rules for ranking pages:
- Location and Frequency of keyword phrases – The most important location to use your keyword phrase is in the HTML Title of your site and as close to the top and bottom of your home page as possible. “Frequency” looks at how often your keyword phrase appears in the text versus the total number of text on the page. It is recommended that you use your keyword phrase 5% of the time to achieve optimal frequency.
- Link Popularity – This measures the number of incoming links to your site. The more sites linking to your site and the quality of their link popularity determines your link popularity rating. The better your link popularity rating, the more likely you are to rank well in the search engines.
