Ivy Capital Inc – Crawlers

Crawlers

Overview

• What are crawlers?
• Submitting to Google
• Submitting to Ask Jeeves/Teoma
• Submitting to Gigablast

What are search engine crawlers?

• Crawlers are search engines that utilize “spider” technology to find and rank web pages. Each crawler search engine has its own algorithm or ranking formula for finding and ranking web pages. These algorithms are kept secret to prevent webmasters from manipulating search results, however, most search engines follow general rules for ranking pages:
  • Location and Frequency of keyword phrases – The most important location to use your keyword phrase is in the HTML Title of your site and as close to the top and bottom of your home page as possible. “Frequency” looks at how often your keyword phrase appears in the text versus the total number of text on the page. It is recommended that you use your keyword phrase 5% of the time to achieve optimal frequency.
  • Link Popularity – This measures the number of incoming links to your site. The more sites linking to your site and the quality of their link popularity determines your link popularity rating. The better your link popularity rating, the more likely you are to rank well in the search engines.

Submitting to Google

• Google is considered the #1 search engine crawler on the web. It’s search results are used by some of the other major search engines including AOL Search and Netscape. Google also sponsors results found in Ask Jeeves/Teoma.
• There are 2 methods for getting your site listed in Google:
  1. Submit your URL for free through Google’s free submit page.
  2. Sign up with Google’s Ad Words program and pay for clicks to your site. When doing this consider not paying more than $0.15 per click until you determine what your per click profit is.
• Google’s search results are layed out with sites found through the free URL submission down the left side of the page and the Google Ad Words sites down the right side of the page under “Sponsored Links.”

Submitting to Ask Jeeves/Teoma

• Ask Jeeves is one of the fastest growing search engines on the web. Through acquisitions and partnerships, Ask Jeeves has expanded their search results to several other search engines. Ask Jeeves owns a crawler based search technology which powers their search results.
• Ask Jeeves requires a $30 annual fee for most sites to submit to their search engine. For more information about their site submit program, click here.

Submitting to Gigablast

• Gigablast is a new upstart search engine crawler. SearchEngineWatch.com, a leading resource on search engines, mentions it as one of the major search engines on the web.
• Submitting to gigablast.com is free and easy. Click here to submit.