Our Network: Proxy Directory NEW! Top Sites Learn SEO eBusiness solutions Proxy Browsing NEW! Anonymous Surfing Shrink your link! NEW!
 Submit new Articles
Crawler-based Search Engines (part 3) PDF Print E-mail
User Rating: / 0
PoorBest 
Written by Seo Master   
Thursday, 23 August 2007

Image Inktomi (http://www.inktomi.com)

Inktomi Corporation is a technology company with one of its main components being the Inktomi search engine. Inktomi licensed its search engine out to other companies, such as HotBot, that wanted their own search engine without having to build one from scratch. Yahoo! purchased the Inktomi search engine in 2003. Since then, Inktomi's own crawler is no longer crawling the Web; instead, it has transformed into the Yahoo's crawler.

 

Inktomi's sole purpose in life is to provide results for other search engines. Now hence owned by Yahoo! it is no longer accepting new subscribers to its Search Submit program. If you're interested in joining a similar program, they'll redirect you to their partner Overture Services with its paid Site Match program. Overture and Yahoo! both use Inktomi's spider and, on a limited basis, their database to feed their search results.

Similar to all other crawler based search engines, Inktomi follows links to find the new pages. There is no way for you to submit your site for free. To get listed, get some links to your site from the sites that Inktomi thinks are important. You might want to do a search at MSN for your main keyword and see if you can get links from the sites that are highly ranked.

Other popular search services that use Inktomi are HotBot and Lycos. Until recently there was also MSN, but since February 2005 MSN uses its own crawler and is no longer supported by Inktomi.

In fact, the Inktomi search engine as such is defunct, and in order to get your pages in the search engines that were once powered by Inktomi, submit to Yahoo! search engine and follow the guidelines we've provided here for Yahoo!.

FAST Search / AllTheWeb and AltaVista (http://www.alltheweb.com)

FAST (now called Fast Search and Transfer) is a Norwegian company that specializes in search and filter technology solutions. Some time ago it built the AllTheWeb search engine. In 2003, AltaVista and AllTheWeb were bought out by the Overture engine, the second being bought from FAST Search. Overture, in its turn, was purchased by Yahoo!. It is through this route that AllTheWeb has joined the Yahoo! family of search engines. As a result, AllTheWeb's spider is no longer crawling the Web, and you can no longer submit to the engine. Its XML feed and paid inclusion programs have been changed over to Overture programs. Submitting to the Yahoo! Search (and getting indexed there) will get your pages in AltaVista, Yahoo! Web Results, AllTheWeb, MSN, HotBot, Overture supplemental results, and other Inktomi-powered engines.

AltaVista (http://www.altavista.com) was once a big player in the search industry. Until about five years ago they could claim to be the most used search engine. Since that time, this engine has lost its independence and much of its popularity. Nowadays, it's sending very little traffic to Web sites. As well as AllTheWeb, it was purchased by Yahoo together with Overture.

Teoma / Ask Jeeves (http://www.teoma.com, http://www.ask.com)

Teoma is a search engine owned by Ask.com (also known as AskJeeves). It has been developed on the basis of the DirectHit service when the latter became defunct. DirectHit was a search engine that provided results based on click popularity. So, the sites that received the most clicks for a particular keyword were listed at the top. Some time ago, many search engines such as HotBot, Lycos and MSN used DirectHit.

These days, DirectHit only displays the Teoma search engine start page. Teoma has become a regular crawler based search engine although it appears that they may still use click analysis to do the ranking.

Recent improvements at Teoma (with the introduction of Teoma 3.0 search technology) include upgrading the search engine to improve relevance and freshness, expanding its index to 2 billion documents, and introducing the capability to scan irregular file types such as PDFs and Flash.

Ask Jeeves discontinued its paid inclusion Site Submit program on August 31st, 2004 , and it is no longer using an XML feed submission service either. There's no possibility to submit the site to Teoma either.

Teoma (Ask Jeeves) is one of three different engines that are now providing search results at HotBot. (The engines that provide results at HotBot are HotBot (Yahoo! search results), Google, and Ask Jeeves.). Other search services that will display your site in their results after they are indexed by Teoma include Metacrawler, Excite, iLor, MySearch.com, MyWay.com, Ixquick, Mamma.com, and Search123.com.

Teoma's claim is that although it scans only a fraction of the content covered by major engines like Google, it produces well ordered and relevant search results by initially eliminating all the irrelevant sites and then considering the popularity of only those that relate to the search subject in the first place. It also provides other ways to sort through thousands or millions of search results. Along with the straight search results, it offers "expert links" to sites that may not be widely visited but contain valuable information, as well as suggested subcategories to help users narrow their searches.

Experts like Eric Ward (link popularity professional) recommend Teoma's "expert links" a sufficient source of good reciprocal linking prospects.

Teoma determines relevance using link analysis to identify communities on the Web. It then determines which sites are authorities within those communities to find the best and most relevant pages. They refer to this process as Subject-Specific Popularity.

Chris Sherman of SearchDay explains:

"It's similar to the way Google works, but with some important differences. Briefly, whereas Google uses the collective wisdom of the entire web to determine relevance, Teoma tries to identify "local" authorities to help identify the best pages for a particular topic. Examining same subject pages that reference a site to determine its level of authority in addition to relevance is referred to by the company as Subject-Specific Popularity."

(the full article is available at http://searchenginewatch.com/searchday/02/sd0110-aj.html).

At the present time, Ask Jeeves uses Teoma as its main result provider, so it's fair to say they have the same index.

Optimizing for Teoma

  • A solid link popularity will play a considerable role for your listing;
  • Teoma indexes the entire text on a Web page and does not ignore the stop words like "on", "the", "and" etc;
  • The META description tag is important for Teoma, so try to use your keywords in META Description (as well as in all other META tags);
  • Refresh your content on a weekly basis. This advise is good for all search engines in general.

Here's the information for finding Teoma in your server logs:

The crawler comes from the IP address of 65.214.xx.xx and will be called egspd433.teoma.com. The user agent shows as Mozilla/2.0 (compatible; Ask Jeeves/Teoma).

While Teoma does not allow free submissions, like all crawlers, it will list your site for free eventually if it finds it by following the links from other sites on the Web. This can take up to three months.

Hence, since the Teoma's results are used on AskJeeves, a very popular search service, it is certainly worthwhile trying to optimize your pages for the Teoma search engine.

Comments (1)Add Comment
Thanks
written by Patrick Burt, August 23, 2007
Thanks for the advice m8. With all the brou-ha-ha revolving around optimizing for Google, people seem to forget that with a little effort, you can optimize for other search engines.

Write comment
quote
bold
italicize
underline
strike
url
image
quote
quote
Smiley
Smiley
Smiley
Smiley
Smiley
Smiley
Smiley
Smiley
Smiley
Smiley
Smiley
Smiley

security code
Write the displayed characters


busy
 

Ads

Polls

Where did your hear about WebUniver?
 

Who's Online

Image

Learn to Fail to be Successful in Making Money Online

28.08.2007 | Business

Being successful online is part of all bloggers dream and to be successful in making money online, you need to fail to gain experiences and learn from your mistakes so that it will not repeat its history. Many people do not understand the word "Failure" and once they fail…

Auditing and Improving Your Site

22.10.2007 | Marketing

You may ask yourself why we include material on site maintenance in a course that deals mainly with search engine optimization, promotion, and marketing – isn’t this the job of the webmaster or site administrator?Remember the Integrated Approach considers site quality maintenance a secondary yet obligatory addition to your promotion…

Image

What Are The Pros And Cons Of Using Flash Sites

22.08.2007 | Design & Development

Flash - based sites have been a craze since the past few years, and as Macromedia compiles more and and great features pursuit Flash, we can only predict practiced will exemplify more and more flash sites around the Internet. However, Flash based sites have been disputed to be bloated…