While both web directories and search engines gained popularity in the 1990s, search engines developed a life of their own becoming the preferred method of Internet search.
For example, the major search engines found in use today originated in development between 19.
In October 2002, Yahoo shifted to crawler-based listing for its search results. purchased Overture’s pay-per-click service, which had only months earlier purchased Alta Vista and Allthe Web, and Inktomi’s search database. combined these tools to create its own search index. Search Marketing and provides paid search advertising revenue. Directory remains one of the top indexes powering search listings.
Also as part of the deal, Info Space acquired rights to Web Crawler.
Ask Jeeves (now Ask.com) purchased the portal in 2004. Originally it was a highly regarded directory of sites that were cataloged by human editors.
Wandex’s technology was the first to crawl the web indexing and searching the catalog of indexed pages on the web.
Another significant development in search engines came in 1994 when Web Crawler’s search engine began indexing the full text of web sites instead of just web page titles.
In 1991, Mark Mc Cahill, a student at the University of Minnesota, effectively used a hypertext paradigm to create Gopher, which also searched for plain text references in files.