Different types of search engines & Search Directories

 Different Types of Search Engines

When people talk about the term “search engine”, it is often used generically to explain both crawler-based search engines and human-powered web directories. In fact, these two types of search engines gather their listings in very different ways and therefore are inherently different.

#Crawler-based search engines, such as GoogleAllTheWeb, and AltaVista, create their data listings automatically by using a piece of software to “crawl” or “spider” the web and then index what it finds to build the search database.

Web page changes can be dynamically caught by crawler-based search engines and will affect how these web pages get listed in the search results.

Crawler-based search engines are good when you have a specific search topic in mind and can be very efficient in finding relevant information in this situation.

However, when the search topic is general, crawler-based search engines may return hundreds of thousands of irrelevant responses to simple search requests, including lengthy documents in which your keyword appears only once.

#Human-powered directories, such as the Yahoo directoryOpen Directory and LookSmart, depend on human editors to create their listings.

Typically, webmasters submit a short description to the directory for their websites, or editors write one for the sites they review, and these manually edited descriptions will form the search base. Therefore, changes made to individual web pages will not affect how these pages get listed in the search results.

Human-powered directories are good when you are interested in a general topic of search. In this situation, a directory can guide and help you narrow your search and get refined results.

Therefore, search results found in a human-powered directory are usually more relevant to the search topic and more accurate. However, this is not an efficient way to find information when a specific search topic is in mind.

#Summarizes the different types of the major search engines.

Search EnginesTypes
GoogleCrawler-based search engine
AllTheWebCrawler-based search engine
TeomaCrawler-based search engine
InktomiCrawler-based search engine
AltaVistaCrawler-based search engine
LookSmartHuman-Powered Directory
Open DirectoryHuman-Powered Directory
YahooHuman-Powered Directory, also provide crawler-based search results powered byGoogle
MSN SearchHuman-Powered Directory powered byLookSmart, also provide crawler-based search results powered by Inktomi
AOL SearchProvide crawler-based search results powered by Google
AskJeevesProvide crawler-based search results powered by Teoma
HotBotProvide crawler-based search results powered by AllTheWebGoogleInktomiand Teoma, “4-in-1” search engine
LycosProvide crawler-based search results powered by AllTheWeb
Netscape SearchProvide crawler-based search results powered by Google

From the table above we can see that some search engines like Yahoo and MSN Search provide both crawler-based results and human-powered listings, therefore become hybrid search engines. A hybrid search engine will still favor one type of listings over another as its type of main results.

There is another type of search engines that is called meta-search engines.

#Meta-search engines, such as DogpileMamma, and Metacrawler, transmit user-supplied keywords simultaneously to several individual search engines to actually carry out the search.

Search results returned from all the search engines can be integrated, duplicates can be eliminated and additional features such as clustering by subjects within the search results can be implemented by meta-search engines.

Meta-search engines are good for saving time by searching only in one place and sparing the need to use and learn several separate search engines. “But since meta-search engines do not allow for input of many search variables, their best use is to find hits on obscure items or to see if something can be found using the Internet.”

LEARN ABOUT: Shift in SEO Trends in Post Pandemic World

Liked what you see?  Let's be friends: Facebook | Linkedin | Twitter | YouTube

About the Author Shamsher

Live Instructor-Led online digital marketing trainer, a consultant, and an affiliate marketer with over 8+ years of experience View Course Details if you want to grow your business online or want to learn digital marketing online from anywhere.

follow me on: