• Create BookmarkCreate Bookmark
  • Create Note or TagCreate Note or Tag
  • PrintPrint

How Search Engines Work

Search engines are designed to make it as easy as possible for you to find what you want on the Internet. But with hundreds of millions of Web pages stored on computers all over the world—and more being added all the time—how can search engines possibly collect them all? And what do they do with the information once they get it?

Spiders and indexes

Search engines do their data gathering by deploying robot programs called spiders or crawlers. Some even have names and personalities, like “Scooter,” the AltaVista spider (Figure 1.6). Scooter and other such programs are designed to track down Web pages, follow the links they contain, and add any new information they encounter to a master database or index.


PREVIEW

                                                                          

Not a subscriber?

Start A Free Trial


  
  • Creative Edge
  • Create BookmarkCreate Bookmark
  • Create Note or TagCreate Note or Tag
  • PrintPrint