How search engines crawl

  1. Start at known sites
  2. Follow links to new pages
  3. Store page data for easy retrieval

Related