Google Patent Granted on Duplicate Content Detection in a Web Crawler System
Some patents from the search engines provide detailed looks at how those search engines might perform some of the core functions behind how they work. By “core functions,” I mean some of the basics such as crawling pages, indexing those pages, and...

How a Search Engine May Choose Search Snippets
When you search at Google or Yahoo or Bing, you’ll see a set of search results that include a page title, a summary or snippet of the page, and a URL indicating the address of the page. Often, that combination of title, snippet, and URL will be the...