Jul 30, 2008

Cuil - New search engine takes aim at Google


There's a big new search engine launching Monday: Cuil. Developed and run by the husband-and-wife team of Stanford professor Tom Costello and former Google search architect Anna Patterson, it's pitched as bigger, faster, and better than Google's flagship search engine in pretty much every way.

The most important difference between Cuil and Google is its ranking system. Rather than assigning priority to pages based on inbound links as Google does ("Pagerank"), Cuil analyzes the content of Web pages to divine their relevance to a search query. Costello bristled when I asked if this was a semantic search engine like PowerSet (recently sold to Microsoft). Costello said Cuil's search is "contextual," and that, "we're trying to understand the real world, not the Web."

It's one thing to have a nice interface and show users good results, but the size of the Web index that the engine has access to matters a lot as well. And this is where Cuil makes its boldest claim. Costello says that the engine is launching with 120 billion pages indexed, well over the 40 billion he says Google has (although see Google's latest bluster about the company's power at Web indexing). Costello also claims that Cuil's Web crawler is three times faster than Google's, although it wasn't clear to me if he meant that is per search computer or for the entire system. Compared with Google's globe-spanning data network of data centers, some literally set up near dams so they can tap hydro power more efficiently, Cuil's two puny data centers hosting less than 2,000 PCs total will have to run pretty fast to outpace Google's crawlers.

It won't, though, be as complete as Google. While Google has had failures in extending its brand (Froogle, Google Base), its collection of services that are affiliated with its mainstream search product, like Google Maps, Image Search, and desktop search, can make switching away from Google difficult for users. Costello realizes that Cuil needs to layer in additional services, but as he said to me, the company has to start somewhere.

www.cuil.com

Source: cnet