Wrath of Twiceler
Aniket Kadam, Sep 03, 2008 1143 hrs IST
Cuil previously claimed that their index was larger than Google itself but a cursory glance proved that not to be the case.
Cuil the search engine, of not so recent fame, got an interesting effect when they unleashed their indexing bot onto the web across the globe. The company previously claimed that their index was larger than Google itself but a cursory glance proved that not to be the case.
Well it looks like their attempts to make good on that promise were a little too overzealous, their indexing engine, albeit experimental wreaked havoc on the web when it was found to consume so much bandwidth of the sites it attempted to index that it brought the site down.
Apparently the bot generates pseudo random addresses and then checks to see if they exist within the site, however it attempts to do it too fast and results in legitimate requests to the site being blocked. It's strange that the Cuil operational engineer only mentioned ways for sites to request not to be indexed and not if they're working on ways to limit the damage caused by the bot.
However, here's hoping they can sort out this mess, Google no matter how good of a company it might be, should always have some competition in the web searching field.
Techcrunch
VIEW ALL LATEST
Video: Adobe Flash 10 Running on G1
News > Software , November 19, 2008 1706 hrs IST
iPhone watch out! ...
Nokia Signs MoU with Telecom Italia
News > Telecom , November 19, 2008 1944 hrs IST
Technological innovations for the future ...
iPhone: Number 1 Handset in the World
News > Gadgets , November 19, 2008 1859 hrs IST
Says Admob ...
Low Cellphone Sales In Cities
News > Consumer Electronics , November 19, 2008 1756 hrs IST
High prices and inflation taking a toll ...
Fashion your Firefox!
News > Internet , November 19, 2008 1722 hrs IST
Social Butterfles, Shutterbugs, and Rock Stars, dress up your Firefox with your favorite add-ons ...
MOST REQUESTED REVIEWS
MOST POPULAR NEWS
|
Could A DVR Save Your Marriage?News | Consumer Electronics | 04 Sep 2008 ...Or should you stick to your shrink? |
|
Firefox Counters Chrome's Speed TestAccording to Mozilla's SunSpider test, Firefox 3.1 is 28% faster than Chrome on ... |
|
Nokia N96 for Rs. 40,000?False alarm everyone... We have learnt from Nokia that the N96 will be priced be... |
MOST POPULAR REVIEWS
MOST POPULAR GAMES
MOST POPULAR DOWNLOADS
|
Forbidden.exe |
|
md5deepDownloads | System Tools | 04 Sep 2008 |
|
RivaTunerDownloads | System Tools | 03 Sep 2008 |
