Jun 01 2010

Project condition

The Centiverse is now powering all the Zooka systems to provide a very fast feed search engine. Also Centiverse is powering Sitexploration used for link analysis. Both sub systems are getting data from ZookaBot (old CentiverseBot)
Nov 23 2009

Educating the bots

The bots are beginning to behave like they should. To begin with they had a malfunction regarding the robots.txt. If the server was busy or a timeout occurred it simply disregarded it – big mistake! Now you can control the crawler using normal robots directives.
Nov 22 2009

More power more data

The system has been heavily updated on the hardware level. Now it should be able to handle more languages and more data. Right now, there are over 54 million pages in the system. All are Danish.