January 2008

On request, crawl-it will check your web site's availability! Your web site is contacted at regular intervals and, if our server discovers that your site is unavailable, you will automatically be informed by email. You can also view individual availability statistics for your site.

January 30th 2007

Through crawl-it's "boosting" functionality, customers can define the order of the search results.

December 1st. 2005

Server farm extended and optimized. With these investments and improvements, the response times of searches, particularly with very large amounts of data, have been improved significantly.

July 1st 2005

Crawl-it free&fun customers with over 800 search requests per month will now be upgraded to the "premium free&fun tariff". This includes an indexing of 1000 web pages.

March 1th 2005

Business customers can now select between the common "broad search" and the new "fast search" algorithm. The "fast search" algroithm allows a very fast search, also in a large amount of pages.

July 1th 2004

Crawl-it offers new functionality. Website administrators can now assign websites to result groups. These groups will be diplayed on top of the result list. With this, the administrator can have influence on the order of the result list.

January 3rd 2004

Crawl-it has enlargened its server farm to garantuee that the increasing amount of customers still receives professional response times. The clustered servers garantuee a minimal amount of downtime.

January 11th 2003

Crawl-it is capable of indexing passwort protected webpages. The customer only needs to insert the username and password into the appropriate fields in his members area.

July, 2nd

Crawl-it has again optimized it's webcrawler. The crawler is now capable of indexing a wide range of dynamic websites.

April,4th 2002

Crawl-it is the winner of the 2002 Goldberg Multimedia Award in the category "Best Web Service". Crawl-it has been described as "Intelligent web application with a intuitive user interface".

Feb 1th 2002

Crawl-it now supports the indexing of Portable Document Format (PDF) documents during web site indexing. When using the crawl-it search functionality, customers can now offer a full text search over archived PDF documents via the internet. The PDF indexing functionality can be purchased as an add-on feature to each respective service package for 5 Euro per month or 50 Euro per year.

May 21st, 2001

Crawl-it is now the only Application Service Provider for site search capability to provide highlighted result pages. This feature allows the highlighting of search keywords on the pages returned by a site search. Users can immediately see the search keyword on the returned text page and can easily determine the relevance of the page.

October 25th, 2000

Crawl-it now offers an additional highlight: the site map which is automatically generated and updated. And it uses crawl-it's own successfully implemented search function technology. The site map provides each web site visitor with a quick overview of the contents of the site.

July 1st, 2000

Crawl-it has a special free offer for universities with up to 3000 pages indexed once per week. Universities interested in this offer can register as usual using the "Free & Fun" tarrif, then apply for the University offer via uni@crawl-it.de.

May 3rd, 2000

Crawl-it introduces new price structure. It now includes a "business startup" tariff, which will help small companies to start a search engine at a very low cost. More information can be found on our price list.

April 30th, 2000

The search result list now displays a section of the text (200 characters) in which the search string first appears. It is displayed under the link to the page and makes it easy to to find the position in the text in which the string is located.

March 8th 2000

Crawl-it introduces "What's New" functionality. this feature creates a list of all URL's to all pages which have been created or modified. This is particularly useful to users who frequently a web site, as they can easily see a summary of the latest changes.

February 1st 2000

Crawl-it starts its search engine service.