Crawl Delay

Note: This documentation is for an old version of Webinator. The latest documentaion is here.

Crawl Delay

Syntax: a whole number from 0 to 10

Causes Webinator to wait the specified number of seconds between page fetches. This is normally 0 but may be increased if the web server can't handle being hit rapidly. Increasing this value will force the walk to take at least this number, times the number of pages on the site, seconds to complete.

Note: Using a delay larger than 0 will force Threads(4.4.9) to 1. A delay defeats the advantage of multiple threads and large delays could cause unexpected page fetch timeouts.