Note: This documentation is for an old version of Webinator.
The latest documentaion is here.
Follow Cross-Site Links
Syntax: select Y or N
When crawling multiple hosts, setting Follow Cross-Site Links
to Y will allow links from one host to another to be respected,
as opposed to only starting from each host's Base URLs.
If you have a lot of Base URLs that have lots of duplicate links to
each other that would've been found on-site anyway, setting
Follow Cross-Site Links to N can improve crawl
performance.
Copyright © Thunderstone Software Last updated: Thu Dec 22 14:38:01 EST 2011