Note: This documentation is for an old version of Webinator. The latest documentaion is here.

Define prefix exclusions (-x)

Syntax: -xURL

Excludes URLs with the prefix URL. This option may be specified multiple times to exclude multiple prefixes. The effect is the same as if the remote system's robots.txt file had the same entries.

e.g.: ``gw -xhttp://www.mysite.com/text'' will skip all URLs beginning with http://www.mysite.com/text


Copyright © Thunderstone Software     Last updated: Tue Nov 6 10:58:47 EST 2007
Copyright © 2024 Thunderstone Software LLC. All rights reserved.