|
Syntax: -xURL
Excludes URLs with the prefix URL. This option may be specified
multiple times to exclude multiple prefixes. The effect is the same
as if the remote system's robots.txt file had the same entries.
e.g.: ``gw -xhttp://www.mysite.com/text''
will skip all URLs beginning with http://www.mysite.com/text
Copyright © Thunderstone Software Last updated: Tue Nov 6 10:58:47 EST 2007
|