Allow an entire domain (-domain)

Syntax: -domain=DOMAIN

Allow walk to fetch pages from any host in DOMAIN. Any URL having a hostname ending in DOMAIN will be accepted. This option may be specified more than once to specify multiple acceptable domains.

e.g.: -domain=othersite.com http://www.mysite.com/ will walk all of www.mysite.com and any URLs referring to any machine in othersite.com.

This option is not a ``restricter'', but an ``enabler''. All hosts specified will be walked and any others that match the given domain(s) will also be walked.

Note: This option will NOT hunt down and walk every web server in the specified domain. It will simply allow walking them if they are referred to.