Base URL
Syntax: one or more URLs, one per line
This is the address where the web crawler will start walking your site.
If the whole site is to be searched, simply enter your web address, ex
- ``http://www.mysite.com''. If the search is to be limited, specify the
address to start the search or create a page listing the URLs to
search. The search will only return information from your web site - no
off-site searching will be done. Directory URLs should include a final
forward slash ``/''. Example - ``http://www.somehost.com/mysite/''. If you
have a virtual domain that just redirects to another URL, enter the
destination URL as your Base URL instead of your virtual domain name.
You may specify multiple base URLs to index multiple sites.
Webinator's
idea of a ``site'' is a single host as identified by the
hostname portion of a URL. Therefore http://www.mysite.com,
http://www2.mysite.com, and http://mysite.com
would all be considered different sites.
In version 4.02.1046373961 Feb 27 2003 and later, the special ``protocol''
http-post or https-post may be used for a Base URL. This
uses the POST method instead of the GET method to fetch the URL, using the
query string as POST data. This can be used to start walking at a login
page form that requires POST instead of GET. Note that the URL stored
in the html table will have the -post and query string
removed for security, so Refresh-type walks may not work. Eg.
``http-post://www.somehost.com/login.asp?user=bigbird&pass=open-sesame''
See also URL file 4.5.2,
URL URL 4.5.3,
Single page 4.5.4,
Page file 4.5.5, and
Page URL 4.5.6
for more ways to specify URLs.
Copyright © Thunderstone Software Last updated: Tue Nov 6 10:58:37 EST 2007