Features

Here are some of its features:

• All actions are logged (see -l).

• One or more Web sites may be indexed into a single database.

• Multiple databases may be maintained (see -d).

• A Web site may be copied to the local file system (see -c).

• Multiple copies may be run simultaneously against the same database.

• Robots.txt is respected.

• Support for proxy servers.

• Support for meta data.

• Totally customizable search interface.

There are many more features and options to tailor its behavior to your needs.