Advanced Walk Settings

These are the advanced settings that are used less commonly than the settings available in Basic Settings. The advanced settings are available in All Walk Settings. You are not limited to the features listed here. You may modify the dowalk script to create additional features and to make the walk behave however you want it to behave.

See also Customizing the Walker 6.5 for information about the inner workings of the dowalk script.

• Watch URL
• Notify
• Attach Logs
• Categories
• URL File
• URL URL
• Single Page
• Page File
• Page URL
• Strip Queries
• Ignore Case
• Extra Domains
• Extra Networks
• Extra URLs REX
• Exclusion REX
• Exclusion Prefix
• Exclude by Field
• Data from Field
  • Data From Field Example - Using Description for Title
  • Data From Field Example - using PublishDate for Modified Date
  • Data From Field Example - grabbing Price from meta
  • Data From Field Example - grabbing Price from Text
• Required REX
• Required Prefix
• Max Page Size
• Max Pages
• Max Bytes
• Max Depth
• Page Timeout
• Meta Tags
• Standard Meta
• All Meta
• Storage Charset
• Source Default Charset
• XML UTF-8
• Keep HTML
• Keep Links
• Remove Common
• Ignore Tags
• Keep Tags
• Ignore Characters
• Plugin Split
• Word Definition
• Index Fields
• Compound Index Fields
• Extra Indexes
• Spell-check Dictionaries
• Primer Type
• Primer URLs
  • Submitting the Form Directly: Custom Primer URL
  • Filling Out the Form: Custom Primer Variables
  • Checking for Bad Logins: Bad Login MM Query
  • Multiple Primers: Base URL MM Query
• Login Info
• Proxy
• Proxy Login Info
• Cookie Source Path
• Off-Site Pages
• Stay Under
• Prevent Duplicates
• Duplicate Check Fields
• All Extensions
• Store Refs
• Inline Iframes
• Max Frames
• Execute JavaScript
• Fetch JavaScript
• JavaScript String Links
• Debug JavaScript
• JavaScript Memory
• JavaScript Timeout
• Protocols
• Authentication Schemes
• Embedded Security
• Entropy Source
• Max Redirects
• Index Name
• DNS Mode
• Net Mode
• User Agent
• Mime Types
• Respect Expires Header
• Default Refresh Time
• Minimum Refresh Time
• Maximum Refresh Time
• Maximum Process Size