Webinator Change Log
Color meanings:
 Version  Caveat  New feature or enhancement  Fix  S/F = Requires [S]cripts or [F]ull update. * = May not apply. 
DateS/FKeywordsLog
2012-08-27 S Webinator Version 6.1.5
2012-08-21 S Fix Fixed scenario where refreshing setting submission could incorrectly re-start wallks
2012-08-17 F Enhancement Fixed logging of some rare, fatal crawl errors
2012-08-15 F Fix Fixed 'New' crawls failing with 'Free Webinator' license
2012-07-30 F Fix Added ResultsFromCache element to search SOAP WSDL
2012-07-24 S Fix Fixed 'Add More Schedules' in older Internet Explorer versions
2012-07-13 F Feature Low Add setting for static cookie jar data, in the profile as opposed to an external file.
2012-07-13 F Feature Low Fetch Added Strict Cookie Paths setting
2012-07-13 F Enhancement Set REFERERs for primer URLs.
2012-07-13 F Fix Fetch Security Caveat Cookies with Path values that are not a prefix of the URL that is setting them will now be accepted during crawls, as most browsers do. May allow an application to alter the cookies of another application that is on the same server, which may be a security issue. Configurable with the Strict Cookie Paths setting
2012-07-09 S Webinator Version 6.1.4
2012-07-09 S Feature Low Added new Search Setting of Phrase Word Processing, for ability to turn off suffix/wildcard processing in phrases
2012-07-03 F Enhancement Added PDF Highlighting support for Adobe Acrobat Reader X"
2012-06-29 F Fix Fixed multiple child crawlers being launched on the same site
2012-06-29 F Fix Fixed scheduled crawls overwriting existing crawls
2012-06-12 S Webinator Version 6.1.3
2012-05-24 S Enhancement Added 'Client Info' page in Maintenance
2012-05-14 F Fix Fixed processing headers from invalid binary files sometimes being used as content
2012-05-14 F Enhancement Added support for restoring additional legacy backup formats
2012-04-30 S Enhancement Added ability to remove custom XSL files from profiles
2012-04-27 F Enhancement Low Add more Maximum Process Sizes between Large and Huge. Add a note to not use Unlimited.
2012-04-25 F Enhancement Changed default Base URL for profiles to consistent 'http://'
2012-04-24 S Enhancement Improved efficiency of List/Edit searches for large profiles
2012-04-23 F Fix Fixed walks failing when admin-created extra metamorph inverted indexes don't contain any content
2012-04-18 S Webinator Version 6.1.2
2012-04-16 F Fix Fixed crawls repeatedly launching and hanging when refreshing some Base URLs
2012-04-12 F Fix Fetch A file:// directory URL with many (~100,000+) files in it was sometimes silently truncating files past ~80,000 or so, with no error. Workaround is to increate Max Page Size.
2012-04-11 F Fix Errors in crawled XML files are now saved properly instead of being printed to the walk log
2012-04-11 S Fix Fixed 'Report Abbreviated' links being improperly escaped
2012-04-09 S Webinator Version 6.1.1
2012-04-06 F Fix Improved RAM usage while building spell checker dictionaries
2012-04-02 F Enhancement Added 'Off-Site Components' setting for toggling off-site frames and redirects
2012-04-02 F Fix Fixed offsite iframe errors preventing pages from being crawled with Offsite Pages=N
2012-03-16 F Fix Sql "Wrong size from TXa2i_setbuf()" errors may occur when updating a Metamorph compound index with row(s) larger than 512KB. Corruption unlikely from update, but can also happen during index create -- without any error(s) reported, and with corruption. Affects Texis versions from 2011-12-03 through 2012-03-16. Workaround is to turn off an optimization in SQL: "set nooptimize='indexvirtualfields'.
2012-03-14 S Fix Fixed Url listed in 'Match Info' pages for metasearch profiles
2012-03-09 F Fix Anytotx A PDF with no docInfo could cause anytotx to ABEND with -M (Appliance/Webinator default flag)
2012-03-07 F Fix Fixed changing categories during a walk causing URLs to maintian old category information
2012-03-07 F Fix Fixed category changes while launching a refresh crawl not updating existing content's categories
2012-03-06 F Fix Fixed refresh walks sometimes not respecting categories changed as the refresh walked luanched
2012-02-22 F Enhancement Low Added warning message when the web interface specifies an invalid entry point
2012-02-22 F Fix Better GUI handling of attempting to access nonexistent profiles
2012-02-22 F Fix Fixed extraneous vortex.log messages about 'duplicate field spec' when using dataload
2012-02-15 S Fix Fixed 'help' links on System Wide Settings when no active profile is selected
2012-02-13 F Enhancement Made walk log format more consistent with timetsamps and sources
2012-02-07 F Enhancement Improved efficiency of long-running crawls pullin from todo table
2012-02-06 F Enhancement Increased efficiency with long crawls pulling from the todo table
2012-02-03 F Enhancement Improved efficiency with large todo table
2012-01-12 F Enhancement Added 'Authorization Target' setting to allow VerificationUrl-only auth, skipping individual result auth
2012-01-04 F Fix Removed redundant 'Modified Date' Data From Field target
2012-01-04 F Fix Profiles may not have been creatable due to missing index file; "Could not find index xoptprofilename" errors
2011-12-23 F Fix Low Windows installer was not properly re-shrinkwrapping conf/texis.ini after installing ISAPI, resulting in warnings about user-modified conf files at next upgrade
2011-12-22 F Fix Improved Data From Field handling of Unicode punctuation
2011-12-20 S Webinator Version 6.1.0
2011-12-15 F Fix Enabled crawling pages that reference resources that give Document Unauthorized
2011-12-08 F Enhancement Added more Data From Field targets
2011-12-04 F Enhancement Performance Low Sql Metamorph Try to avoid failing Metamorph index builds/updates completely, when certain low-memory situations encountered
2011-12-01 F Enhancement Performance Sql Reduced Metamorph index builds' later (but not peak) mem usage, after reading a very large row
2011-11-18 F Enhancement Low Performance Added index to options table to speed up Profiles page, some settings updates
2011-11-01 F Enhancement Added Task Monitor Logging
2011-10-17 F Fix Low Extras Download, DB Walker, image caching, online documentation may occasionally have failed or produced errors due to missing a character in the URL ($userpath)
2011-10-07 F Fix Low Anytotx Fix parsing of "Date" like properties to handle other than stock PDF format. Texis similar dates are cleaned up into Texis style. Others are left as-is.
2011-10-04 F Fix Data From Field now properly operates on plugin-translated documents (pdf, doc, etc)
2011-10-03 F Fix Low Caveat Some texis.ini SSL settings changed to align more with Apache-style conf; install program updates them at upgrade, so no user fixup should be needed. Settings relate to GUI apply-license functionality.
2011-09-29 S Fix Low Changing Debug Mode under System Wide Settings was failing with `Cannot find ... script' error
2011-09-26 F Fix Metamorph Inline settings (e.g. `@minwordlen=5' were not always being applied solely to following sets during Metamorph index queries
2011-09-24 F Fix Low Hit-highlighting "legend" (highlighting the query itself, to show which terms are which colors in text) was highlighting inline settings (e.g. `@suffixproc=0') too, even though these "sets" are never searched for in the text; could be misleading
2011-09-24 F Fix Metamorph Inline settings (e.g. `@suffixproc=0') were causing post-processing of otherwise fully indexable queries
2011-09-20 F Fix A REX NOT (`!') sub-expression that searches backwards (e.g. is before the `>>' anchor sub-expression) was not matching to start-of-buffer/max-repetition if its sub-expression was not found, the way a search-forward NOT sub-expression would.
2011-09-15 F Fix Sql Creating a database in Windows could cause ABEND
2011-09-13 F Fix Allow html(AuthorizationUrl) field for Free Webinator schema, so profiles can be created
2011-09-09 F Enhancement Low Try to recover from erroneous extra `Transfer-Encoding: chunked' header from server, instead of failing entire fetch with `Missing chunk size ...' and `Cannot decode Content- or Transfer-Encoding' errors
2011-08-22 S Enhancement Added 'Show Authorization Info' for displaying individual Results Authorization results, to assist in troubleshooting ResAuth
2011-08-22 S Version 6.0.3
2011-08-19 F Fix Fetch `Cannot completely convert charset ISO-8859-1 to ISO-8859-1 ...' error could occur if an HTML page was fetched without a labelled/detected/default charset, if it contained >U+00FF HTML-escaped entities in links or attributes; even if charsettext/Storage Charset was UTF-8 not ISO-8859-1.
2011-08-03 F Fix Fixed PDF Highlight Url Functionality for SOAP Search results
2011-08-01 F Fix Unix installation script now has increased support for SELinux
2011-07-15 S Fix Fixed possible duplicate links when tracking refs
2011-07-15 S Enhancement Low Docs Make warning about exceeding "Max User Results per Page" more consistent.
2011-07-15 F Fix Low Docs Fix quick help for "Max User Results per Page" to say correct variable "rpp" instead of incorrect "resultsPerPage".
2011-07-14 S Fix Better cleanup of refs for removed URLs
2011-07-12 F Fix Fetch Avoid `Connection reset' error (especially during local fetches) from some servers that appear to support Keep-Alive but do not
2011-07-08 S Fix Fixed creating profiles with multiple DatabaseDirs in texis.ini
2011-07-01 S Version 6.0.2
2011-06-27 F Fetch Fix Low JavaScript library now interprets scripts/strings as UTF-8, so charsetsrc is properly taken into account
2011-06-14 F Enhancement Unknown HTML tags now cause a space to be inserted in formatted text, to help avoid run-together words when e.g. XML-like content inadvertently appears in HTML
2011-06-11 F Fix Stopping or pausing a profile's walk no longer affects other walks in progress
2011-05-11 S Fix Crawler now consumes less RAM when finalizing very large crawls
2011-04-26 F Fix Metamorph A Metamorph LIKE/LIKEP/etc. (keyword) search with equivs (synonyms), indexed and unindexed sets could potentially miss hits
2011-04-25 S Feature Parametric Caveat Added Attribute Compare Mode to change case/diacritic/etc. insensitivity of Parametric attribute comparisons. Character Match Mode renamed to Text Search Mode to clarify that it applies only to text (keyword) searches.
2011-04-19 F Enhancement Install script can now read Apache config files on Debian Linux boxes
2011-04-12 F Fix Fixed event log messages for the Thunderstone Proxy Module
2011-04-05 S Fix A Unicode U+FFFF character in source data was not suppressed in XML output, causing XML search errors
2011-03-29 S Fix Fixed javascript error on walk configuration pages
2011-03-28 F Fix FTP of a URL after fetching an FTP dir might return `Garbled response' or `Missing parameters' on some servers (NetApp 7.3.4) that do not support no-arg `CWD'; fixed. Workaround is to set <urlcp> ftprelativepaths off.
2011-03-11 F Enhancement Added "Disable Walks" profile setting and "Disable All Walks" system-wide setting, for users in dataload-only scenarios
2011-03-08 F Fix Sql SYSCOLUMNS table was slowly increasing in size at every crawl or GUI access. Did not affect license document count, but GUI admin responsiveness could continually degrade.
2011-02-28 S Fix Fixed scenario where profiles with schedules at the same time may be recorded incorrectly
2011-02-25 S Fix Low Fix typo "schedlue" in fix schedules.
2011-02-22 F Fix Low Anytotx xls2csv (anytotx) was sometimes outputting numbers in Excel spreadsheets (*.xls) incorrectly or as random dates or command-line arguments, and/or causing an ABEND
2011-01-28 S Fix Fixed "Debug SQL Level" printing empty messages
2011-01-26 S Fix Low Avoid potential `Wrong server id', lock, and constantly-creating database problems if refresh crawl live database is missing or appears so
2011-01-25 F Fix Acls An ACE created under a Windows version might fail to appear in the GUI list after creation
2011-01-13 F Enhancement Low Added Language and Preserve 7-bit settings to Language Analysis setting
2011-01-12 S Enhancement Low Added `Max version num' to Maintenance -> Thunderstone Information, if supported
2011-01-10 F Fix Low Metamorph Fixed Metamorph memleak
2011-01-04 F Fix Low `oe'/`OE' ligature (U+0153/U+0152) was not being expanded under `loose' Character Match Mode
2010-12-22 S Fix Fixed list/edit display issue when a profile uses less than (but close to) 50 parametric fields
2010-12-22 S Fix Fixed possible infinite recursion in error handling
2010-12-21 S Version 6.0.1
2010-10-26 F Fix Fetch An HTTP/1.1 fetch of gzip+chunked page can cause a fetch timeout sometimes
2010-10-14 F Fix Skips building spell check dictionaries in situations that would cause errors
2010-10-13 S Fix Fixed unnecessarily fetching some extra Single Page URLs after walk limits have been reached
2010-10-12 S Fix Fixed displaying Query Report page after browsing to other Query Log pages
2010-10-05 S Enhancement Added better detection for crawls that immediately crash before registering themselves
2010-09-29 S Fix Fixed some new setting defaulting to incorrect values on existing profiles
2010-09-29 F Enhancement Multiple rewalk schedules can now be specified for a profile
2010-09-28 F Fix Fetch `Cannot convert charset ... to ... via converter ...: Timeout' error was possible during crawls/<fetch>, after long pause, especially for custom small Vortex <fetch>es
2010-09-22 S Fix Fixed page links for large list/edit URL patterns that involved an ampersand
2010-09-16 S Fix Try to avoid `Trying to insert duplicate value ... in index xerrorurl.btr' errors
2010-08-31 S Enhancement Added more options to Data from Field sources: URL Path, URL Query Var etc.
2010-08-31 F Fix Catalog imports now respect the "Crawl Delay" setting.
2010-08-31 F Enhancement Added Custom Suffix List, Custom Suffix Default Removal, and Custom Suffix Min Length settings
2010-08-27 F Fix Low Sql Avoid ABEND for certain SQL math expressions such as `pow('x'*'y', 0.43)'
2010-08-20 S Fix Fixed rare incorrect "Redirect from ..." error messages with no redirect
2010-08-19 F Fix Texis Monitor under Windows might consume CPU and/or fail to report job exit, when Vortex-<schedule> script exits
2010-08-07 S Fix List/Edit page after hitting "Update Soon" now displays the proper "Next Visit" time
2010-07-29 F Fix Make sure accessing a script as foo.vs or foo does not cause duplicate schedule entries, or .vs in schedule table
2010-07-29 S Fix Avoid potential duplicate schedules in Texis version 6
2010-07-28 F Enhancement Removed "Apply Appearance" and "Revert Appearance" checkboxes, now applied through "Update Test" and "Update Live and Test" submit buttons
2010-07-16 F Enhancement Added Auto BestBets, which allows pages to specify best bets for themselves in their meta headers.
2010-06-28 S Fix Fixed fetching pages that were errors on previous walks when the linking page hasn't changed between walks
2010-06-24 F Feature Anytotx Open Document Format documents supported
2010-06-24 F Fix Fetch Avoid `Cannot decode deflate data: zlib returned Z_DATA_ERROR: incorrect header check in the function TXzlibTranslate' error from some HTTP/1.1 fetches of Content-Encoding: deflate URLs
2010-06-16 F Feature Low Added Exclude Extensions setting
2010-06-08 S Fix Fix order of best bets in meta search results.
2010-06-08 S Fix Restore display of result Url when right best bets are turned on.
2010-06-08 F Feature Query Highlighting setting now split into Results Highlighting and Context Highlighting settings
2010-06-05 S Enhancement Added mdlt and mdgt search parameters to test if the Modified Date is less than, and if Modified Date is greater than, respectively
2010-06-03 S Fix Fixed Data From Field setting Modified Date when multiple values may match
2010-05-27 F Fix Fixed profile-section in the title order on some admin pages
2010-05-27 S Enhancement Moved "Best Bet Groups" under Profile Tools
2010-05-25 F Enhancement Fetch Try to avoid `No forward progress' error from some sites that return extra data after Content-Encoding gzip stream; now reports `Extra NNN bytes input ignored'
2010-05-19 S Fix Fixed changing categories while launching a refresh walk
2010-05-19 F Fix Low Javascript Support \uNNNN escapes beyond \uFF
2010-05-15 S Enhancement Added pagination to "show errors" and "show duplicates" on Walk Settings
2010-05-14 S Enhancement Added maxdups parameter to duplicate viewing system
2010-04-29 F Fix Anytotx Capture occasionally missed meta data from MSWord DOC files.
2010-04-29 F Feature Version 6 features: * GUI look and feel slightly improved with CSS * Improved abstracts * Hit highlighting in different colors for different terms * Maintenance section added, with network test, license update etc. options * XML output * SOAP API search service * Results authorization * Results groupable by site, max results per site settable * GUI for customizing the thesaurus * GUI for backing up and restoring settings * Meta search * HTTP Version setting * Character Match Mode: ignore-accents, improved UTF-8/Unicode searching * Language Analysis module (available separately) supported * Licenses applicable via GUI
2010-04-29 F Feature High Caveat Version 6 caveats: * Version 5 executables may not read/update version 6 indexes correctly * Withinmode word: w/5 is now within 5 words not 5 chars * Setting Extensions renamed to Allow Extensions; default now empty (allow all) * All Extensions setting moved up to next to Allow Extensions * Default for Exclusions is now `logout' * Allow XML setting removed: always on
2010-04-20 F Fix Low Attempt to avoid <exec bkgnd> error `Cannot set std[0] flags: The parameter is incorrect' in Windows
2010-04-08 S Version 5.1.88
2010-03-15 S Fix Show Parents' link title XML element now converts to display charset
2010-03-10 S Fix Low Allow single-letter prefix characters to use index, e.g. `d'asile'
2010-03-09 S Fix Fixed applying display character set to RSSUrl XML element
2010-03-09 S Feature Low Fetch Added Max Connection Lifetime setting to adjust Keep-Alive lifetime
2010-03-04 F Fix Fetch Crawling an FTP site may hang and consume CPU, usually after an extended period, when maxconnrequests or maxconnlifetime reached, especially during a directory request. Workaround: set maxconnrequests, maxconnlifetime higher than expected length of site crawl
2010-02-05 F Fix Low Using -dump when disabled, with a CGI invocation that does not have PATH_INFO set, can cause an ABEND
2010-01-19 S Enhancement Low Add meta robots noindex,nofollow to admin html.
2010-01-13 F Fix Performance Fetch Memory leak in fetch lib fixed; should reduce memory use during long-running crawls
2009-12-30 F Fix Fix handling of multiple meta robots tags. Use only first instead of all. In fetch test display all instead only first.
2009-12-17 S Fix Low Group By Field / Order by widgets may have appeared out of sync in GUI
2009-12-16 F Feature Document "Test network and servers".
2009-12-13 F Javascript Fix Low ABEND in jQuery ui.core.js fixed
2009-12-11 S Version 5.1.87
2009-12-07 S Fix Fix thesaurus upload on Windows when Texis install dir has spaces in it.
2009-11-23 F Fix Low Invalid-schema <timport> run after a valid <timport> was causing ABEND
2009-11-20 F Fix Metamorph Linear withinmode char/word matches should not depend on query set order; e.g. text `AA xx xx BB xx xx CC' was missed by `AA BB CC w/3' but found by `BB AA CC w/3'
2009-11-20 F Fix Metamorph Low Find some hits missed during linear withinmode char/word (char radius/word radius), e.g. query `AA BB CC w/3' withinmode word missed text `AA xx BB BB xx xx CC'; also an index issue
2009-11-20 F Fix Metamorph Low Linear withinmode char matches should account for varying anchor set length: query `/C+ /D+ /E+ w/7' should not only match `CCC xx DDD xx EEE' but `CCC xx DDDDDDDDDDDDDD xx EEE' too
2009-11-20 F Fix Metamorph Linear withinmode char/word matches should check for middle `anchor' term
2009-11-19 S Fix Low Fix path for thunderstone logo image.
2009-11-17 S Low Fix Add <hr> and date stamp foot to every admin page. Fix box msg function to output <tr> and </tr>. Add standard footer to profile tools page.
2009-11-17 F Feature Add fetch and network testing options to admin interface.
2009-11-16 F Fix Compiling a Vortex script was causing `Timeout reading from 127.0.0.1:10005', `Could not unschedule ... via monitor' messages under Windows, and possible `WaitForSingleObject failed' or `Recursive mutex lock (depth N)' messages in monitor.log
2009-11-10 F Fix Anytotx Some RTF documents were producing little or no text (but copious <META NAME>s instead) when run through anytotx plugin
2009-11-06 S Fix search's category search box no longer printed with no visible categories
2009-11-04 S Fix Low Large number of Index Fields and/or Compound Fields together would cause index creation to fail
2009-11-04 S Fix Low Index Fields can now *stay set* to more than 6 fields
2009-11-04 S Fix Spell-check Dictionaries was erroneously multi-value, and may not have taken effect
2009-10-27 F Fix Fetch Setting Max Page Size to -1 may have failed and resulted in `Bad parameter in the function TXfetchSetMaxDownloadSize' error message
2009-10-26 S Fix Low Do not say `best matches first' for results when ordering by custom Additional/Parametric field
2009-10-15 F Fix Fixes dataloading <Category> and <Categories> elements
2009-10-14 S Version 5.1.86
2009-10-11 F Fix Metamorph Sql within-N (word or char) was index-matching hits spanning <= 2N (ok), but without a set <= N from left and <= N from right; e.g. "A B C w/3" incorrectly matched "A x B x x x C" (B is > 3 words from right edge)
2009-10-09 F Feature Low Anytotx anytotx supports bzip2 compressed files, if native OS has `bunzip2' in path
2009-09-18 F Fix Fetch Large page fetches (truncated at maxpgsize) may have returned `Ok' with no message; large FTP fetches may have also reported `Missing HTTP response line' and `Max headers size exceeded'
2009-09-17 F Security During Unix install, do not allow CGI dir that points to morph3/bin: security risk and may rm texis
2009-09-14 F Fix Windows: Accessing GUI via ISAPI may give a Texis ISAPI error message, and `Texis Monitor failed to create license segment' message in monitor.log, due to monitor web server failure to initialize (but Texis Monitor runs). Workaround: start monitor from command line with stdin redirected from a plain text file
2009-09-11 S Low Enhancement Caveat Word Forms set to Plural & possessives now matches plurals/possessives down to 3 letters (was 5)
2009-09-09 F Fix Fetch `Persistent connection negotiated without Content-Length ...' message was occurring from some fetches, if server reply is HTTP/1.1 with no Content-Length nor chunked encoding (e.g. IIS/5.1 directory request)
2009-08-24 F Fix Sql Low <sqlcp cache close> was causing SQL statements to revert to Texis APICP defaults; should have left APICP alone
2009-08-05 F Fetch Feature Low Added <urlcp contentlocationasbaseurl on|off> to turn on/off interpretation of Content-Location as base URL
2009-08-03 F Enhancement Low Anytotx Unix compress and gzip formats supported by anytotx on all platforms (eg. Windows too) now
2009-07-28 S Version 5.1.85
2009-07-21 S Fix Low Flush error and warning messages to the client more often.
2009-07-15 F Fix Fetch Language Analysis Module could fail with `No result document' walk/query errors and `Illegal request id N in the function fcgi_makehdr' in monitor.log, after 65,535 pages and/or queries
2009-07-08 S Version 5.1.84
2009-07-02 S Fix Give spelling suggestions when query has leading or trailing whitespace.
2009-06-26 S Enhancement Improved walk failure error messages
2009-06-23 S Fix Low Displayed titles sometimes had garbled character at end, if lots of UTF-8 characters (eg. CJK)
2009-06-17 F Fix Metamorph Performance Fix memory leak when using XPM in Metamorph queries. Was leaking the length of every XPM term in a query. Introduced 2008-08-22.
2009-06-17 S Fix Avoid `invalid range sequence', `search subexpression too long' or other REX errors during crawls, eg. for URLs with brackets (URL-encoded or not). Affects scripts since 2009-03-23.
2009-06-16 F Fix Low Metamorph Performance eliminate memory like from setmmapi. Introduced 2008/09/05
2009-06-13 F Fetch Feature Low Caveat <urlinfo cookiejar> output has new fifth column: IsHttpOnly (TRUE/FALSE). Use <urlinfo cookiejar netscape4x> for old format. <urlcp cookiejar> understands both formats.
2009-06-12 S Low Fix Fixed navbar highlighting on List/Edit details pages
2009-06-12 F Enhancement Added mimeTypeQuery (mtq) search parameter
2009-06-11 S Enhancement Added support for RSS feeds to Page URL/Url URL
2009-06-11 F Fetch Enhancement Low Pages marked as UTF-8 but that contain 8-bit ISO-8859-1 characters should convert better (still with an error)
2009-06-09 S Fix Low Sorting profiles list by Name or Created, when no profile selected, was selecting the oldest or first-named
2009-06-09 S Fix Low Do not offer to delete certain predefined/internal profiles, if name collision
2009-06-09 F Fix Fetch Low Put a newline at <div> and </div> in formatted text
2009-06-03 S Fix CJK queries were sometimes not highlighted when CJK Mode set to Simple
2009-05-28 S Enhancement Changed Next Pages to be Fetched table to only show relevant pages
2009-05-28 S Fix Low Allow more than 3 Extra Indexes
2009-05-27 S Enhancement All URL errors are no longer printed at the end of the walk summary, linked instead
2009-05-21 S Version 5.1.83
2009-05-17 S Enhancement Added Query Highlighting search setting
2009-05-14 F Fix Fixed hiding non-Visibile Categories with XSL Stylesheet
2009-05-11 S Fix User Field character sets are now properly converted for List/Edit URLs
2009-05-11 S Fix Properly converts HTML Data From Field to storage charset
2009-05-11 S Fix Properly converts URL Decoded Data From Field to storage charset
2009-04-22 S Fix Low Avoid "Cannot resolve host `...http'" messages when trying to get robots.txt when multiple Base URLs exist.
2009-04-13 S Fix Fix for erroneous Top Queries counts
2009-04-13 F Fix Sql Fixed issue with query log reports, eg. top queries, returning erroneous/fluctuating counts
2009-04-10 S Enhancement Added Phishing Protection setting
2009-04-09 S Enhancement Query Logging now ignores multiple spaces for more consistent Top Queries
2009-04-06 S Enhancement Changed Stip Query and Exclusion defaults to allow common dynamic content
2009-04-06 S Fix Fixes file redirection when using Query Logging
2009-04-03 S Fix Clicking Stop or Pause on Walk Status will no longer be interrupted by the countdown
2009-04-03 S Enhancement Maximum Process Size setting now shows exact numbers
2009-03-31 S Version 5.1.82
2009-03-24 S Enhancement Added support for Boolean keywords
2009-03-23 S Fix Fix handling of non-existant files in a file: crawl. Previously would store info about missing files and not
2009-03-19 S Fix Added support for sub-second Crawl Delays
2009-03-12 S Version 5.1.81
2009-03-06 S Fix Enhanced killing of stuck children when stopping a walk
2009-02-24 S Enhancement Added new Result Order, "Url"
2009-02-20 S Fix Blocked potential phishing usage of Webinator's redirect functionality
2009-02-19 S Version 5.1.80
2009-02-18 F Javascript Fix Fixed ABEND during crawls with JavaScript enabled and JavaScript Memory set very low (200 bytes)
2009-02-17 F Fix Low Avoid `Cannot create directory ...: Cannot create a file when that file already exists' error if possible, when creating a directory and its parents and a parent dir lacks List Folder Contents perms
2009-02-11 S Enhancement Added Username Fixup setting to assist with ResAuth
2009-02-04 F Fix Free Webinator licenses were generating "Schema for table options not permitted by current license" errors and failing to run; affects versions from 2008-11-13 through 2009-02-03
2009-02-03 S Enhancement Low Sort profiles case-insensitively on Profiles admin page
2009-01-27 S Version 5.1.79
2009-01-22 S Enhancement search now accepts resultsPerPage, added search setting Max User Results Per Page
2009-01-20 S Fix Low Fixed linebreaks in page body in Match Info for Win32 Webiantor
2009-01-12 S Enhancement Caveat Low Added <Visited> to XML search results; SOAP WSDL may need updating
2009-01-12 F Enhancement Low Caveat Added <Visited> to search results
2009-01-02 F Fix Low Anytotx Fix for some Word documents that generate "The Big Block Depot is damaged" error messages, and are N*512 - 1 bytes in size
2008-12-23 S Enhancement Expanded error information when abandoning a new walk
2008-12-23 S Version 5.1.78
2008-12-23 S Feature Low Added SSL Client Protocols setting
2008-12-19 S Enhancement Added Max Url Display Length search setting
2008-12-16 S Version 5.1.77
2008-12-16 F Low Enhancement Added exe-IIS-prefix to [Texis] Ignore Env Script Name setting, for incorrect Windows IIS/7.0 Script Map
2008-11-25 S Enhancement Added 'URL Decoded' as a source in Data From Field
2008-11-20 S Version 5.1.76
2008-11-17 F Fix Low Fetch Print directory HTML and . .. links on empty FTP dirs
2008-11-07 S Fix Fixed storing Last-Modifed in a user field when it occurs in both HTTP headers and page meta
2008-11-07 S Enhancement Added `infield:enc:' syntax for Parametric Search infield queries with values containing spaces, quotes etc.
2008-10-27 F Fetch Low Fix Accept and send cookies whose Domain value is of the form `.host.domain' where `host.domain' is the Web server
2008-10-24 S Fix Output all primers at greater verbosity settings
2008-10-23 F Enhancement Low Anytotx Try to recognize and minimally parse XML
2008-10-23 F Fetch Low Enhancement Recognize XML files that have no Content-Type by checking for `<?xml ...' in the document
2008-10-21 S Fix Fix for http BaseURLs with http-post PrimerURLs and default BaseURL MMQuery
2008-10-20 F Fix Low Fetch Parse self-closing tags such as `<p/>' correctly
2008-10-17 F Fix Unix install script may have failed with `One or more variables were not set as expected'
2008-10-15 S Fix Low Caveat Allow multiple & in 2nd default word definition expression.
2008-10-15 S Fix Low Caveat Remove leading . from 2nd default word definition expression. Cuts down the amount of junk in the index. Reduces memory usage of database verify step.
2008-10-10 F Enhancement Low Fetch Javascript Added additional support for framed documents in JavaScript
2008-10-09 S Enhancement Added Decode Display URLs search setting
2008-10-09 F Fetch Javascript Enhancement Low Add mouse and keyboard events for all elements (except <title> etc.), not just a few
2008-09-17 F Fix Metamorph Fixed potential core dump (ABEND) when creating or using custom equivs (thesaurus) if entries in that equiv did not have part-of-speech information. Bug introduced in 2006-10-13 version. Workaround is to set a part-of-speech for every root term in the equiv source file before compiling.
2008-09-05 S Fix Make sure database is abandoned when it's not usable and says it will be abandoned. Previously a disk full or similar condition could cause it to make an unindexed/unusable database live.
2008-09-05 S Fix Let singles processing resume when stopped in a mode new walk due to memory and similar limits.
2008-09-04 S Version 5.1.75
2008-09-04 F Fix Low Caveat Metamorph A search term with a leading non-alphanumeric character, and a slash (`/') later, might interpret later commas in the term as equiv (instead of set) separators. Eg. `.x/z,yyy' interpreted as `(.x/z,yyy)' not `.x/z yyy'. Also, multiple unquoted commas inside a term were not interpreted as delimiters like space.
2008-09-02 F Enhancement Low Hit markup/match info now XHTML 1.0 compliant
2008-08-26 S Fix Caveat Don't follow links from "single" pages or "offsite" pages when doing a refresh walk.
2008-08-25 F Fix Low Docs Remove reference to deprecated "dorefresh" function of dowalk.
2008-08-25 F Fix Low Caveat If a database disappears while in use report error and continue rather than exiting app immediately. Change message "Database path no longer exists. Exiting" to "Database path DBPATH no longer exists".
2008-08-25 F Fetch Low Fix Verify that fetched pages are valid UTF-8 even if Storage Charset/text charset is UTF-8 too
2008-08-25 F Fix Low Caveat Metamorph REX NOT (!) subexpression now matches fully to end of buffer if subexpression is not found, instead of stopping a subexpression length before end
2008-08-25 S Fix Low Support non-UTF-8/ISO-8859-1 pages for Url Urls setting
2008-08-22 S Fix Low Prevent vortex.log warnings about "Database path no longer exists. Exiting" after launching a walk that finishes in a second or 2.
2008-08-20 S Feature Low Added Language Characters setting to help with non-ASCII character sets
2008-08-13 S Enhancement Added List Duplicates tool Moved List/Edit URLs to Profile Tools section
2008-08-12 F Low Enhancement Retry certain KDBF writes that fail with temporary errors, such as Windows 1450 ERROR_NO_SYSTEM_RESOURCES, for up to [Texis] Write Timeout seconds
2008-08-11 S Fix Displays information about Best Bets when viewing group with no URLs
2008-08-11 S Fix No longer allows BestBet groups to be created with no result type
2008-08-11 S Fix No longer allows BestBets to be created with no group
2008-08-11 S Enhancement Best Bets can now be added without creating a group first
2008-08-06 F Fix Sql Fixed issue that can cause "Could not read 8,192-byte page at offset 0x... of B-tree ....btr: got 0 bytes in the function btreadpage" error during SQL "select count(*)" or other aggregate operations
2008-07-31 F Enhancement Fetch Low For file:// URLs, more information is returned as headers, eg. Created, File-Mode, etc.
2008-07-29 F Enhancement Low Added XTREE option to <xtree> to set xtree name more clearly (instead of potentially ambiguous last arg)
2008-07-22 S Fix Low Partially work around potential issue where UTF-16 source HTML might get truncated
2008-07-11 S Enhancement Handle walk status logs larger than 2GB better.
2008-07-07 S Fix Fixed list/edit links from duplicate pages in active walks