It's time for you to upgrade to a crawler that works, perhaps Webinator. The one you are currently using, CCBot/1.0 (+http://www.commoncrawl.org/bot.html), is broken. It is sending you to the wrong host when you click on urls. /texis/site/pages/regexp.html exists on one of our other servers, not this one.