Navigation Toggle

How Ariba built an enterprise-wide Knowledge Management system based on Texis

October 24, 2007
How Ariba built an enterprise-wide Knowledge Management system based on Texis

A major challenge in today's organization is being able to have a search that is flexible enough to search across all the repositories in the appropriate manner to build an enterprise-wide knowledge management system. In this article we look at how Ariba, Inc. created an enterprise-wide knowledge management system using Thunderstone's Texis as a search solution.

Ariba offers the world's leading Spend Management software and services to a wide range of customers that include people from all industries. It provides a set of both CD-based and on-demand software, along with services related to sourcing products and commodities, negotiating contracts, buying against negotiated contracts and other key components of a complete, end-to-end Spend Management solution. Ariba helps organizations analyze, understand and manage their spending in order to rapidly achieve sustainable cost savings and to improve business process efficiency.

Why knowledge management?

Derek Matthews, Ariba's Lead Knowledge Architect, was initially focused on their Professional Services organization and their implementation methodology. He wanted to be able to drive consistent best practices into every implementation engagement. During every engagement they would learn things and want to capture the assets and templates that were the best practices for each phase of a project engagement with the customer.

According to Matthews, “A key piece of knowledge management is searching. Process-wise, the first thing you do when you've got an issue in front of you is that you search our knowledge base to discover if your issue has already been addressed. Is there already a best practice out there that addresses what you're trying to do, or is there a content item out there that is immediately leverageable for what you're wanting to do? If none of those are the case, then we do what we call research. Research means having to dig really deep into content items and collaboration, discussion forums and all this sort of thing. And eventually maybe you'll find your solution on page 75, paragraph 4 of some technical document in combination with some other user guide and whatever else. Then the idea is to build a solution, put that into our knowledge base and enable other users around the globe to find it when searching. Researching is more costly than searching. So, we want to push everything forward to that less-costly searching process.”

Native Power and Flexibility of Thunderstone's TEXIS,

Ariba initially licensed Thunderstone Texis due to the availability of integration code from their content management system vendor who supported Texis because of the attribute storage and search available in Texis. The integration code turned out to be inefficient and was sluggish for Ariba's end users when pushed beyond its design. Because Thunderstone provides the ability to completely customize everything from the Texis databases to Vortex scripts, Ariba's software engineers developed their own integration with the content management system. The result was greatly improved efficiency with several customized interfaces that enabled users of the company's various portals to search for content items containing full text and file attachments plus all the associated metadata needed for efficient filtering, security and results sorting. Over time, Ariba built their current knowledge base. With every engagement it became smoother and smoother and smoother, and they are able to have everyone, globally, following the same process. And then from Professional Services implementation methodology it started growing into Sales and Marketing material, and then into Customer Support -- the entire CRM environment, engineering, HR, and eventually every department in Ariba got on-board with their Knowledge Management platform, and now they're all big users of it (Ariba has around 2,000 employees in North America, Europe, Asia/Pacific, Latin America and the Middle East).

As Matthews explains, “We started rolling out enhancement wave after enhancement wave and have continued that to this day. One of the latest enhancements that we've rolled out has been federated searching capabilities, what Thunderstone calls the meta-searching. We actually have portlets that we use on various portals across our extranet that allow people to pull together incongruent content based on metasearches that they want to perform. It is possible now, within the last year, for an Ariba employee to do a search and be able to pull a service request from our CRM system, a defect from our engineering quality system, a marketing presentation from our content management system, as well as searching any number of other internal web sites that have been indexed. You can search over all of the sources through one integrated portlet that we built on top of Thunderstone Texis.

“Texis allows Ariba to index widely varying content into a platform that can be securely accessed by users from various portals for our customers, partners, suppliers, prospects and employees. We are able to use the search engine to present dynamic, context-sensitive views of content for users to browse with the ability to refine through full-text searching.”

Customized Search Engine for Knowledge Management

Thunderstone has always believed in providing tools to users, letting them add the intelligence and knowledge they have in their field to the core tools Thunderstone provides, enabling the creation of powerful applications that can give a competitive advantage. By providing a SQL based database that is optimized for full-text searching in combination with traditional database attributes Thunderstone enables customers to use their existing expertise in database application creation and efficiently extend it into the world of search. Another benefit Thunderstone provides is the Texis Web Script language, known as Vortex. This is designed to allow developers to quickly create applications using the Texis database by providing a simple but powerful syntax and library. Customers can take Thunderstone's applications and modify them to suit their needs easily, while at the same time allowing Thunderstone to create new applications for customers, usually in a matter of days.

Matthews continued, “From a knowledge management perspective we were excited to get involved with Thunderstone, because what they brought to us was a completely customizable interface. A lot of companies, when you talk about knowledge management, tend to believe there's one out-of-the-box solution you can install that's going to solve all your problems with no customization. But, that's not reality. What Thunderstone allowed us to do was to completely look at any and every requirement that we have. With Thunderstone Texis we get a platform that we can customize down to the most technical level.

“With many search engine solutions on the market you basically install their software, point it at a URL and say 'go index that data.' And that's fine. For some situations that's no problem. But in our case we need to be able to customize, even down to the database level. We need to be able to modify how this Texis database works. We need to make modifications to the Vortex scripts that go out and search for content so that they can make certain metadata changes based on certain conditions that might be present. Those Vortex scripts need to be able to combine text from within attached files together with the metadata describing that document in addition to the full text that might be within those files. For example, there will be categorization that's tied to those files. There will be filtering tags that are applied, as well as security tags that get applied.

“The last piece is critical. We need to be able to fully customize the interface to our search engine in a secure manner. If you're a customer accessing our search engine, we want to be able to allow you to search all of the content that we provide to every customer as well as the content that's provided to you specifically as a customer. Maybe it's a benchmark report that we want you to be able to see. But, at the same time, we don't want to allow you to search against a benchmark report for another customer. Security is very important. We're allowing you to search the content that you, depending on whatever attributes you have as a company, are able to see. If you bought a certain product, we may want you to be able to search content for that product, but we don't want you to get bogged down searching content for another product that you don't even own. It's useful both from a filtering for ease of use perspective as well as a security perspective -- both equally important aspects.

“Thunderstone's ability to customize based on those very, very specific requirements that we had made it a great choice, because at each level we are able to make it do exactly what we want it to do. With Thunderstone Texis you have the option of using it right out of the box, one size fits all, just install it and run. However, and this is what I think so many people don't realize out in the industry, Texis also enables a level of customization that lets you go down to the 'nth degree' depending on whatever your requirements are.”

“I am amazed at the whole design of the engine itself. It really is powerful. Thunderstone doesn't get enough credit, and I've never quite understood why. When it comes to customizing the database, customizing the indexing and how that works, and customizing the user interface -- those three things -- I have not seen any of Thunderstone's competitors demonstrate the ability to hit all three of those the way Thunderstone does and with the depth that Thunderstone does,” said Matthews.

Starting with a flexible and easily customized search solution from Thunderstone Software in one area of the business, Ariba has been able to deploy an enterprise-wide search based knowledge management system by extending it application by application, incorporating the specific knowledge from each part of the organization, all using the same core skill sets.

Change In Daylight Saving Rules

September 28, 2007

Are Thunderstone Software's products affected?

Texis and Webinator do not require any patches to accommodate the upcoming changes to daylight saving rules as they store dates in UTC, and use the configured timezone to output and import dates. Daylight saving tracking is a feature provided by the operating system and Texis will respect the OS configuration. However, your OS may need patching if it's not already properly configured to handle the new rules.

 

Thunderstone will be issuing patches for the Search Appliance on March 1 (possibly earlier). Use your appliance's "Maintenance->Check for updates" feature if you haven't configured it for automatic updates. Select the package called "timezone-1.0.0".

Are the dates in my database correct?

If you have used, or are using Texis on an unpatched OS, and you import or convert string dates whose string values lie between the old and new DST changeover dates (e.g. Sun Mar 11 02:00:00 2007 and Sun Apr 01 02:00:00 2007 local time for the US), for any year after 2006, then the imported value will be based on the prior rules, and will be output differently after the patch because the OS parsed it wrong. You will need to re-import/convert those dates after patching your OS.

For example the string "2007-03-20 16:30:00" (4:30pm on March 20, 2007) imported to a date field on an unpatched operating system configured for a US timezone will print as "2007-03-20 17:30:00" (5:30pm on March 20, 2007) after patching.

Updating your operating system

Unix and Linux

Your best bet would be to check with your OS distribution vendor for timezone or tzdata updates. Here are links to a few popular ones.
For Solaris see Sun Alert ID 102775.
For RedHat see knowledge base article 7909.
For SUSE see document 3853518.
For doit-your-selfers check out tzdata.tar.gz at ftp://elsie.nci.nih.gov/pub/ for new timezone data. Be sure to link or copy your timezone file to /etc/localtime or whatever's appropriate for your system.

Microsoft Windows

Visit windowsupdate.com to download Update KB928388 in the Optional category. Note that this fix is NOT included in automatic updates. For full details from Microsoft visit http://www.microsoft.com/windows/timezone/dst2007.mspx.

Testing compliance for Texis and Webinator

Note: The following tests assume a US timezone that used and will use the conventional DST rules. Some localities and other countries follow different rules.
The lines here may wrap to fit the page. Enter each command on one long line.

Open a shell or msdos window and cd to the Texis install directory. Then run (for Windows use "texis"1 instead of "bin/texis" in the examples below)

bin/texis -h -d texis/testdb -s "select convert('2007-03-11 03:01:00','date')-convert('2007-03-11 01:59:00','date')"

This test compares one minute before and after the new transition time.
Unpatched you should get "3720". Patched you should get "120".

Then run

bin/texis -h -d texis/testdb -s "select convert('2007-04-01 03:01:00','date')-convert('2007-04-01 01:59:00','date')"

This test compares one minute before and after the old transition time.
Unpatched you should get "120". Patched you should get "3720".

 


1Particularly old installations of Texis may not havetexis.exe in the installation directory but only in the webserver's CGI directory. In that case use the full path to texis.exe to run it.

Confirming updates on the Search Appliance

After installing the timezone-1.0.0 package via "Check For Updates" confirm the installation by going to "Maintenance->Manage Logs" and clicking on "messages". You should see something similar to the following, but with your machine name and timezone (note that the lines are in reverse chronological order).

Feb 27 14:12:58 host logger: timezone finished
Feb 27 14:12:58 host logger: patch ok
Feb 27 14:12:57 host logger: Your timezone is America/New_York
Feb 27 14:12:57 host logger: Installing updated timezone info
Feb 27 14:12:57 host logger: timezone-1.0.0-1
Feb 27 14:12:57 host logger: Preparing packages for installation...

If necessary you can adjust your timezone setting via "Maintenance->Webmin Interface->Change Time Zone".

Further questions

Please contact Thunderstone Support if you have questions.

Customer Spotlight: QVC Customers Find What They Need With Texis

June 13, 2003
Customer Spotlight: QVC Customers Find What They Need With Texis

Most Americans know QVC by its shopping channel on television. QVC's web site, however, also is one of the most successful online retailers, bringing in a substantial portion of QVC's $4.4 billion of sales yearly.

Thunderstone's Texis software plays an important role at QVC in a variety of ways.

Unlike television sales, where each item is on sale for only a few minutes at a time, QVC's entire inventory is available all the time on its web site. The online database thus has hundreds of thousands of products, and requires a robust search engine to help users find the items that satisfy them.

QVC needed its search engine to do more than simply search, however. The company had many advanced requirements.

For example, its customers are price sensitive, so QVC wanted to enable them to select by price as well as by description. A user can enter "gold necklace" and "$100", and QVC's Texis system automatically finds products within +/- 25% of the user-entered price. QVC found Texis the best product for combining a numeric range query with a text search.

Texis's real-time functionality also is crucial to QVC.

We update our inventory in realtime to make sure sold-out products are not offered to the customer. This is especially important In high volume periods like 'Fashion Day' where certain colors and sizes sell out quickly and frequently. This is a key function Texis provides that no other search engine we've seen can do.
Frendy Glasser, QVC Director of Data Administration

 

In addition to serving search results, Texis powers the "drill-down" or catalog browsing features, which are based on product metadata. And when a user views the detailed description associated with an individual item, Texis serves up that content too.

Many other Texis features are in use. Products are ranked according to QVC's proprietary criteria. And results are retrieved from "partner" databases for products such as books, music, and sporting goods.

The Texis applications are used as well by QVC's order-entry representatives when customers call asking for a product. All in all, the Texis installation at QVC is handling millions of database queries daily. QVC runs Texis on IBM AIX hardware, with the "front end" user interface written in ASP running on Microsoft NT servers.

What's also important to us, besides the performance and advanced features, is the flexibility to change how we respond to queries as the business situation evolves. We like knowing that Texis can be programmed to respond to searches according to almost any logic we come up with. Before Texis, we had another search package that was a major product in the industry, but we were frustrated by programmability limitations, and by its proprietary interface. Texis, in additional to being a great search product, is easily customizable due to its industry-standard database features.
We also value Texis's consistency in response time regardless of volume, its scalability, and its availability. We rarely, and I mean rarely, have any downtime problems with the Thunderstone Texis engine.
Frendy Glasser, QVC Director of Data Administration

Thunderstone Attacks 'invisible Web' With First Javascript Link Crawler

July 30, 2002

Cleveland, Ohio, July 30, 2002 -- The industry's first search product to index JavaScript hyperlinks and JavaScript dynamic content was announced by Thunderstone Software. The new capability is bundled with Thunderstone's Texis search software, and is available immediately.

The need to index JavaScript links has become a serious challenge on the Internet. More and more web designers use JavaScript not only to add interactivity to web pages, but for basic site navigation as well. As JavaScript usage has become more mainstream, sites have grown increasingly dependent on JavaScript-enabled browsers. But since search engines cannot "see" JavaScript links, search-engine users are missing valuable content -- often without knowing it.

Neither the major web-search sites, nor specialized search products, currently collect JavaScript links for indexing. "JavaScript links are part of the 'invisible web' that most search engines miss," said John Turnbull, Thunderstone's general manager. "Making that information searchable may be especially important on corporate networks or portals."

Many organizations need to run large intra-net search engines, aggregating content from a variety of internal sources. "They may run an internal crawler and not even know they're missing all those pages linked by JavaScript." Turnbull said. "We've seen that occur, for example, at companies using Lotus's QuickPlace product, which creates collaboration sites navigable mainly by JavaScript links."

Thunderstone's support of JavaScript link indexing reinforces Texis as the most comprehensive and versatile search software on the market. Texis also provides a broad range of other data discovery and indexing techniques. That includes indexing 'deep' information such as database content and newswire feeds, or even results from other search engines, all of which may be continually changing.

Thunderstone is offering a free trial of the JavaScript link crawler through Oct. 30. The feature is included with Thunderstone's Webinator web-site indexing product. Anyone who administers a web site may download a full working copy via the link on Thunderstone's home page, at http://www.thunderstone.com/ .

ABOUT THUNDERSTONE
Thunderstone Software LLC is the premier provider of text-search technology integrated with SQL relational database functionality. Applications include publishing, catalogs, classified advertising, auctions, content management, and web-searching. Thunderstone is a 20-year-old company whose products are used on thousands of web sites worldwide. Major customers include eBay, QVC, About.com, ZDNet, HotJobs, and many others. For more information, visit http://www.thunderstone.com or call +1 216-820-2200.

Askme Corp. Acquires Thunderstone License

May 30, 2002

Cleveland, Ohio, May 30, 2002 -- Thunderstone Software announced that AskMe Corp. has acquired a perpetual license to integrate Thunderstone's Texis search software within AskMe's Employee Knowledge Network software solutions.

AskMe creates software that enables corporations to create and manage employee knowledge networks to deliver employee expertise, directly to other employees blocked on critical tasks, exactly when they need it. The Texis search engine within the AskMe Enterprise product helps users to find the expertise they need via sophisticated database searching.

Thunderstone's Texis software also powers the public AskMe expertise search engine. The original AskMe web site is one of the world's most popular expert advice websites for thousands of topics.

"Texis plays a crucial role within our products," said Digvijay Chauhan, Chief Technology Officer and co-founder of Askme. "The Texis relational structure is unique among search engines, and is key to effective integration with the AskMe SQL applications. We also take advantage of various Texis advanced search features such as fuzzy matching and natural language querying." Texis will be bundled with all AskMe Enterprise systems, said Chauhan.

"The AskMe enterprise solutions highlight Thunderstone's core competency," said John Turnbull, Thunderstone general manager. "Texis is designed with integration in mind. It is the only search engine to incorporate the full SQL data model. That makes it ideally suited to searching data within complex applications, especially those built on top of relational databases, or incorporating real-time updates."

ABOUT THUNDERSTONE
Thunderstone Software LLC is the premier provider of text-search technology integrated with relational database functionality. Applications of Thunderstone's system include publishing, catalogs, classified advertising, auctions, content management, and web-searching. Thunderstone is a 20-year-old company whose products are used on thousands of web sites worldwide. Web sites using the Thunderstone Texis software include eBay.com, About.com, and Corbis.com. For more information, visit http://www.thunderstone.com or call +1 216-820-2200.

ABOUT ASKME CORP.
AskMe builds software solutions that enable global 2000 companies to create and manage Employee Knowledge Networks. Employee Knowledge Networks are software systems that deliver employee expertise, directly to other employees blocked on critical tasks, exactly when they need it most. AskMe's solutions enable employees with business-critical problems to discover the best expertise within the organization, facilitate the exchange of that expertise, capture the outcome for re-use, dispatch the best practices to employees who need to know, and provide the tools to analyze the results to make the entire company more effective. Such blue-chip companies including Procter & Gamble, 3Com, and CNA have implemented the company's flagship product, AskMe Enterprise. Founded in 1999 by former Microsoft executives, AskMe is privately held with headquarters in Bellevue, Washington. (www.askmecorp.com)

Recent