Giving XML more muscle

Virtually every agency's information technology department is a den of pack rats, collecting data by the ton. Still, as pack rats go, they would make Martha Stewart proud of how well they can store and retrieve that data.

But then the Homeland Security Department was created and with it the need to integrate departments, data and a crop of cross-agency e-government initiatives. Storing and retrieving data in-house was manageable, but now agencies have to unlock data from proprietary systems and share it with one another.

This challenge arose as a new data-sharing solution started coming into its own. Extensible Markup Language allows disparate systems to exchange data by tagging it in a common yet highly flexible format. XML has become a powerful workhorse at many agencies, but it also has a downside.

"XML is big, bulky and verbose," said Tom Rhinelander, an analyst at New Rowley Group Inc., a technology market research and analysis firm. XML processing can consume network resources, causing "a slow but steady decline" in network performance, he said.

Coming to the rescue is a cavalry of dedicated XML-accelerator appliances and chips. These solutions — a few are ready for purchase, but most are still in testing — perform one or more essential XML-handling functions, usually data translation and sometimes security.

New challenge

Owen Ambur, chief XML strategist at the Interior Department, said the large volume of XML-based documents presents a "new and growing challenge, which is taking some IT professionals by surprise."

The same data transmitted without XML uses much less bandwidth, but XML provides critical context for the applications that process the data. "Data without context is meaningless, as well as subject to misunderstanding and confusion," Ambur said.

Analysts estimate that XML bloats data by about 40 percent to 50 percent, compared to marking up the same data in HTML, which is used to present data in a Web browser so users can view it.

Ambur said Interior officials are studying solutions to the XML overhead problem, adding that they see the wisdom in the accelerator approach. "It would seem to make far more sense to apply hardware-based processing," he said.

He said graphics processing has migrated to hardware because specialized processors can better complete the task than software on a general-purpose processor. Ambur thinks XML processing may follow a similar route.

Vendors such as DataPower Technology Inc., Forum Systems Inc. and Sarvega Inc., soon to be joined by Conformative Systems Inc., provide turnkey hardware appliances that speed up the transformation of data from a proprietary format to XML and handle message routing. Many appliances, which include the necessary software, can also perform security tasks such as XML-schema validation, encryption and signature, all of which require extensive processing.

Another approach to the problem is to house the XML processing engine on a chip provided on a PCI card. Manufacturers can build the chip into network switches, routers, storage devices, servers or even PCs. DataPower began shipping chips on PCI cards in May, while Conformative and Intel Corp.'s spinoff Tarari Inc. expect to begin shipping such chips later this year.

Appliances on the market range in price from about $30,000 to $70,000. Vendors say the tools can increase XML processing speeds by 10 to 20 times compared to running the applications only on general-purpose servers that also handle other workloads. The actual effect on a given application can only be determined through testing, they say.

Ambur, who is also co-chairman of the CIO Council's XML Working Group, said he does not know of any agencies buying XML accelerators yet. But he said that as agencies make more extensive use of the language, more officials will be forced to consider alternatives to general-purpose servers for XML processing.

Government organizations that need both XML transformation and security functions will likely adopt accelerators first because the combination can add a heavy load to processing overhead. For example, last July, the Massachusetts Department of Revenue released the first phase of its WebFile service, a Web-based application that allows taxpayers to file tax returns and wage reports, make payments, review status and account history, and maintain accounts. The site relies on various Web services standards, including heavy use of XML.

The massive programming effort to build and maintain the application was difficult. "We didn't want to give our programmers the additional burden of configuring and maintaining security, which had to be bulletproof," said Jim Sheehy, security specialist at the department.

To simplify the security function, the agency purchased DataPower XS40 XML Security Gateway, which handles the XML security rules and the translation of XML-based Simple Object Access Protocol messages arriving from the taxpayers' Internet service providers.

Sheehy said the immediate need to contain security administration costs, not performance worries, was the primary

reason for buying the product. However, as more taxpayers use WebFile, performance will become an important issue.

"We expect [that] the XML appliance should help dodge any performance hits," he said.

Different architectures

Because Massachusetts revenue department officials use the appliance as a security gateway, Sheehy has configured it to operate in proxy mode. In this setting, the most typical architecture for the appliances, the accelerator receives all incoming traffic and handles only the XML security tasks. It passes everything else to the general-purpose server.

One of the advantages of using the appliance in proxy mode is that it does not require new software or changes to the Web applications.

For officials who want more control of which processes are handled by the appliance vs. the server, another option is to set the appliance as an application co-processor. In this mode, the application server receives all incoming traffic and selectively sends requests for processing to the appliance.

Before XML appliances appeared, the only way to speed XML processing was to add more general-purpose servers to the mix. Some experts question whether this option will be feasible as XML transactions increase during the next several years.

"Many agencies will hit the wall with XML," said Barry Schaeffer, president of X.Systems Inc., a systems integrator and Sarvega partner that has several federal agency customers. Eventually, XML processing may take up as much as 50 percent of server processing power, he said.

Alternatively, a single XML appliance costs about $30,000, the same as a midrange general-purpose server, and it can take on XML processing from many servers, with little additional administrative overhead, Schaeffer said.

In addition, compared to general-purpose servers, the appliances may be more reliable and easier to administer because they have no moving parts — other than fans — or disks. They do not need backup or replication software, and they contain no application software that would have to be licensed.

Knowing when it makes sense to offload XML processing to an appliance is not an exact science. Wes Swenson, chief executive officer of Forum Systems, said that volume should probably be greater than the 25 transactions per second rate. He warns that at least some of the transactions may be less than obvious. "I think most network managers would be shocked at the volume of XML moving in and out of their networks, in applications, e-mail and messaging," Swenson said.

Still, for those agencies without a pressing need, there are some advantages to putting off buying XML appliances. For one, even though a turnkey appliance reduces the need for trained people to administer it, a learning curve is always associated with unfamiliar products, which could add to the cost.

"In general, it's best to go with what you know," Swenson said. Data centers are familiar with Intel Corp. and Advanced Micro Devices Inc., which makes chips for most general-purpose PC servers. "If you can stick with general processes and possibly add software-based XML acceleration, you might be better off, at least in the near term."

Second, a general-purpose server is more flexible. If you only use half of the capacity of an XML device, the remainder is wasted. If you purchase another general-purpose workstation to handle XML processing, whatever is not needed for that can be used for other jobs.

Finally, although XML is close to maturity, it is not yet there. "XML and Web services are changing rapidly, which includes the applications, the standards, use cases, new vulnerabilities, and, of course, this all affects the operations to be performed on XML," Swenson said.

There's no doubt that XML-accelerator appliances in many cases represent a

cost-effective and relatively easy approach to reducing XML bottlenecks. Even though the technology is still young, an XML appliance would be a good investment for agencies that need the XML horsepower. Agencies with less XML traffic may do well to research the products and postpone buying for six months to a year.

Stevens is a freelance journalist who has written about information technology since 1982.

X
This website uses cookies to enhance user experience and to analyze performance and traffic on our website. We also share information about your use of our site with our social media, advertising and analytics partners. Learn More / Do Not Sell My Personal Information
Accept Cookies
X
Cookie Preferences Cookie List

Do Not Sell My Personal Information

When you visit our website, we store cookies on your browser to collect information. The information collected might relate to you, your preferences or your device, and is mostly used to make the site work as you expect it to and to provide a more personalized web experience. However, you can choose not to allow certain types of cookies, which may impact your experience of the site and the services we are able to offer. Click on the different category headings to find out more and change our default settings according to your preference. You cannot opt-out of our First Party Strictly Necessary Cookies as they are deployed in order to ensure the proper functioning of our website (such as prompting the cookie banner and remembering your settings, to log into your account, to redirect you when you log out, etc.). For more information about the First and Third Party Cookies used please follow this link.

Allow All Cookies

Manage Consent Preferences

Strictly Necessary Cookies - Always Active

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Sale of Personal Data, Targeting & Social Media Cookies

Under the California Consumer Privacy Act, you have the right to opt-out of the sale of your personal information to third parties. These cookies collect information for analytics and to personalize your experience with targeted ads. You may exercise your right to opt out of the sale of personal information by using this toggle switch. If you opt out we will not be able to offer you personalised ads and will not hand over your personal information to any third parties. Additionally, you may contact our legal department for further clarification about your rights as a California consumer by using this Exercise My Rights link

If you have enabled privacy controls on your browser (such as a plugin), we have to take that as a valid request to opt-out. Therefore we would not be able to track your activity through the web. This may affect our ability to personalize ads according to your preferences.

Targeting cookies may be set through our site by our advertising partners. They may be used by those companies to build a profile of your interests and show you relevant adverts on other sites. They do not store directly personal information, but are based on uniquely identifying your browser and internet device. If you do not allow these cookies, you will experience less targeted advertising.

Social media cookies are set by a range of social media services that we have added to the site to enable you to share our content with your friends and networks. They are capable of tracking your browser across other sites and building up a profile of your interests. This may impact the content and messages you see on other websites you visit. If you do not allow these cookies you may not be able to use or see these sharing tools.

If you want to opt out of all of our lead reports and lists, please submit a privacy request at our Do Not Sell page.

Save Settings
Cookie Preferences Cookie List

Cookie List

A cookie is a small piece of data (text file) that a website – when visited by a user – asks your browser to store on your device in order to remember information about you, such as your language preference or login information. Those cookies are set by us and called first-party cookies. We also use third-party cookies – which are cookies from a domain different than the domain of the website you are visiting – for our advertising and marketing efforts. More specifically, we use cookies and other tracking technologies for the following purposes:

Strictly Necessary Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Functional Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Performance Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Sale of Personal Data

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.

Social Media Cookies

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.

Targeting Cookies

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.