Review: SmartBear Software's TestComplete 8 Enterprise

Rating: 4 out of 5 stars
Website: http://www.automatedqa.com/products/testcomplete
Price: $1,999

I have been a proponent of AutomatedQA's TestComplete product for years. DevProConnections readers may recall that the earlier edition of TestComplete won an honorable mention in the 2009 Readers' Choice Award. With the passage of time, the product has continued to improve with features and capabilities that keep it current for testing the latest generation of Microsoft technologies.

Now a member of the SmartBear Software family, AutomatedQA's TestComplete 8 has expanded beyond Win32 and .NET to support a bevy of Windows-hosted programming technologies. Considering the companies that are now stewards of the related technologies, SmartBear's stewardship of TestComplete is simply a sign of the times.

Key Differentiation
Several features make TestComplete 8 stand out among the crowded arena of both free and commercial test suites. Perhaps the most notable is its adoption of Keyword Testing. Instead of requiring you to learn an arcane scripting language that is sometimes more complex than the language of the original application being tested, TestComplete helps testers and developers assemble tests in a series of checkpoints that are graphically displayed in a step-by-step logical hierarchal tree. Scripts can be visually recorded to aid with UI as well as business logic testing. Keywords can introspectively examine the states of the application's various properties, methods, and events via "white-box testing".

This deeper analysis is available to both 32-bit and 64-bit versions of Windows running .NET, WPF, ActiveX, Visual C++, Java, web pages (via Internet Explorer 8 and Firefox 3.6), Nokia Qt, Embarcadero's Delphi and C++ Builder, and Microsoft Office applications that use the IAccessible interface. Adobe Flex applications are limited to just the public properties. And for those who prefer scripts over visual keyword interfaces, keyword tests can be exported to scripts for such needs as incorporation into continuous testing frameworks.

Another attractive aspect of TestComplete is the full catalog of test types it offers, including the expected functional, unit, and regression tests as well as data-drive, keyword-driven, and white-box tests. Additionally, scalability, load, and stress tests can be combined with distributed tests to measure the performance of an application designed for high-volume performance. Coverage tests can be constructed with SmartBear's AQtime profiling tool for extensive code analysis. Finally, manual tests can be constructed for those scenarios that can't be automated. The manual test instructions can be imported from Microsoft Word and Excel documents, databases, and text files and can be exported to Word and HTML format for internal team or client review.

More Features
In addition to TestComplete's ability to record and play back test scenarios (which, by the way, focus solely on the task at hand and will not be interrupted by other system-processing events such as email alerts, IM pop-ups, and other distractions that could halt execution of other less-intelligent testing utilities), it also integrates with source-control systems such as CVS and Microsoft Visual SourceSafe, allowing tests to accompany source code and be versioned accordingly. And for teams that have standardized on Microsoft Visual Studio Team System, TestComplete can hook directly into the team build process with its results published to Microsoft Team Foundation. This avoids having to jump through hoops and trying to shoehorn the system into playing nice with an established team development environment. It just works.

Most Notable
Some of my favorite aspects of the TestComplete 8 release are its ability to easily edit and reorder the keyword tests. If I prefer, I don't have to plow through reams of lines of code to make a simple parameter or value change. And if I do need to dive into the test scripts for a granular degree of customization, I can do so in the five scripting syntaxes supported by the product (VBScript, Jscript, and DelphiScript rank high on my list). The script editor is a full-featured IDE, complete with code snippets, templates, breakpoints, and reusable function libraries along with parameter tool tips and context-sensitive help with plenty of copy-and-paste code samples.