| Requirements |
Weight |
QF-Test (QFS)
Regression and load tests for Java and Web GUIs |
Your rating of QF-Test |
Other tool 1 |
Other tool 2 |
Other tool 3 |
| Features |
| Supported platforms |
|
Java Swing, AWT, SWT, Eclipse, RCP, Applets, Java Web Start,
ULC, CaptainCasa.
Web: Internet Explorer and Firefox (HTML, AJAX, GWT, ExtGWT,
ExtJS, RAP, Qooxdoo, RichFaces).
|
|
|
|
|
| Supported OS |
|
Swing: Windows, Unix, Linux, Mac OS X.
SWT: Windows, Linux-GTK; Solaris-GTK on request.
Web: Windows, Linux
|
|
|
|
|
| Testing principle |
|
Capture/replay for quick test creation. Extensive possibilities for sequence
control, modularization and advanced scripting.
|
|
|
|
|
| Test structuring |
|
Clear and concise due to graphical depiction of the test sequence as tree
structure. The layered test-suite architecture enables modularization in large
tests.
|
|
|
|
|
| Robustness of tests |
|
Tests tolerant adverse to GUI modifications. |
|
|
|
|
| Component recognition |
|
Masters complex elements like dynamic trees and tables. Sophisticated
recognition mechanism leads to extraordinary maintainability, via naming up to
100%.
|
|
|
|
|
| Data-driven testing |
|
Data drivers allow for flexible integration of internal or external data,
e.g. from CSV and Excel files, also direct database access. Other data sources can
be integrated via script extension.
|
|
|
|
|
| Error analysis |
|
Detailed run-log. Excellent debugger functionality (breakpoints and analysis
of variables possible).
|
|
|
|
|
| Test case preparation |
|
Dependency management for test preparation enables independently executable
test cases, including automatic error handling.
|
|
|
|
|
| Basic procedures |
|
Automatic creation for basic component access procedures, which is highly
effective especially for form-based applications.
|
|
|
|
|
| Reporting |
|
Configurable test documentation und reports can be created at the push of a
button or via command line execution.
|
|
|
|
|
| Expandability / scripting |
|
Embedded Jython and Groovy are standardized scripting languages including
comprehensive libraries. They also allow direct access to the Java API.
|
|
|
|
|
| Test management |
|
Pragmatic small scale solution included. Easy integration with third party
solutions.
|
|
|
|
|
| Continuous integration |
|
Flexible integration with build tools like Hudson/Jenkins.
|
|
|
|
|
| Maturity |
|
High degree of maturity, available at the market since 2001. More than 500
customers worldwide.
|
|
|
|
|
| Usability |
| Accessibility |
|
Demo version download is free and anonymous. Evaluation license is acquired
quickly, cost-free and extensible. Upgrade to commercial version simply by
receiving a license file.
|
|
|
|
|
| Installation |
|
Very fast, without problems, download of about 85 MB, available for Windows and
Unix systems. No license registration required for demo version.
|
|
|
|
|
| Duration of orientation |
|
Good and clearly structured self-starter tutorial, first tests can be run
after about one hour.
|
|
|
|
|
| Previous knowledge required |
|
Programming skills are not necessary for standard usage, but helpful for
advanced script implementation.
|
|
|
|
|
| User-friendly |
|
Easy to use, highly intuitive. Clearly structured tree view for comfortable
test-case handling, supporting e.g. Copy/Paste and Drag&Drop. Capture/Replay for
quick start.
|
|
|
|
|
| Documentation |
|
Extensive manual and tutorial, online help via right-click.
|
|
|
|
|
| Test execution |
| Test preparation |
|
Simple due to automated instrumentation for the JDK and SWT-jar. Quickstart
wizard for easy application integration.
|
|
|
|
|
| Test scripts |
|
Concise and comprehensible. Effortlessly extendable, can be modified even
during debugging.
|
|
|
|
|
| Verification points |
|
Direct recording of standard checks. Customized checks possible via scripting.
|
|
|
|
|
| Image testing / comparison |
|
Multiple algorithms also for fuzzy comparison. Convenient diff-view for
validation on deviations. |
|
|
|
|
| Object mapping |
|
Component information is saved in a specific area of the test-suite during
recording and can be edited anytime. Mechanism for automatic updates available.
|
|
|
|
|
| Tests in batch mode |
|
Yes. Extensive options for configuration via command line parameter. Can be
integrated into build environments without problems. Option to start additional
steps after a test run through a return value.
|
|
|
|
|
| Remote execution |
|
Test can be executed also on a remote machine which might run
in a special daemon mode.
|
|
|
|
|
| Error handling |
|
Automatic error handling, which grants continued execution of the whole test.
|
|
|
|
|
| Run-logs and reports |
|
Detailed run-logs contain all information for an effective error analysis
(incl. screen shots of application once an error occurs). Summary reports in HTML
und XML.
|
|
|
|
|
| Test modification |
|
Tests can be edited fully and modified at arbitrary position. Test debugger
offers valuable assistance.
|
|
|
|
|
| Maintenance effort / reusability |
|
Low effort and high degree of reusability due to stable component recognition
and modular build.
|
|
|
|
|
| Teamwork |
|
Modular structure of tests and an import mechanism for the component
information enable smooth team work.
|
|
|
|
|
| Formats and version management |
|
Both test-suites and run-logs are XML files and thus well-suited for version
management.
|
|
|
|
|
| Licenses and prices |
| Product variants |
|
QF-Test is available in different product variants (all combinations
of Swing, SWT and Web). Just those GUI technologies can be chosen that are
actually required.
|
|
|
|
|
| License types and models |
|
All QF-Test licenses are floating.
Developer and runtime licenses available.
Purchase, leasing and upgrading possible.
|
|
|
|
|
| License price |
|
Single developer license starts at 1995 EUR, runtime license from 995 EUR. The
price per license declines with higher numbers.
|
|
|
|
|
| License server |
|
Not necessary. License management can be handled locally without additional
effort.
|
|
|
|
|
| Support and service |
| During evaluation |
|
Free, via phone / e-mail, active contact and support offered.
|
|
|
|
|
| Community / discussion forum |
|
Mailing-List available. Short response times, also from QF-Test
developers. Large list archive.
|
|
|
|
|
| Commercial support |
|
Annually extendable maintenance contract (support and updates). Very short
response times. Individual support onsite or via webinar.
|
|
|
|
|
| Consulting / training |
|
Available, both at customers site and regular training sessions at QFS and via
webinar.
|
|
|
|
|
| Total result |
| |
|
|
|
|
|
|
