FAQ: Frequently Asked Questions concerning QF‑Test

In addition to the following general FAQ, technical FAQ can be found in the QF-Test Manual.

General information

    • 01. What is QF-Test?

      QF-Test is a professional tool for the creation, execution and management of automated system and load tests for Java and Web applications with a graphical user interface (GUI). QF-Test has been developed and distributed by Quality First Software GmbH (QFS) since 2001. Detailed information about QF-Test is available on the page QF-Test.
    • 02. What GUI technologies are supported for testing?

      For Java based applications the full toolkit set is covered starting with the traditional Swing (including Applets, Webstart, ULC, CaptainCasa), its successor JavaFX (JavaFX SubScene components as well) and also SWT, the Standard Widget Toolkit from Eclipse, including Plugins and RCP (Rich Client Platform) applications. Furthermore QF-Test provides cross-browser testing of Web GUIs including HTML5, AJAX. QF-Test supports completely frameworks like Angular, React and Vue.js. Also extensions for dedicated UI toolkits are integrated in QF-Test, like Smart (GWT), GXT/ExtGWT, ExtJS, ICEfaces, jQuery UI, jQueryEasyUI, Kendo UI, PrimeFaces, Qooxdoo, RAP, RichFaces, Vaadin and ZK. Further toolkits can be integrated with little effort if required, e.g. SAP UI5, Siebel Open UI and Salesforce. PDF documents can also be tested by QF-Test (Testing PDF documetns Video). The supported browsers are Google Chrome, Firefox, Internet Explorer, Safari and Microsoft Edge as well as headless browser for Chrome and Firefox.

       

      If you don't know exactely which AJAX toolkit you are using, read the following technical FAQ.

    • 03. What are QF-Test's outstanding features?

      Easy to use:

       

      • Quick creation of tests with capture and replay
      • Excellent usability through QF-Test's intuitive GUI
      • Simple composition of complex, high coverage tests without the need to program

      Highly flexible:

      • Automatic adaptation to changes in the application under test
      • Intelligent recording and filtering
      • Full access to recorded sequences
      • Support for trees, tables and other widgets, even with dynamic content

      Powerful:

      • Powerful algorithms for component recognition
      • Advanced programming elements if desired, like loop constructs, 'try/catch', dependencies and logical 'if/else' control structures as well as variables and procedures allowing modularization
      • Text processing with regular expressions
      • Full access to the Java API of the application under test
      • Integrated scripting with Jython, Groovy and JavaScript, command line scripting
      • XML/HTML based test reporting, incl. screenshots

      Well documented:

      • An extensive manual (over 1,000 pages) containing a user's guide with many examples and a reference section
      • Tutorial for a quick start, with many easy to understand test scenarios
      • FAQ for basic questions - right here :)
      • Both English and German language documentation
      • Example test-suites
      • Videos

    • 04. Which platforms is QF-Test available on (system requirements)?

      QF-Test supports Java version 7, 8, 9 as well as 10 and on:

       

      • Windows (Windows 10, Windows 8.1, Windows 8, Windows 7, Server 2016, 2012, 2008 R2)
      • Linux. Swing and JavaFX testing is also being used in other Unix systems (Solaris, AIX, HP-UX...).
      • macOS (except for SWT). 

      Further information - also regarding JDK-/SWT-/Browser-versions - can be found in the installation chapter of the Manual.

    • 05. What releases of QF-Test are currently available and what do they contain?

      For background information about the QF-Test versioning scheme, please see The life cycle of a QF-Test version.

    • 06. How about integration with other tools?

      As QF-Test provides multiple interfaces (batch and daemon mode, scripting, ...) and uses XML as primary data format a flexible combination and communication with other tools is possible (among others Quality Center, load testing tools like Neoload, Scapa TPP):

       

      • Continuous integration and build tools (Ant, bamboo, Maven, CruiseControl, Hudson, Jenkins, TeamCity...)
      • Version management (CVS, SVN, Subversion, ClearCase, Git, Mercurial, ...)
      • Issue and defect tracking (Bugzilla, JIRA, ClearQuest, TestTrack Pro, Mantis, ...)

      Special out-of-the-box integrations are available for the following test management products:

      • ALM - QualityCenter from HP
      • TestBench from Imbus
      • QMetry from QMetry
      • SQS-TEST/Professional from SQS
      • Klaros from verit
      • TestLink, Open Source Solution

    • 07. Who uses QF-Test already?

      More than 1,000 companies from over 50 countries, ranging from small ones to the largest IT service providers worldwide are using more than 7,000 licenses. See here for examples: References.
    • 08. We are testing our website already with Selenium. Do I need QF-Test then?

      With Selenium developers can quickly create web-tests. However, if tests get more complicated or should be easily maintainable, and when also non-developers are part of the testing team, we recommend switching to QF-Test. To control modern browsers, QF-Test uses, like Selenium the WebDriver-standard. It is also possible integrate existing Junit-based Selenium tests via Unit test steps or via the Selenium API in scripts directly in visual test procedures.

       

      QF-Test offers lots of features (e.g. easy and stable component addressing, implicit synchronization, intuitive handling of Javascript-GUI-toolkits). The proven test approach of QF-Test applies also for web applications. 

      The tool price of QF-Test in comparison to Selenium is just a small part of the test project costs. The main factor is manpaower. So the effectivity of implementing and maintaining tests is playing a decisive role. And QF-Test already has maintenance, support, further development, bug fixes etc. included.
      All mentioned aspects also apply for derivates of Selenium as Protractor for Angular.

Why GUI test automation?

    • 09. I run unit tests, why is that not sufficient?

      Though indispensable, unit tests can only test small parts of a system in isolation (steering-wheel OK, motor OK). GUI based testing exercises an application as a whole (steering-wheel and motor taken together don't guarantee roadworthiness). See Benefits for developers.
    • 10. What is the use of test automation?

      Automated software testing reduces time and costs spent on quality assurance. Comprehensive automated tests, executed regularly during software development, will detect bugs at an early stage. The reproducible security thus achieved ensures higher quality and shorter time to market at lower maintenance expense. A tool with reliable component recognition and low maintenance effort is a precondition, however.... and a few other conditions (tester, test design...).
    • 11. What can I tell my boss who doesn't want to spend money?

      Thanks to the low price for licenses and the good usability of QF-Test you can start quickly with efficient testing and have a high return on investment (blog). Just compare the costs for licenses with common costs for developers' or testers' wages and the costs of bugs detected after release - not to mention the damage to your company's reputation. See Benefits for decision-makers.

Evaluation and Licenses

    • 12. Is a trial version available for download?

      Yes. You can download the trial version here.
    • 13. Do I need anything else?

      Normally a license file is required to run QF-Test. It will run without a license, but it will not let you save any files or load any files that were not provided by Quality First Software GmbH. This is sufficient for getting a first impression, working through the tutorial and making a first attempt at running your application under QF-Test. To go beyond that, you'll need a license file.
    • 14. So how do I get a license?

      You can obtain a free trial license valid for 4 weeks by filling in the request form.
    • 15. Which GUI technology/technologies do I need to buy?

      QF-Test licenses can be purchased specifically for the GUI technologies actually needed. In order to determine the GUI technologies for your application, open your test-suite(s) and run all your client(s) via QF-Test. After having executed your tests, please open the 'Clients' menu. There you can see the GUI technologies used in [] brackets. In the example there are two clients running using [Swing] and [Web]; all combinations out of [Swing], [Swt], [FX] and [Web] are possible.
Client: GUI technologies
    • 16. How much does QF-Test cost?

      License types and prices for QF-Test are listed on the page Prices. The QF-Test licenses are "floating" within a network and persistent (except leasing licenses of course).
    • 17. Does QF-Test need an additional license server?

      No, not necessarily. QF-Test handles multi user license management for local networks by itself, provided that IP multicast works. For floating licenses across multiples sites and in case of restricted networks, a license server is available.

       

      Further general information can be found in the product description and technical details in the license server manual.

Support, training and feedback

    • 18. Where do I get help troubleshooting?

      • Before asking for help, please read through this FAQ to see if your question has already been answered. Additional information can be found in the technical FAQ.
      • For beginners the learning-by-doing tutorial proves useful, further questions are answered by the manual.
      • Evaluation webinar for beginners every Monday. Registration via webinar@qfs.de.
      • Videos with different subjects for beginners and advanced users can be found here
      • There is a mailing list for QF-Test questions and discussions that you can subscribe to (Further information can be found here). The mailinglist archive contains lots of helpful postings (full text search possible).
      • During evaluation period of QF-Test we grant free support via email support@remove-this.qfs.de or phone +49 8171 38648-20.
      • For customers we offer support with a guaranteed response time in the form of our Software Maintenance Agreement.

    • 19. What about training for QF-Test?

      QF-Test trainings for beginners and advanced users in German and English language take place regularly here. There is also the option for webinar-based or on-site training & consulting.
    • 20. How can I request an enhancement to QF-Test?

      Enhancement requests should preferably be sent to the mailing list (see 18.), but they are also welcome anytime at support@remove-this.qfs.de.