QMetry

Introduction

The current integration between QF-Test and QMetry relies on planning the tests and its steps within QMetry and forwarding the actual test execution to QF-Test. Once the the test run terminates the QF-Test run log and its HTML report will be automatically uploaded to QMetry to the respective result area as well as the state of the test case in QMetry will be set to the according result.

You need to prepare your test system in order to run QF-Test tests. Please perform the following steps:

  • In the 'Admin' area of the QMetry Testmanagement view install a test execution agent at the 'Agent' view.
  • Download the required agent and configuration files to install the QMetry execution agent on your test system.
  • Install the respective QF-Test QMetry Launcher at your test-agent.
  • Install and set-up a platform at the 'Platform' view, which is also located in the 'Admin' area of QMetry.
  • Configure QMetryAgent.properties correctly to use the required environment variables of QMetry's QF-Test wrapper.
  • Configure QMetryConfig.properties correctly to show to the right QF-Test executable.
  • Configure additional parameters for the QF-Test call in QMetryConfig.properties, see next section for details.
  • Launch the QMetry agent. Please do not launch the agent as Windows-Service to avoid running GUI-Tests within the service-session. If you launch the agent as service you should run the QF-Test tests via the QF-Test daemon, which shouldn't run in a service session then.

After setting up the agent and launcher, you need to plan the test execution. QMetry supports several ways of integrating QF-Test test cases. You can find all supported integrations in QMetry's integration guide document. Please perform following steps for a simple integration:

  • In the Testmanagement view change to 'Test Cases' and plan the test cases there.
  • At the individual test case you have to set the value 'Test Script Name' to the path of the required QF-Test test suite holding the actual implementation of the test case.
  • The name of the test case must be exactly the same as the specified value for the 'QF-Test ID' attribute in QF-Test.
  • Add the test case to an executable test suite in the 'Test Suites' view.

Now you are ready to run the test cases:

  • Open the 'Test Suites' view and select the required test suite for execution.
  • Select the 'Execute TestSuite' tab.
  • Run or schedule a test run via assigning an agent to the 'Automation' column.
  • The next time when the local QMetry agent is polling the QMetry server it will get the necessary information to run the test case.
  • Once the test run terminates you will find the run log of QF-Test and its HTML report attached to the 'Execution History' of the executed test suite. The state of the test case will also be updated accordingly.

The following figure shows the 'Execution History' tab in 'Test Suites' holding the run log:

QMetryLog
Figure 26.14:  QF-Test run log in QMetry

You will find a more detailed description of how to setup QMetry in the manual of QMetry and in QMetry's integration guide document.

Sample Configuration

It's recommended to set following values in the configuration file QMetryConfig.properties:

  • Set the value of generic.adapter.success.code to 0,1.
  • Set qftest.additional.arguments to -test ${QMTestCaseName} in case of local test execution.
  • In case of using QF-Test's daemon set qftest.additional.arguments to -test ${QMTestCaseName} -calldaemon -daemonhost <testsystem> -daemonport <daemonport> .

As already mentioned in the previous section, you need to use the same name for the test case within QMetry and for the value of the 'QF-Test ID' attribute within QF-Test.

Further ways for integrating QMetry and QF-Test can be found in the integration guide document provided by QMetry.