Running long duration tests

When tests exceed 24 hours, resource consumption issues can cause problems with the SAP and Citrix clients. The long run mode increases the reliability of long duration tests with the SAP and Citrix protocols by running the tests in multiple processes.

Before you begin

Ensure that the test plays back reliably, with no errors, when run as a single test.

For Citrix tests, a new process is created for each virtual tester.

For SAP tests, a new process is started each time the number of test instances reaches a specific value.

The following guidelines improve the success of long duration tests:
  • Use agent computers with at least 2GB of RAM and 10GB of free disk space, running the same version of the IBM® Rational® Performance Tester or Rational Performance Tester Agent. Disable antivirus software, screen savers, and automatic updaters. Avoid using the agent computers during the test.
  • Keep individual tests short by avoiding loops of more than 10 iterations within each test, and achieve the desired long run duration by looping within the schedule. Do not exceed 20 or 30 virtual testers per agent computer with a think time above several seconds.
  • Use tests with a minimal number of verification points.
For SAP:
  • Do not use the Signature theme. Disable all animations in the SAP GUI.
  • Any mouse click could be interpreted by a hidden SAP GUI window, which could cause the test to fail.
  • Ensure that the Screen Throughput counter remains low (approximately 1 per second per agent).

Procedure

To enable long run mode:

  1. In the Test Navigator, browse to the schedule and double-click it. The schedule opens.
  2. In the schedule, click the schedule element and in the Schedule Element Details area, configure the options
    1. On the Test Log page, disable Show errors and failures.
    2. On the Problem Determination page, set the log level to Severe.
    3. On the Statistics page, set the log level to Schedule Actons or Primary Test Actions, set a sample interval between 15 and 30 minutes, and select only store All Hosts statistics.
    4. On the Performance Requirements page, disable performance requirements.
  3. In the schedule, click the user group for which you want to enable the long run mode.
  4. In the Schedule Element Details area, click the Options tab and click Edit Options.
  5. To enable long run mode:
    1. Click Enable long run mode.
    2. For SAP tests, type a value to specify the Number of test starts per process. Ideally, set this value to 1.5 times the number of virtual testers for the user group.

Feedback