MyLoadTest On-Demand offers three services to best suit your business objectives. The feature comparison at the bottom of this page shows a detailed breakdown of the differences between the three options.
Validate
- Standard load tests
- Basic optimization recommendations
- Test summary report
Optimize
- Advanced load tests
- Unlimited re-tests while tuning
- Access to self-service Portal
Ongoing
- Continuous Integration API
- Ongoing script maintenance
- Access to self-service Portal
Load & Performance Validation
A one-off set of tests to measure your website’s performance and stability under load.
Load and Performance Validation helps to answer questions like “what is the breaking point of the website?” or “what response times can we expect under peak load conditions?” It could be an input to a go/no-go decision for a new system, or could provide confidence that the business is ready for the next high-traffic event.
A Workload Model is created, representing transaction volumes under normal and peak conditions, load is generated against the system, and response times and error rates are measured. A report is provided for stakeholders.
This service includes a single test cycle, and does not allow scope for in-depth analysis of problems found, or retesting of defect fixes. Choose this option if you do not expect to find load-related problems, but still want a performance baseline.
This is the simplest, lowest cost option. It is a good way to increase confidence in a system prior to a high-traffic event such as a flash sale, or as an acceptance test for a new system.
Load & Performance Optimization
A short-duration exercise to find problems, tune the system, and confirm defects have been fixed successfully.
Load and Performance Optimisation helps a web team improve stability and performance under load. Rather than just running a single set of load test to measure system performance, multiple test runs help to find the root-cause of problems. An iterative tuning exercise enables comparison of different system configurations, and tests may be re-run to confirm that defects have been fixed correctly.
This service includes the same load testing activities as Performance Validation, with the addition of expert assistance in pinpointing the root cause of load and performance-related problems. Customers may log into the self-service portal and run load tests as many times as needed while tuning their system configuration. This option is recommended for all new systems, systems undergoing major changes, and systems with existing performance problems.
Ongoing Load & Performance Testing
A long-term service to safeguard the performance of a system over its development and operational lifespan.
Ongoing Load and Performance testing helps to safeguard the performance and stability of business-critical web applications over their lifespan. Load tests can be run automatically every day, or whenever a change is deployed. Any change can alter the performance and scalability characteristics of the system, so frequent load tests highlight problems as soon as they are introduced.
This service provides the option to invoke load tests from your Continuous Integration build server, and includes updates to load testing scripts as the front-end of the application changes. Trending of metrics between tests highlight any degradation of the system over time. Your load testing scripts are updated as your application changes, so all you have to worry about is your results, not maintaining test scripts.
This option best suits business-critical applications and large projects, where it makes sense to find problems early and to monitor the behaviour of the system as it evolves.
Feature Comparison
Validate | Optimize | Ongoing | |
---|---|---|---|
Performance Test Plan | |||
Workload modelling | |||
Load testing script development | |||
Ongoing script maintenance | |||
Load tests (standard) | |||
— Front-end analysis | |||
— Baseline test | |||
— Mobile user performance test | |||
— Stress/Break test | |||
Load tests (advanced) | |||
— Soak/Endurance test | |||
— Failure scenarios | |||
— Targeted tests | |||
— Other advanced test cases | |||
Raise defects | |||
Re-test defects | |||
Performance Test Summary Report | |||
— Architecture assessment | |||
— Monitoring assessments | |||
Access to self-service Portal | |||
— Run load tests | |||
— Real-time test results dashboard | |||
— Schedule load tests | |||
— Continuous Integration API | |||
— Trend historical test results | |||
— APM integration |