Load Testing
Organizations / Publications / Events
The Workshop
on Performance and Reliability (WOPR)
some presented papers
Computer Measurement Group (CMG) holds annual International CMG Conferences, has many regional US groups and International groups
CMG conference proceedings from 1997 through 2007
STP (Software Test Professionals) publishes Software Test & Quality Assurance (former Software Test & Performance) Magazine and organizes Software Test Professionals (former Software Test & Performance) Conference
SQE publishes Better
Software Magazine and organizes STAR (Software Testing Analysis & Review) and Better Software conferences, runs StickyMinds.com testing portal
Association for Software Testing (AST)
Testing Experience Magazine the publisher, Díaz & Hilterscheid, organized multiple conferences across Europe
TPC Technology Conference on Performance Evaluation & Benchmarking (TPC TC) colocated with VLDB (Very Large Data Bases) Conference
Sites
Scott Barber's site,
don't miss Publications and
Presentations
LoadTester.com
includes library and
articles, mainly for LoadRunner
Microsoft's Patterns & Practices Performance Testing
Guidance project
QA Forums includes "Performance &
Load Testing" and many load testing tools forums and
QALinks
Wilson Mar's performance
testing notes
Dan Downing / Mentora white papers
Performance Testing : KnowledgeBase from Roland Stens
White Papers from CSS (ReadyTestGo)
The world's only blog on load testing
by Stuart Moncrieff, a lot of good LoadRunner info
Jason Harris' "Captain LoadTest" Blog
Corey Goldberg's Blog
Performance Engineering News, Avinash Mangipudi's blog
PerformanceCompetence.com, Chaitanya Bhatt's blog
Shanti Subramanyam's blog about performance and scalability testing, workloads and tools
Performance Testing Professional
TestsAutomation.com, Waldemar's blog
Keynote
Resource Library has some interesting white papers as well as description of their performance management services
Gomez whitepapers (you need to fill a form to get them)
Performance Testing portal
Also check load testing tool vendor's sites
for white papers (usually registration required)
Generic
See about Performance Requirements are in the Performance Design section
Wikipedia about Software Performance Testing
Load Testing
Terminology by Scott Stirling
Introduction
to Performance Testing; The Who, What, Where, When and Why by Scott Barber
Software Performance Testing Handbook - A Comprehensive Guide for Begineers by Ramya Moorthy
Testing for performance Part 1: Assess the problem space
Part 2: Build out the test assets Part 3: Provide information by Michael Kelly
Template: Load Test Plan
by Rajeev J (some things are LoadRunner-specific)
Load Testing: Points to Ponder by Alexander Podelko
The Top 13 Mistakes in Load Testing Applications by Mark D. Anderson
Performance
Testing Case Study, Part 1: Developing the Test Strategy by Ross Collard
Getting
Things Done: Practical Web/e-Commerce Application Stress Testing by Robert Sabourin
Load Testing,
Benchmarking, and Application Performance Management for the Web by Daniel
A. Menascé
Load
Testing of Web Sites by Daniel A. Menascé
Scott Barber's
interview
High
Performance Testing by Scott Barber
Tester PI: Performance Investigator by Scott Barber
Critical Success Factors for
Load Test Projects by Mark McWhinney
Tuning
Your Stress Test Harness by Kirk Pepperdine
Tales from the
Lab: Best Practices in Application Performance Testing by Ellen Friedman
Real-World Load Testing Tips to Avoid Bottlenecks When Your Web App Goes Live by Jeff Dunmall and Keith Clarke
Performance testing Java servlet-based Web applications: A guide for software test engineers by Len DiMaggio
Analyzing Performance-Testing Results to Correlate Performance Plateaus and Stress Areas by Michael Kelly.
Bottlenecks
Bottlenecks Exposed
by Dan Downing
How to Identify the Usual Performance Suspects by Scott Barber
Diagnosing Symptoms of
Poor System Performance by Scott Barber
Rapid Bottleneck Identification, Oracle white paper
Load Testing Tools
Load Testing Tools by Wilson Mar
QAGuild Testing Tools Directory - Performance
I am aware about four "universal" (supporting multiple protocols) load testing tools :
HP LoadRunner (former Mercury)
HP LoadRunner and Performance Center Blog
LoadRunner Tutorial
Wilson Mar's LoadRunner notes
Wilson Mar's scripting notes
Yahoo
Group
Learn LoadRunner blog
Dmitry Motevich's blog
SAP Cheat Sheet for Performance
Testers by Stuart Moncrieff
Performance Testing Citrix Applications Using LoadRunner: Citrix Virtual User Best Practices by Tim Chase
HP LoadRunner and Citrix. Advanced Techniques for Performance Engineers by Anthony Lyski and Scott Moore
LoadRunner Winsock Tutorial
Performance Testing, LoadRunner Tips&Tricks blog
Using LoadRunner with Oracle Applications Release 12 by Mentora Group
Using
LoadRunner for Unsupported or Difficult to Parameterize Protocols
Rational Performance Tester
Using Rational Performance Tester Version 7 IBM Redbook
Rational manuals
"User Experience, not Metrics"
and "Beyond Performance Testing" by Scott Barber
Custom Load Generation with Rational TestManager
Using a
LoadRunner workload as a model for a Rational workload by Yuriy Veytsman
IBM Rational Performance Tester on Windows 2000 and Linux: A scalability
comparison by Yuriy Veytsman
IBM Rational Performance Optimization Toolkit for Rational Performance Tester
Use
IBM Rational Testing Tools for Effective Performance Monitoring of Apache Web
Servers by Matthew Adcock
An Experience Using Rational PerformanceTester to Benchmark Oracle EnterpriseOne IBM Redpaper
Michael Kelly's writing
RTTS Whitepapers and Presentations
Micro Focus (former Borland, former Segue) SilkPerformer. SilkPerformer resources.
Micro Focus (former Compuware) QALoad
Oracle Application Testing Suite (formerly e-Test Suite from Empirix) probably is the best-known Web-only commercial tool, several good white papers (Empirix still provides solutions for VoIP, IMS, and Contact Centers - Hammer; Empirix white papers).
Alex Amat's blog
Visual Studio
Team Suite and Test Edition
include a load testing tool
Microsoft's Patterns & Practices Performance Testing
Guidance project
Shai Raiten's blog
SOASTA CloudTest, there is CloudTest Lite, free downloadable edition
Cloud Corner blog
Performance Matters blog
Fred Beringer's blog
Facilita's Forecast, claims multiple technology / protocol support
LoadStorm lowest cost cloud load testing tool
LoadStorm performance tetsing blog
RadView WebLOAD
RadView Software sponsored WebLOAD Open Source Load Generation Engine
WAPT is a load and stress testing tool for web interface,
inexpensive ($350 per installation), free trial
WAPT 4.0: Web Site Load, Stress and Performance Testing
eValid, "test complex web applications from inside the browser to work from the same perspective as your users"
PushToTest TestMaker, allows to re-use Selenium, Sahi, soapUI test scripts and unit tests written in Java, Ruby, Python, and PHP for performance testing
There are many specialised load testing tools, many for Web or database testing. See, for example:
http://www.softwareqatest.com/qatweb1.html
http://testingfaqs.org/t-load.html
Here is the list of open source load testing tools:
http://www.opensourcetesting.org/performance.php
A couple of open source tools that looks more mature:
OpenSTA Originally developed by Cyrano
as a commercial tool. OpenSTA stands for Open Systems Testing Architecture.
Another branch of the Cyrano code is a commercial tool
QTest
from Quotium.
OpenSTA versus LoadRunner by Andy O’Brien and Antony Marcano
Danny Faught's review of OpenSTA in Open Testware Reviews
Apache JMeter
Load Testing your
Applications with Apache JMeter by Keld H. Hansen
Load Testing with Apache JMeter and Badboy – A Tutorial
JMeter Links a
big collections of links from JMeter site
Eclipse
Test & Performance Tools Platform Project
JUnitPerf a collection of JUnit test decorators used to measure the performance and scalability of functionality contained within existing JUnit tests
p-unit an open source framework for unit test and performance benchmark
Hardware appliances can be useful if it is necessary to test network devices or
simulate a big number of users with limited scripting requirements. For
example,
Spirent
Avalanche or
Ixia products.
SwiftTest allows to test network storage devices.
BreakingPoint provides cyber security solutions.
Comparisons
An
Overview of Load Test Tools by Julien Buret and Nicolas Droze (2003),
includes OpenSTA, DieselTest, TestMaker, Grinder, LoadSim, JMeter, LoadTest,
Rubis
Load Test Tools
Evaluation by Abraham Jacob et al. (2002)
Stress, Load, Volume, Performance, Benchmark and Base Line Testing Tool
Evaluation and Comparison by Cordell Vail
Load Testing and Performance Monitoring as Services
Gomez Web and mobile performance, many good white papers
Keynote testing, monitoring and measurement products and services
Webmetrics monitoring services, managed load testing, and web performance management
Site Confidence web performance monitoring and load testing services
Catchpoint Real-Time Web Performance Monitoring
Yottaa Web Performance Monitoring / Optimization
BlazeMeter, a 100% JMeter-compatible, self-service load testing cloud
Related Tools
Shunra Software
products allow real network simulation during load testing. Integrated with
LoadRunner.
iTrinegy (former Itheon) WAN / Network emulation
The TesLA (Test Lab Automation) Alliance is an open industry alliance of IP test vendors
Network Test Automation Forum (NTAF), created to develop and promote interoperability
standards in the test community
Benchmarking
Wikipedia about Benchmarking
Transaction Processing Performance Council
TPC Benchmarks
Standard Performance Evaluation Corporation
(SPEC)
The Business Applications
Performance Council (BAPCo)
Ideas
International Benchmark Gateway different benchmark results
The
Performance Database Server (PDS) different benchmark results
Oracle and Sun Benchmarks
SAP Standard Application Benchmarks
Intel Server
Performance server benchmark results
AMD Opteron Processor-based Server Benchmarks
Windows Server 2003 Benchmarks
Microsoft SQL Server Benchmarks
Wilson Mar about Multi-Tier Reference Apps for Benchmarking
50 TB Data Warehouse Benchmark on IBM System z IBM Redbook
AC&NC collection of I/O benchmark programs for UNIX and Windows
Iperf network benchmarking tool
VMware VMmark virtualization benchmark
Benchmarking Directory
Compiler Connection's benchmark resource page
Generic Testing
Some links to general testing sites (in addition to mentioned above).
testingReflections.com
testing blogs
SearchSoftwareQuality.com from TechTarget
The Automated Testing Institute (ATI)
Testing Resources from LogiGear
Tools and articles from PushToTest
(SOA testing) and Frank Cohen's blog
Cem Kaner's site
James Bach's site
Douglas Hoffman's site
Bret Pettichord's site
Michael Kelly's site
Karen Johnson's site
Brian Marick's site
Michael Bolton's site
Elisabeth Hendrickson's site
Jonathan Kohl's site
Jon Bach's blog
SoftwareQATest.com Software QA and Testing Resource Center by Rick Hower
Grig Gheorghiu's articles and blog
Testing Education Lab Black Box Testing and other courses
Quick Testing Tips blog
Test Driven Development community
Software Testing Club
Software Testing Wiki
Applied Testing and Technology
(ApTest) a big list of links
SQAtester.com Online Software Testing and
Resourse Center
comp.software.testing Frequently Asked Questions (FAQ)
Test and Measurement World (electronic)
Books
Start from Performance Testing Guidance for Web Applications
Click on the book or its title below to see book information and
reviews (if available) on Amazon.com