Organizations / Publications / Events
The Workshop
on Performance and Reliability (WOPR)
Computer Measurement Group (CMG) holds annual International CMG Conferences, has many regional US groups and International groups
STP (Software Test Professionals) publishes Software Test & Quality Assurance (former Software Test & Performance) Magazine and organizes Software Test Professionals (former Software Test & Performance) Conference
SQE publishes Better
Software Magazine and organizes STAR (Software Testing Analysis & Review) and Better Software conferences, runs StickyMinds.com testing portal
Association for Software Testing (AST)
Testing Experience Magazine the publisher, Díaz & Hilterscheid, organized multiple conferences across Europe
TPC Technology Conference on Performance Evaluation & Benchmarking (TPCTC)
Load Testing
Wikipedia about Software Performance Testing
Load Testing
Terminology by Scott Stirling
Introduction
to Performance Testing; The Who, What, Where, When and Why by Scott Barber
Microsoft's Patterns & Practices Performance Testing
Guidance project
Testing for performance Part 1: Assess the problem space
Part 2: Build out the test assets Part 3: Provide information by Michael Kelly
Load Testing: Points to Ponder by Alexander Podelko
Scott Barber's site,
don't miss Publications and
Presentations
Performance Testing Professional
Scott Moore / Northway Solution blog and resources
Dan Downing / Mentora white papers and presentations
Mark Tomlinson's blog and writing
QA Forums, include "Performance &
Load Testing" and many load testing tools forums and
QALinks
Wilson Mar's performance
testing notes
Performance Testing : KnowledgeBase from Roland Stens
The world's only blog on load testing
by Stuart Moncrieff, a lot of good LoadRunner info
Jason Harris' "Captain LoadTest" Blog
Corey Goldberg's Blog
Performance Engineering News, Avinash Mangipudi's blog
PerformanceCompetence.com, Chaitanya Bhatt's blog
Shanti Subramanyam's blog about performance and scalability testing, workloads and tools
TestsAutomation.com, Waldemar's blog
Keynote
Resource Library has some interesting white papers as well as description of their performance management services
Gomez whitepapers (you need to fill a form to get them)
Performance Testing portal
Testing Performance articles
The Top 13 Mistakes in Load Testing Applications by Mark D. Anderson
Performance
Testing Case Study, Part 1: Developing the Test Strategy by Ross Collard
Getting
Things Done: Practical Web/e-Commerce Application Stress Testing by Robert Sabourin
Load Testing,
Benchmarking, and Application Performance Management for the Web by Daniel
A. Menascé
Load
Testing of Web Sites by Daniel A. Menascé
High
Performance Testing by Scott Barber
Tester PI: Performance Investigator by Scott Barber
Critical Success Factors for
Load Test Projects by Mark McWhinney
Tuning
Your Stress Test Harness by Kirk Pepperdine
Tales from the
Lab: Best Practices in Application Performance Testing by Ellen Friedman
Real-World Load Testing Tips to Avoid Bottlenecks When Your Web App Goes Live by Jeff Dunmall and Keith Clarke
Template: Load Test Plan by Rajeev J (some things are LoadRunner-specific)
Performance testing Java servlet-based Web applications: A guide for software test engineers by Len DiMaggio
Analyzing Performance-Testing Results to Correlate Performance Plateaus and Stress Areas by Michael Kelly.
See about Performance Requirements are in the Performance Design section
Also check load testing tool vendor's sites
for white papers (usually registration required)
Bottlenecks
Bottlenecks Exposed
by Dan Downing
How to Identify the Usual Performance Suspects by Scott Barber
Diagnosing Symptoms of
Poor System Performance by Scott Barber
Rapid Bottleneck Identification, Oracle white paper
Load Testing Tools
Load Testing Tools by Wilson Mar
QAGuild Testing Tools Directory
Software Tetsing Tool Finder by Cordell Vail
QA Testing Tools
It looks like only two "universal" (supporting multiple protocols, including legacy) load testing tools remain: HP LoadRunner and Borland SilkPerformer.
HP LoadRunner (former Mercury LoadRunner)
Borland (former Segue) SilkPerformer. SilkPerformer resources.
Micro Focus (former Compuware) QALoad
IBM Rational Performance Tester
Oracle Application Testing Suite (formerly e-Test Suite from Empirix) probably is the best-known Web-only commercial tool, several good white papers (Empirix still provides solutions for VoIP, IMS, and Contact Centers - Hammer; Empirix white papers).
Microsoft Visual Studio Stress and Performance Test Solution
SOASTA CloudTest, there is CloudTest Lite, free downloadable edition
Facilita's Forecast, claims multiple technology / protocol support
LoadStorm lowest cost cloud load testing tool
NeoLoad from Neotys
SandStorm from Impetus
SmartBear LoadComplete
RadView WebLOAD
WAPT is a load and stress testing tool for web interface,
inexpensive, free trial
eValid, "test complex web applications from inside the browser to work from the same perspective as your users"
PushToTest TestMaker, allows to re-use Selenium, Sahi, soapUI test scripts and unit tests written in Java, Ruby, Python, and PHP for performance testing
There are many specialised load testing tools, many for Web or database testing. See, for example:
http://www.softwareqatest.com/qatweb1.html
http://testingfaqs.org/t-load.html
Here is the list of open source load testing tools:
http://www.opensourcetesting.org/performance.php
A couple of open source tools that looks more mature:
Apache JMeter
OpenSTA Originally developed by Cyrano
as a commercial tool. OpenSTA stands for Open Systems Testing Architecture.
Another branch of the Cyrano code is a commercial tool
QTest
from Quotium.
Eclipse
Test & Performance Tools Platform Project
JUnitPerf a collection of JUnit test decorators used to measure the performance and scalability of functionality contained within existing JUnit tests
p-unit an open source framework for unit test and performance benchmark
Hardware appliances can be useful if it is necessary to test network devices or
simulate a big number of users with limited scripting requirements. For
example,
Spirent
Avalanche or
Ixia products.
SwiftTest allows to test network storage devices.
BreakingPoint provides cyber security solutions.
Comparisons
An
Overview of Load Test Tools by Julien Buret and Nicolas Droze (2003),
includes OpenSTA, DieselTest, TestMaker, Grinder, LoadSim, JMeter, LoadTest,
Rubis
Load Test Tools
Evaluation by Abraham Jacob et al. (2002)
Stress, Load, Volume, Performance, Benchmark and Base Line Testing Tool
Evaluation and Comparison by Cordell Vail (2005)
Load Testing and Performance Monitoring as Services
Gomez Web and mobile performance, many good white papers
Keynote testing, monitoring and measurement products and services
Neustar Webmetrics monitoring services, managed load testing, and web performance management
NCC Group (former Site Confidence) web performance monitoring and load testing services
Catchpoint Real-Time Web Performance Monitoring
Yottaa Web Performance Monitoring / Optimization
BlazeMeter, a 100% JMeter-compatible, self-service load testing cloud
Related Tools
Shunra Software
products allow real network simulation during load testing. Integrated with
LoadRunner.
iTrinegy (former Itheon) WAN / Network emulation
The TesLA (Test Lab Automation) Alliance is an open industry alliance of IP test vendors
Network Test Automation Forum (NTAF), created to develop and promote interoperability
standards in the test community
Benchmarking
Wikipedia about Benchmarking
Transaction Processing Performance Council
TPC Benchmarks
Standard Performance Evaluation Corporation
(SPEC)
The Business Applications
Performance Council (BAPCo)
Ideas
International Benchmark Gateway different benchmark results
IDC Qualified Performance Indicator (QPI)
The
Performance Database Server (PDS) different benchmark results, somewhat outdated
Oracle and Sun Benchmarks
SAP Standard Application Benchmarks
Intel Performance processor benchmark results
AMD Opteron Processor-based Server Benchmarks
Windows Server 2003 Benchmarks
Microsoft SQL Server Benchmarks
Wilson Mar about Multi-Tier Reference Apps for Benchmarking
50 TB Data Warehouse Benchmark on IBM System z IBM Redbook
AC&NC collection of I/O benchmark programs for UNIX and Windows
Iperf network benchmarking tool
VMware VMmark virtualization benchmark
Benchmarking Directory
Compiler Connection's benchmark resource page
QPI (Qualified Performance Indicator), a part of IDC's Server Decision Suite Metrics (free 30-days trial available)
The Gartner Relative Performance Estimate (RPE2, originally from Ideas International), RPE2 white paper
Generic Testing
Some links to general testing sites (in addition to mentioned above).
SearchSoftwareQuality.com from TechTarget
The Automated Testing Institute (ATI)
Testing Resources from LogiGear
Tools and articles from PushToTest
(SOA testing) and Frank Cohen's blog
Cem Kaner's site
James Bach's site
Douglas Hoffman's site
Bret Pettichord's site
Michael Kelly's site
Karen Johnson's site
Brian Marick's site
Michael Bolton's site
Elisabeth Hendrickson's site
Jonathan Kohl's site
Jon Bach's blog
SoftwareQATest.com Software QA and Testing Resource Center by Rick Hower
Grig Gheorghiu's articles and blog
Exploratory Testing resources
Testing Education Lab Black Box Testing and other courses
Quick Testing Tips blog
Test Driven Development community
Software Testing Club
Software Testing Wiki
Applied Testing and Technology
(ApTest) a big list of links
SQAtester.com Online Software Testing and
Resourse Center
comp.software.testing Frequently Asked Questions (FAQ)
Test and Measurement World (electronic)
Books
Start from eBook Web Load Testing For Dummies
and Performance Testing Guidance for Web Applications
Click on the book or its title below to see book information and
reviews (if available) on Amazon.com
|
