|
|
PAST CONFERENCES:
56th Conference
Conference Photos
Conference Program
Key Note Speakers
Pre & Post Conference
Seminars
55th Conference
Conference Photos
Conference Program
Key Note Speakers
Pre & Post Conference
Seminars
54th Conference
Attendees Comments
Conference Photos
Conference Program
|
|
|
|
 Back to Seminars
Testing effectiveness is determined by one’s testing process—the way we do things
that produces our results. To improve test results, we must improve our testing
process; and that requires meaningful, valid, and reliable objective measurement.
Defect data are the most obvious testing artifact to measure, but they must be put
in context and coupled with other key factors that are critical to enabling improvement.
Not only do we tend to miss important measures, but we also often overwhelm ourselves
with too many measurements. This interactive presentation describes a minimum set
of metrics that testing needs to know, ways to make those measures within appropriate
contexts, and methods to analyze and report to guide improvement. Techniques are
suggested for overcoming resistance when getting started. Exercises enhance learning
by allowing participants to practice applying practical techniques to realistic
examples.
Course Content:
I. MEASUREMENT AND PROCESSES
What a process is, and is not, why it matters Distinguishing “real” from “presumed”
Defined and documented processes Relation between process and measurement Silos,
measuring a process to full end result Measuring results vs. guiding improvement
Non-procedural process components Key measurement principles, core measures Validity,
reliability, materiality, Hawthorne Project and product vs. process measures Measures
vs. metrics, meters and predictors Goal-question-metric (GQM), process goals Why
most measurement programs fail Avoiding resistance to measurement
II. DEFINING THE TESTING PROCESS
Key testing process procedural elements Proactive Testing™ Life Cycle IEEE Standards
for testing, documentation What should be measured, how to do it Testing/development
good metrics practices Statistical process control, capability Externally-defined
software process models Test maturity, CMM-based vs. TPI models Test effectiveness
indicators Benchmarks, surveys, assessments adequacy
|
III. TESTING ACTIVITY MEASURES
What is a test case, basic unit of size Development sizing, derived test sizing
Test case coverage measures, limitations Functional test coverage, traceability
matrix Degrees of structural, white box coverage Dynamic vs. active, passive static
testing Test execution time, effort, quality measures Test automation, support,
administration Test cycles, defect fix turnaround time Impact of level of quality
required
IV. OUTCOMES, ANALYSIS, AND REPORTING
What is a defect; fault vs. failure, duplicates Operations and performance measures
Reliability, durability, usability Incident/defect categorization, tracking Defects
found vs. number projected Defect age, source including testing errors Charting
over time, projecting delivery date Defect patterns, causal analysis Test sensitivity,
detection rates and yields Find and fix time, effort, cost by phase Defect detection
efficiency Historical profiles, subjective view of value Evaluating effectiveness
of test techniques Reporting, using measures to improve
|
Robin F. Goldsmith has been President of Go Pro Management, Inc. consultancy since
1982. He works directly with and trains professionals in business engineering, requirements
analysis, Beyond the Textbook(tm) software acquisition, process and project management,
quality and Proactive Testing(tm). Previously he was a developer, systems programmer/DBA/QA,
and project leader with the City of Cleveland, leading financial institutions, and
a "Big 4" consulting firm. Mr. Goldsmith Chaired BOSCON 2000 and 2001, ASQ Boston
Section's Annual Quality Conferences, and is a member of the ASQ Software Division
Methods Committee; and is also an author of many articles and the recent book Discovering
REAL Business Requirements for Software Project Success.
He holds the following degrees: Kenyon College, A.B. with Honors in Psychology;
Pennsylvania State University, M.S. in Psychology; Suffolk University, J.D.; Boston
University, LL.M. in Tax Law. Mr. Goldsmith is a member of the Massachusetts Bar
and licensed to practice law in Massachusetts.
DATE: October 16, 2006
Location: Holiday Inn, Mansfield, MA
Time: 9:00 am to 5:00 pm
Back to Seminars
|
|
