Home

Blogs

The Performance Testing Council has an extensive library of resources. All resources are available for members to view and save. If you are not a member please look for resources marked as Free to preview our resource library.

Filter by Resource Type
Filter by keyword(s)
Title Author Date
Testing Director's Guide to Psychometrics - A PTC workshop
Free
A description of PTC Workshop - Testing Director's Guide to Psychometrics
Judd, Wallace08/12/2008pdf 7503kbView »
The PTC - The Beginning
Free
A Powerpoint presentation of a brief history of the PTC and the benefits of membership
Judd, Wallace07/14/2008pdf 294705kbView »
Standards and Best Practices - a comparative
Free
What is a Best Practice and what is a Standard and how are they related
PTC Standards Review Board08/12/2008pdf 95907kbView »
APA Testing Standards
A powerpoint presentation discussing APA testing standards that require modification to apply to performance tests
Judd, Wallace10/10/2007ppt 332800kbView »
Attendee List - Alexandria Summit
Alexandria Summit Attendee list
Timmcke, Julie08/04/2008pdf 23201kbView »
Translating Multiple Choice Items to Performance Based
Free
A PTC Workshop - Translating MC items to PT items
Judd, Wallace08/12/2008pdf 17047kbView »
Job Task Analysis for Performance Based Testing
Free
A PTC Workshop - JTA for PT
Adair, Jim & Berry, Thomas08/12/2008pdf 7682kbView »
Gating Items - A New Item Type
A paper exploring an item type which an examinee must pass as a condition of passing a test. Failing a gating item results in failure on the test.
Judd, Wallace09/12/2008pdf 139211kbView »
Barriers to Performance Testing in IT Certification
A paper describing the barriers to performance testing in IT certification which was the result of a brainstorming session of leaders in the IT industry and supporters of performance testing
Various09/12/2008pdf 104266kbView »
An Annotated Bibliography of Performance Testing
Performance Testing Council Annotated Bibliography
Becker, Kirk03/17/2005pdf 77145kbView »
Speed Dating the PTC Way - Alexandria Summit
Summary of the four speed dating topics from the Alexandria summit, June 2008
Various09/12/2008pdf 21001kbView »
Building Constructed-Response; Performance-based Examination Items on a Multiple-Choice Budget!
Autodesk Performance Exam Items
Koneman, Phillip12/05/2008pdf 1853658kbView »
Benefits of Performance Testing
Article from Certification Magazine about the benefits of Performance Testing
Certification Magazine04/24/2004doc 26624kbView »
Cisco Summit Presentation - Deer Valley
Cisco hands on Certification Program - Deer Valley Summit, 2004
Matt O’Donoghue, Cisco team12/30/2008pps 4435968kbView »
Air Traffic .PPS
Screening Air Traffic Control Applicants - A test battery
Waugh, Gordon, Wise, Laurie, HumRRO02/01/2005pps 877568kbView »
Performance Testing Design Approaches
Classification of various types of performance items
Lopes, Elaine, Design and Delivery Committee12/31/2008pdf 133421kbView »
Performance Testing Council Standard Tier Levels
Hardware tiers defined for delivery of performance items
Standards Review Board02/01/2005pdf 164601kbView »
Summit Agenda - Boulder 2008
Free
Summit Agenda for Boulder 2008
Timmcke, Julie10/22/2008pdf 34849kbView »
Attendee List Boulder Summit 2008
2008 Boulder Summit Attendee List
Timmcke, Julie10/22/2008pdf 66619kbView »
New Standards for New Item Types
Free
Session description for New Standards for New Item Types
Judd, Wallace10/22/2008pdf 16365kbView »
Performance Testing Design Approaches - Executive Summary
Free
An Overview of the performance testing design approaches project
Lopes, Elaine, Design and Delivery Committee12/31/2008pdf 6606kbView »
Standards Review Process Flow Chart
A flow chart of the process for creating a performance testing standard
Standards Review Board02/01/2005jpg 95142kbView »
Standards review submission process
The process for submitting documents for consideration as a standard
Standards Review Board09/04/2004pdf 82507kbView »
The Guilds and Performance Testing
A presentation at the Boulder Summit
Judd, Wallace10/23/2008wav 55605804kbView »
LET Application Functionality
This is a graphic from the LETSI.ORG group which illustrates the assumptions for the SCORM 2.0 training and testing interoperability projects that LETSI.ORG is initiating. LETSI is a non-profit organization dedicated to improving systems interoperability and supporting innovation in learning, education, and training technology.
The International Federation for Learning, Education, and Training Systems Interoperability (LETSI)02/17/2009JPG 56676kbView »
Assessing Skills Unavailable Through Multiple-Choice Testing
COBRA - Presentation at the Palm Springs Summit, Feb. 2009
Rosenthal, Doug02/25/2009ppt 2605568kbView »
Scoring and Classifying Examinee Using Measurement Decision Theory
This paper describes and evaluates the use of measurement decision theory (MDT) to classify examinees based on their item response patterns.
Rudner, Lawrence04/27/2009pdf 262064kbView »
Ricci v. DeStefano - Petitioners' Reply Brief on the Merits
Free
Attorneys for Petitioners05/11/2009pdf 147389kbView »
Ricci v. DeStefano - Thoughts
Free
Justices Ponder Whether Scrapping Test Was Reverse Bias Against White Firefighters
McGowan, Kevin P.05/11/2009doc 49664kbView »
Applied Measurement
Free
Industrial Psychology in Human Resource Management
Whetzel and Wheaton05/11/2009pdf 2017838kbView »
Ricci v DeStafano
BRIEF OF INDUSTRIAL-ORGANIZATIONAL PSYCHOLOGISTS AS AMICI CURIAE IN SUPPORT OF RESPONDENTS
Frederick, David02/25/2009pdf 222802kbView »
Slippery Slope of “Alternatives” Altering the Topography of Employment Testing?
Free
alternatives
Sharf, James05/11/2009pdf 175878kbView »
Ricci v. DeStefano - Involving Title VII “Alternatives” and the Constitution’s Equal Protection Clause
Free
alternatives
Sharf, James05/11/2009pdf 163934kbView »
Summit Agenda, Chicago, May 2009
Agenda for the May 2009 Summit held in Chicago
Timmcke, Julie04/30/2009pdf 37684kbView »
Gating Items
Free
Over the past twenty years in performance testing a specific item type with distinguishing characteristics has arisen time and time again. It’s been invented independently by dozens of test development teams. And yet this item type is not recognized in the research literature. This article is an invitation to investigate the item type, evaluate the contexts in which it may be appropriately used, and assess possible statistical and administrative ramifications of the item type.
Judd, Wallace06/02/2009pdf 138506kbView »
Six Strategies for Designing Creative Insightful Performance Items
Free
A pre-Summit Workshop
Judd, Wallace08/17/2009pdf 17593kbView »
Job Task Analysis for Performance Testing
Free
A pre-Summit Workshop
Berry, Thomas08/17/2009pdf 16052kbView »
Why Test?
Free
An article on performance testing
The Performance Testing Council Founding Members01/30/2004pdf 40989kbView »
Oak Brook 2009 Summit - Key Speakers
Free
Description of key speakers for 2009 Oak Brook Summit
Timmcke, Julie09/15/2009pdf 32588kbView »
Summit Agenda Oak Brook 2009
Free
Summit Agenda Oak Brook October 2009
Timmcke, Julie10/16/2009pdf 38312kbView »
Balancing Job-relatedness with Real Lives
Summit presentation of the SRTA Dental Hygienist Examination
Davis, Susan10/22/2009pdf 407533kbView »
Performance Testing Tools Survey
survey data from performance testing tools survey
Design and Delivery Committee10/21/2009ppt 15720448kbView »
Performance Testing Tools Survey PDF
survey data from performance testing tools survey - pdf format
Design and Delivery Committee10/28/2009pdf 737083kbView »
Psychometric References
Free
Listing of psychometric references compiled by the PTC Psychometrics Committee
PTC Psychometrics Committee10/23/2009doc 1668096kbView »
Psychometric Concepts and Analyses Learning Objectives
Learning Objectives for the Psychometric Concepts and Analyses presented at NOCA
NOCA10/23/2009pdf 88209kbView »
Various Test Program Evaluation Standards
Free
A compiled list of where to obtain Test Program Evaluation Standards
PTC Psychometrics Committee10/23/2009doc 2689536kbView »
Adaptive Testing for Classifications Using Decision Theory
A paper presented at the annual meeting of AERA
Rudner, Lawrence M.04/15/2004pdf 752620kbView »
Advances in Standard Setting for Professional Licensure Examinations
A paper presented at the annual meeting of AERA
Pitoniak, Hambleton, Sireci04/01/2002pdf 344810kbView »
Automatic Item Generation Methodology in Theory and Practice
A study prepared for the Medical Council of Canada
Pitoniak, Mary J.01/24/2002pdf 381893kbView »
A Brief Introduction to Evidence-Centered Design
A paper providing an introduction to the basic ideas of ECD
Mislevy, Almond, Lukas05/12/2003pdf 119679kbView »
Computer Based Testing and Validity
A look into the future of computer-based testing and validity
Russell, Goldberg, O'Connor08/01/2003pdf 179931kbView »
Expected Classification Accuracy
A discussion of a procedure for developing a classification table of true and expected score categories
Rudner, Lawrence M.04/01/2004pdf 271319kbView »
Expected Classification Accuracy
A presentation of a procedure for developing a classification table of true and expected score categories
Rudner, Lawrence M.04/01/2004ppt 134144kbView »
Intuitive Test Theory
A discussion of some "phenomenological primitives" about testing and assessment
Mislevy and Braun05/17/2001pdf 161666kbView »
Item Cluster Method for Setting a Passing Score
A presentation of the CPA exam
Hambleton and Wild07/07/2005pdf 278964kbView »
Project Based Learning
A working paper on the learning issues in projects
Peter W.G. Morris and Irene Loch02/11/2002pdf 322992kbView »
Relationships between Alpha Coefficient and Scale Stability Index
A paper describing an empirical investigation between two reliability coefficients as indices of relationship among a set of item or task scores
Olsen, James07/08/2004doc 45568kbView »
Setting a Passing Score on the Uniform CPA Examination
A presentation of the CPA exam
Biskin, Hambleton, Wild07/17/2003pdf 201917kbView »
Setting Standards on Tests Containing Computerized Performance Tasks
An evaluation of four standard setting methods for performance assessments
Pitoniak, Hambleton, Biskin07/07/2005pdf 365442kbView »
The Evolution of the NAEP Achievement Levels Setting Process
A summary of the research and development efforts conducted by ACT
Reckase, Mark06/01/2000pdf 290185kbView »
Statistical Test Theory for Education and Psychology
A manuscript on Statistical Test Theory
Dato N. M. de Gruijter & Leo J. Th. Van der Kamp05/01/2002pdf 1016529kbView »
Theory Frameworks and Extensions Useful for Scoring Complex Performance Tests
A white paper descibing methods that may be useful for scoring complex performance exercises or tests
Olsen, James10/14/2004pdf 1021366kbView »
Work Classification Method Training
AICPA presentation on WCM
Hambleton and Wild07/07/2005pdf 289270kbView »
Sample Performance Test Psychometrics Part II
This paper shows a variety of psychometric analyses that can be conducted with a performance data
Olsen, James10/14/2004doc 243712kbView »
Sample Performance Test Psychometrics
This paper shows a variety of psychometric analyses that can be conducted with a performance data
Olsen, James10/13/2004doc 265216kbView »
Preliminary Factor analysis results of a twenty item Performance Test – Draft 1.0
Documented Analysis for the Performance Testing Council
McCook, William09/10/2004doc 303104kbView »
5-Item Weighted Info
A tool for 5-Item weighted analysis
Judd, Wallace10/28/2009xls 322048kbView »
Decision Theoretical Test Analysis by Lawrence Rudner
Integrating Decision Theory In Testing
Judd, Wallace10/28/2009xls 27136kbView »
Decision Theoretical Test Analysis - Poly by Lawrence Rudner
A tool for decision theoretical test analysis
Judd, Wallace10/28/2009xls 30720kbView »
Cost Analysis
Recommended principles and procedures for evaluating Project costs
Olsen and Newby10/13/2004doc 26624kbView »
Cutpoint Testing
A discussion on determing a passing score
Judd, Wallace11/01/2002pdf 300475kbView »
Five-Item Test
A tool for Five-Item Test analysis
Judd, Wallace10/28/2008xls 278016kbView »
A generalizability Theory Approach toward Estimating Standard Errors of Cutscores Using the Bookmark Standard Setting Procedure
A paper presented at the annual meeting of the NCME
Guemin and Lewis04/13/2001pdf 460843kbView »
The Guilford-Guttman Dual-Distribution Cutpoint Computation
Implementation of Guilford and Guttman's work on cutpoint calculation.
Judd, Wallace10/28/2009xls 195584kbView »
Hybrid Testing
A presentation on hybrid testing
Judd, Wallace10/14/2004doc 25600kbView »
Hybrid Testing
A presentation on hybrid testing
Judd, Wallace10/28/2008ppt 44032kbView »
Three Parameter Item Test Theory
A tool for three parameter item test theory
Judd, Wallace10/28/2008xls 135168kbView »
ICC and Information
A tool for ICC
Judd, Wallace10/28/2009xls 48128kbView »
Item Generator
A tool for Test of Normal Random Number Generation
Judd, Wallace10/28/2008xls 1908224kbView »
Omega
A tool for 5 Item ICC
Judd, Wallace10/28/2008xls 496640kbView »
Appeals by Type
A graphical presentation of appeals by type
Judd, Wallace10/28/2008xls 39424kbView »
A Performance Testing Glossary
The meanings of terms appropriate to the context of performance testing
Various03/18/2005doc 70656kbView »
The Omega in Testing
A research report prepared for the Performance Testing Council on the goal of testing
Judd, Wallace01/01/2005pdf 428245kbView »
Scale Stability Index (SSI) 1.0 Brief
A briefing on the scale stability index
Judd, Wallace10/28/2008doc 89600kbView »
Scale Stability Index (SSI) 1.0
A tool to calculate the Scale Stability Index
Judd, Wallace10/28/2008xls 112128kbView »
Sum Five-Item Test
A tool for Sum Five-Item tests
Judd, Wallace10/28/2008xls 321024kbView »
Test Score Converter
A tool for test score conversion
Judd, Wallace10/28/2008xls 23552kbView »
Validating a New Reliability Measure
A PTC paper on reliability measures for performance tests
Judd, Wallace08/14/2004doc 68096kbView »
Validity Centered Design
A paper on validity centered design
Bunderson, C. Victor10/13/2004doc 35840kbView »
Certification Program Manager Job Opening
Free
Job Listing ESRI
Gloria Jaramillo01/14/2010docx 31611kbView »
Measuring Team Performance in Simulations
measurement tools for evaluating team performance in a simulation experience
Salas, Eduardo02/16/2010pdf 500663kbView »
Summit Agenda Orlando 2010
Free
Summit Agenda Orlando 2010
Timmcke, Julie02/16/2010pdf 33916kbView »
Simulation-Based Team Training Performance Assessment
Presentation at Orlando Summit
Shuffler, Marissa02/15/2010ppt 1192960kbView »
Institute for Simulation and Training - Presentation and Tour Summary
Free
Bios and Lab descriptions for the Institute for Simulation and Training Tour and Presentations
Timmcke, Julie02/16/2010doc 35328kbView »
Go With The Flow
Abstract of Go With The Flow, research by Dr. Karen Cooper
Cooper, Karen02/16/2010pdf 0kbView »
An Overview of Human Performance Assessment Using Simulation
Presentation at Orlando Summit on Simulation Projects at the Institute for Simulation and Training, University of Central Florida
Kincaid, Peter02/16/2010pdf 0kbView »
Research in Advanced Performance Technology and Educational Readiness
Presentation at Orlando Summit on RAPTER Lab Simulation Projects at the Institute for Simulation and Training, University of Central Florida
Tarr, Ronald02/16/2010pdf 0kbView »
Pyschometrician Simulations Specialist
Free
Job opportunity for Psychometrician Simulations Specialist for ABIM
ABIM02/25/2010pdf 9966kbView »
Performance Testing Tools Survey Review
A review of the results of the performance testing tools survey conducted by the design and delivery committee.
Elaine Lopes12/31/2009pdf 0kbView »
Summit Agenda - Minneapolis May, 2010
Free
Summit Agenda for Minneapolis May 2010
Timmcke, Julie05/21/2010pdf 32616kbView »