PTC History

Frequently Asked Questions

Does growth of performance testing (PT) mean traditional tests will go away?
No. Performance testing is a new layer of value, supplementing traditional cognitive tests. Multiple choice has its place and is not going away.

Will PT cannibalize market for cognitive tests?
No. It will create a new market; PT helps to differentiate, maintain competitive offerings. The two go together: multiple choice tests can be a pre-requisite to Performance Tests. Traditional testing faces risks largely of its own making

If I offer a Performance Test will it lower the perceived value of my traditional tests?
No. Traditional tests can be positioned to track to and pre-qualify for performance tests. People will take both.

Why should I care about standards for PT?
Same reason as for traditional tests: your customers deserve an independent measure of validity. Standards are coming and you want to participate in their development, even if you don't have PT plans right now

Why should I invest in PTC?
PTC is where the standards will be developed, and the work of PTC leverages your own R&D investments

We would join but we aren't sure how to apply classical test theory to PT.
Yes, exactly the reason to get involved in PTC! That's what PTC investigates. Some vendors have successfully applied psychometrics to PT with good results. Classical test theory needs to be adapted to performance testing: this is what PTC will be focused on. Learn more by joining and actively participating.

We have already decided we can't do PT. No plans for PT. Why should we join PTC?
Evaluate PT on a much bigger scale, give it a fresh look, supported by experts and practicitioners. PT is growing, as success of many PTC members demonstrates. Learn about successful PTs in a range of contexts. Invest in the future: opportunities you have not thought of yet (Never say never. Never say can't.) Do you want your company to be away from the table when standards for PT are developed?

We believe performance testing provides a better performance measure, but can it scale?
Yes it can. Test delivery is a major area of PTC innovation, for standards and solutions. PT has advantages even if not as ubiquitous as traditional testing

Can PT be brought to market at competitive pricing?
Yes it can. Major IT vendors have pushed the price of PT down to equal or less than cost of traditional tests. PTC members share info on how they do it

Why doesn’t ATP (Association of Test Publishers) address performance testing?
ATP is focused on lobbying more than R&D. ATP charter limits members to publishers of psychometrically valid tests. New validation methodologies are required for PT. ATP is focused on traditional (multiple-choice) test measures, not looking for new testing methods. Different skills are required to develop Performance Tests than conventional multiple choice tests. “ Innovator's Dilemma” issues apply

Why would I share data and methods with other Regular Members at PTC?
Only by sharing data and methods can standards be developed. Your data and methods kept to yourself don't help you create or provide an independent measure of validity

What are protections for confidential info & IP?
Sharing of data or material is strictly voluntary. PTC Bylaws bind Members to non-disclosure between one another and PTC. Ownership of a Member's IP remains with that Member unless otherwise assigned in writing by that Member.

How do I insure that the standards developed at PTC will be appropriate and useful by my industry and company?
Join PTC and get involved! Participate in Practice Area Committees on issues related to your industry and company. PTC focus is on valid science. Proposed standards are balloted to entire voting membership, and there is an appeal process. PTC processes are modelled on successful standards development orgs (IEEE, ANSI, ISO)





		Frequently Asked Questions Does growth of performance testing (PT) mean traditional tests will go away? No. Performance testing is a new layer of value, supplementing traditional cognitive tests. Multiple choice has its place and is not going away. Will PT cannibalize market for cognitive tests? No. It will create a new market; PT helps to differentiate, maintain competitive offerings. The two go together: multiple choice tests can be a pre-requisite to Performance Tests. Traditional testing faces risks largely of its own making If I offer a Performance Test will it lower the perceived value of my traditional tests? No. Traditional tests can be positioned to track to and pre-qualify for performance tests. People will take both. Why should I care about standards for PT? Same reason as for traditional tests: your customers deserve an independent measure of validity. Standards are coming and you want to participate in their development, even if you don't have PT plans right now Why should I invest in PTC? PTC is where the standards will be developed, and the work of PTC leverages your own R&D investments We would join but we aren't sure how to apply classical test theory to PT. Yes, exactly the reason to get involved in PTC! That's what PTC investigates. Some vendors have successfully applied psychometrics to PT with good results. Classical test theory needs to be adapted to performance testing: this is what PTC will be focused on. Learn more by joining and actively participating. We have already decided we can't do PT. No plans for PT. Why should we join PTC? Evaluate PT on a much bigger scale, give it a fresh look, supported by experts and practicitioners. PT is growing, as success of many PTC members demonstrates. Learn about successful PTs in a range of contexts. Invest in the future: opportunities you have not thought of yet (Never say never. Never say can't.) Do you want your company to be away from the table when standards for PT are developed? We believe performance testing provides a better performance measure, but can it scale? Yes it can. Test delivery is a major area of PTC innovation, for standards and solutions. PT has advantages even if not as ubiquitous as traditional testing Can PT be brought to market at competitive pricing? Yes it can. Major IT vendors have pushed the price of PT down to equal or less than cost of traditional tests. PTC members share info on how they do it Why doesn’t ATP (Association of Test Publishers) address performance testing? ATP is focused on lobbying more than R&D. ATP charter limits members to publishers of psychometrically valid tests. New validation methodologies are required for PT. ATP is focused on traditional (multiple-choice) test measures, not looking for new testing methods. Different skills are required to develop Performance Tests than conventional multiple choice tests. “ Innovator's Dilemma” issues apply Why would I share data and methods with other Regular Members at PTC? Only by sharing data and methods can standards be developed. Your data and methods kept to yourself don't help you create or provide an independent measure of validity What are protections for confidential info & IP? Sharing of data or material is strictly voluntary. PTC Bylaws bind Members to non-disclosure between one another and PTC. Ownership of a Member's IP remains with that Member unless otherwise assigned in writing by that Member. How do I insure that the standards developed at PTC will be appropriate and useful by my industry and company? Join PTC and get involved! Participate in Practice Area Committees on issues related to your industry and company. PTC focus is on valid science. Proposed standards are balloted to entire voting membership, and there is an appeal process. PTC processes are modelled on successful standards development orgs (IEEE, ANSI, ISO)