Contrasting Groups Method - Assess | Computerized Adaptive Testing | Psychometrics

The Contrasting Groups Method is a common approach to setting a cutscore. It is very easy to do, but has the important drawback that some sort of “gold standard” is needed to assign examinees into categories such as Pass and Fail. This “gold standard” should be unrelated to the test itself.

For example, suppose you wanted to set a cutscore on a practice test that is helping examinees determine if they are ready for a high-stakes certification test. You might have past data for examinees who took both your practice exam and the actual certification test. Their results from the certification test can be used to assign them to groups of Pass or Fail, and then you can evaluate the practice test score distributions for each group. These distributions are typically smoothed, and their intersection represents an appropriate cutscore for the practice test. In the example below, the two curves intersect near a score of 85, suggesting that this is an appropriate cutscore for the practice test that will closely predict the results of the official certification test.

I developed a simple tool in MS Excel that allows our psychometricians to easily produce both the smoothed and unsmoothed versions of this method, given nothing more than a list of practice test scores and “real” test classification for examinees. If you think this method might be appropriate for your exams, please contact us at sales@54.89.150.95 and one of our consultants will get in touch with you.

Want to improve the quality of your assessments?

Sign up for our newsletter and hear about our free tools, product updates, and blog posts first! Don’t worry, we would never sell your email address, and we promise not to spam you with too many emails.

Newsletter Sign Up
First Name*
Last Name*
Email*
Company*
Market Sector*
Lead Source

Bio
Latest Posts

nthompson

Nathan Thompson earned his PhD in Psychometrics from the University of Minnesota, with a focus on computerized adaptive testing. His undergraduate degree was from Luther College with a triple major of Mathematics, Psychology, and Latin. He is primarily interested in the use of AI and software automation to augment and replace the work done by psychometricians, which has provided extensive experience in software design and programming. Dr. Thompson has published over 100 journal articles and conference presentations, but his favorite remains https://pareonline.net/getvn.asp?v=16&n=1.