Item response theory is the predominant psychometric paradigm for mid or large scale assessment. As noted in my introductory blog post, it is actually a family of models. In this post, we discuss the two parameter IRT model (IRT 2PL).
Consider the following 3PL equation (simplified from Hambleton & Swaminathan, 1985, Eq. 3.3). The IRT 2PL simply removes the c and (1-c) elements, so that probability is only a function of a and b.
This equation is predicting the probability of a certain response based on the examinee trait/ability level, the item discrimination parameter a, and the item difficulty/location parameter b. If the examinee’s trait level is higher than the item location, the person has more than a 50% chance of responding in the keyed direction.
This phrase “in the keyed direction” is one you might often hear with the IRT 2PL. This is because it is not often used with education/knowledge/ability assessments where items usually have a correct answer and guessing is often possible. The IRT 2PL is used more often in attitudinal or other psychological assessments where guessing is irrelevant and there is no correct answer. For example, consider an Extroversion scale, where examinees are responding Yes/No to statements like “I love to go to parties” or “I prefer to read books in my free time.” There is not much to guess here, and the sense of “correct” is not relevant.
However, it is quite clear that the first statement is keyed in the direction of extroversion while the second statement is the reverse. In fact, you would get the 1 point of response for saying No to that statement rather than Yes. This is often called reverse-scored.
There are other aspects that go into whether you should use the 2PL model, but this is one of the most important. In addition, you should also examine model fit indices and take sample size into account.
How do I implement the two parameter IRT model?
Like other IRT models, the 2PL requires specialized software. Not all statistical packages will do it. And while you can easily calculate classical statistics in Excel, there is no way to do IRT (well, unless you want to write your own VBA programs to do so). As mentioned in this article on the three parameter model, there are a lot of IRT software programs available, but not all meet the required standards.
You should evaluate cost and functionality. If you are a fan of R, there are packages to estimate IRT there. However, I recommend our Xcalibre program for both newbies and professionals. For newbies, it is much easier to use, which means you spend more time learning the concepts of IRT and not fighting command code that might be 30 years old. For professionals, Xcalibre saves you from having to create reports by copy and paste which is incredibly expensive.
Nathan Thompson earned his PhD in Psychometrics from the University of Minnesota, with a focus on computerized adaptive testing. His undergraduate degree was from Luther College with a triple major of Mathematics, Psychology, and Latin. He is primarily interested in the use of AI and software automation to augment and replace the work done by psychometricians, which has provided extensive experience in software design and programming. Dr. Thompson has published over 100 journal articles and conference presentations, but his favorite remains https://scholarworks.umass.edu/pare/vol16/iss1/1/ .