Scaling is a psychometric term regarding the establishment of a score metric for a test, and it often has two meanings. First, it involves defining the method to operationally scoring the test, establishing an underlying scale on which people are being measured. A common example is the T-score, which transforms raw scores into a standardized […]
Certification exam development, is a well-defined process governed by accreditation guidelines such as NCCA, requiring steps such as job task analysis and standard setting studies. For certification, and other credentialing like licensure or certificates, this process is incredibly important to establishing validity. Such exams serve as gatekeepers into many professions, often after people have invested […]
A T Score (sometimes hyphenated T-Score) is a common example of a scaled score in psychometrics and assessment. A scaled score is simply a way to present scores in a more meaningful and easier-to-digest context, with the benefit of hiding the sometimes obtuse technicalities of psychometrics. Therefore, a T Score is a standardized way that […]
Item writing (aka item authoring) is a science as well as an art, and if you have done it, you know just how challenging it can be! You are experts at what you do, and you want to make sure that your examinees are too. But it’s hard to write questions that are clear, reliable, […]
Validity threats are issues with a test or assessment that hinder the interpretations and use of scores, such as cheating, inappropriate use of scores, unfair preparation, or non-standardized delivery. It is important to establish a test security plan to define the threats relevant for you and address them. Validity, in its modern conceptualization, refers to […]
Item review is the process of ensuring that newly-written test questions go through a rigorous peer review, to ensure that they are high quality and meet industry standards. What is an item review workflow? Developing a high-quality item bank is an extremely involved process, and authoring of the items is just the first step. Items […]
Online proctored exams are assessments that you can take at your home or office, with a video stream of you taking the exam being used to ensure its integrity. The primary purpose is to increase convenience and flexibility, by letting people take their exams at any quiet place they like instead of having to commute […]
Likert scales (items) are a type of item used in human psychoeducational assessment, primarily to assess noncognitive constructs. That is, while item types like multiple choice or short answer are used to measure knowledge or ability, Likert scales are better suited to measuring things like anxiety, conscientiousness, or motivation. In the realm of psychology, surveys, […]
Test blueprints, aka test specifications (shortened to “test specs”), are the formalized design of an assessment, test, or exam. This can be in the context of educational assessment, pre-employment, certification, licensure, or any other type. Generally, the amount of effort and detail is commensurate with the stakes of the assessment; a 10 item quiz for […]
Testlet is a term in educational assessment that refers to a set of test items or questions grouped together on a test, often with a common theme or scenario. This approach aims to provide a more comprehensive and nuanced assessment of an individual’s abilities compared to traditional testing methods. What is a testlet? As mentioned […]
