What Are Cognitive Diagnostic Models? Cognitive diagnostic models (CDMs) are a psychometric framework designed to enhance how tests are structured and scored. Instead of providing just an overall test score, CDMs aim to generate a detailed profile of an examinee’s mastery of specific skills. This approach offers deeper insights into individual strengths and weaknesses, making […]
The Goal: Quality Assessment On March 31, 2017, I read an article in The Industrial-Organizational Psychologist (the journal published by the Society for Industrial Organizational Psychology) that really resonated with me: Has Industrial-Organizational Psychology Lost Its Way? By Deniz S. Ones, Robert B. Kaiser, Tomas Chamorro-Premuzic, Cicek Svensson Why? Because many of their points apply […]
What is a Rubric? A rubric is a set of rules for converting unstructured responses on assessments—such as essays—into structured data that can be analyzed psychometrically. It helps educators evaluate qualitative work consistently and fairly. Why Do We Need Rubrics? Measurement is a quantitative endeavor. In psychometrics, we aim to measure knowledge, achievement, aptitude, or […]
Time limits are an essential parameter to just about every type of assessment. A time limit is the length of time given to individuals to complete their assessment or a defined portion of it. Managing test timing effectively ensures fairness, accuracy, and a pleasant experience for all test-takers – and is therefore a component of […]
Introduction Test fraud is an extremely common occurrence. We’ve all seen articles about examinee cheating. However, there are very few defensible tools to help detect it. I once saw a webinar from an online testing provider that proudly touted their reports on test security… but it turned out that all they provided was a simple […]
KSAOs (Knowledge, Skills, Abilities, and Other Characteristics) is an approach to defining the human attributes necessary for success on a job. It is an essential aspect of human resources and organizational development field, impacting critical business processes from recruitment to selection to compensation. This post provides an introduction to KSAOs and then discusses how they […]
Computerized adaptive testing is an AI-based approach to assessment where the test is personalized based on your performance as you take the test, making the test shorter, more accurate, more secure, more engaging, and fairer. If you do well, the items get more difficult, and if you do poorly, the items get easier. If an […]
Summative and formative assessment are a crucial component of the educational process. If you work in the educational assessment field or even in educational generally, you have probably encountered these terms. What do they mean? This post will explore the differences between summative and formative assessment. Assessment plays a crucial role in education, serving as […]
Situational judgment tests (SJTs) are a type of assessment typically used in a pre-employment context to assess candidates’ soft skills and decision-making abilities. As the name suggests, we are not trying to assess something like knowledge, but rather the judgments or likely behaviors of candidates in specific situations, such as an unruly customer. These tests […]
An assessment-based certificate (ABC) is a type of credential that is smaller and more focused than a Certification, License, or Degree. ABCs serve a distinct role in education and workforce development by providing a formal recognition of skills after a structured learning experience. An assessment-based certificate is typically based on an educational experience like an […]
