Psychometrics

factor analysis
PsychometricsTest Development

Factor Analysis: Evaluating Dimensionality in Assessment

Factor analysis is a statistical technique widely used in research to understand and evaluate the underlying structure of assessment data. In fields such as education, psychology, and medicine, this approach to unsupervised machine learning helps

Test response function 10 items Angoff
CredentialingPsychometricsTest Development

Setting a Cutscore to Item Response Theory

Setting a cutscore on a test scored with item response theory (IRT) requires some psychometric knowledge.  This post will get you started. How do I set a cutscore with item response theory? There are two

modified-Angoff Beuk compromise
CredentialingPsychometricsTest Development

Modified-Angoff Method Study

A modified-Angoff method study is one of the most common ways to set a defensible cutscore on an exam.  It therefore means that the pass/fail decisions made by the test are more trustworthy than if

test response functions
PsychometricsTest Development

What is Item Response Theory (IRT)?

Item response theory (IRT) is a family of machine learning models in the field of psychometrics, which are used to design, analyze, validate, and score assessments.  It is a very powerful psychometric paradigm that allows

laptop data graph
Psychometrics

Criterion-related validity

Criterion-related validity is evidence that test scores are related to other data which we expect them to be.  This is an essential part of the larger issue of test score validity, which is providing evidence

students-taking-digital-test
Psychometrics

What is Digital Assessment, aka e-Assessment?

Digital assessment (DA) aka e-Assessment or electronic assessment is the delivery of assessments, tests, surveys, and other measures via digital devices such as computers, tablets, and mobile phones.  The primary goal is to be able

job task analysis workshop
Human ResourcesPsychometrics

Navigating Leadership Assessments: A Science-Backed Approach

Leadership assessments are more than just tools; they are crucial to identifying and developing effective organizational leadership. Plenty of options exist for “leadership assessments,” from off-the-shelf tools costing $15 to the incredible bespoke, intense, and,

parcc ebsr items
EducationPsychometricsTest Development

Why PARCC EBSR Items Provide Bad Data

The Partnership for Assessment of Readiness for College and Careers (PARCC) is a consortium of US States working together to develop educational assessments aligned with the Common Core State Standards.  This is a daunting task,

test-scaling
CredentialingEducationPsychometricsTest Development

What is Test Scaling?

Scaling is a psychometric term regarding the establishment of a score metric for a test, and it often has two meanings. First, it involves defining the method to operationally scoring the test, establishing an underlying

certification exam development construction
CredentialingPsychometricsTest Development

Certification Exam Development and Delivery

Certification exams are a critical component of workforce development for many professions and play a significant role in the global Testing, Inspection, and Certification (TIC) market, which was valued at approximately $359.35 billion in 2022

Spearman-Brown
PsychometricsTest Development

What is the Spearman-Brown formula?

The Spearman-Brown formula, also known as the Spearman-Brown Prophecy Formula or Correction, is a method used in evaluating test reliability.  It is based on the idea that split-half reliability has better assumptions than coefficient alpha

item-writing-tips
PsychometricsTest Development

Item Writing: Tips for Authoring Test Questions

Item writing (aka item authoring) is a science as well as an art, and if you have done it, you know just how challenging it can be!  You are experts at what you do, and

validity threats
PsychometricsTest Development

Validity Threats and Psychometric Forensics

Validity threats are issues with a test or assessment that hinder the interpretations and use of scores, such as cheating, inappropriate use of scores, unfair preparation, or non-standardized delivery.  It is important to establish a

Likert scale meme
Psychometrics

Likert Scale Items

Likert scales (items) are a type of item used in human psychoeducational assessment, primarily to assess noncognitive constructs.  That is, while item types like multiple choice or short answer are used to measure knowledge or

test blueprints specifications
Psychometrics

Test Blueprints & Specifications

Test blueprints, aka test specifications (shortened to “test specs”), are the formalized design of an assessment, test, or exam.  This can be in the context of educational assessment, pre-employment, certification, licensure, or any other type. 

test publishing quality control
Psychometrics

Test Publishing Quality Control

Test publishing is the process of preparing computer-based assessments for delivery on an electronic platform. Test publishing is like a car rolling off the assembly line. It’s the culmination of a great deal of effort

student-testlet
Psychometrics

What is a testlet?

Testlet is a term in educational assessment that refers to a set of test items or questions grouped together on a test, often with a common theme or scenario. This approach aims to provide a

job-task-analysis
PsychometricsTest Development

What is Job Task Analysis for Certification?

Job Task Analysis (JTA) is an essential step in designing a test to be used in the workforce, such as pre-employment or certification/licensure, by analyzing data on what is actually being done in the job. 

Previous Next