Nathan Thompson articles

Nathan Thompson earned his PhD in Psychometrics from the University of Minnesota, with a focus on computerized adaptive testing. His undergraduate degree was from Luther College with a triple major of Mathematics, Psychology, and Latin. He is primarily interested in the use of AI and software automation to augment and replace the work done by psychometricians, which has provided extensive experience in software design and programming. Dr. Thompson has published over 100 journal articles and conference presentations, but his favorite remains https://scholarworks.umass.edu/pare/vol16/iss1/1/ .
woman-taking-test
Desarrollo de pruebas

Flujo de trabajo de revisión de ítems para desarrollo de pruebas

La revisión de ítems es el proceso de garantizar que las preguntas de prueba recién escritas pasen por una rigurosa revisión por pares, para garantizar que sean de alta calidad y cumplan con los estándares

certification licensure exam laptop
CredentialingTest Development

Certification vs. Licensure Exams: Differences and Examples

Certification vs licensure refers to the organization that runs a credentialing exam, usually nonprofit vs government, and whether it is legally required. These are terms that are used quite frequently to refer to credentialing examinations

Equation editor item type
Uncategorized

¿Qué son los ítems mejorados tecnología?

Los ítems mejorados tecnología son ítems de evaluación (preguntas) que utilizan tecnología para mejorar la interacción de una pregunta de prueba en una evaluación digital, más allá de lo que es posible con el papel.

Woman thinking of careers with RIASEC assessment
Psychometrics

What is RIASEC Assessment? A tool to know yourself.

RIASEC assessment is type of personality assessment used to help individuals identify their career interests and strengths. Based on theory from John Holland, a renowned psychologist, this type of assessment is based on the premise

test response functions
Desarrollo de pruebasPsicometría

¿Qué es la Teoría de Respuesta al Ítem (TRÍ)?

La teoría de respuesta al ítem (TRÍ) es una familia de modelos de aprendizaje automático en el campo de la psicometría, que se utilizan para diseñar, analizar, validar y puntuar evaluaciones. Se trata de un

AI essay scoring process
CredentialingTest Security

Addressing Pre-Knowledge in Exam Cheating

In the realm of academic dishonesty and high-stakes exams such as Certification, the term “pre-knowledge” is an important concern in test security and validity. Understanding what pre-knowledge entails and its implications in exam cheating can

Test response function 10 items Angoff
CredentialingPsychometricsTest Development

Setting a Cutscore to Item Response Theory

Setting a cutscore on a test scored with item response theory (IRT) requires some psychometric knowledge.  This post will get you started. How do I set a cutscore with item response theory? There are two

Equation editor item type
EducationTest Development

What are technology enhanced items?

Technology-enhanced items are assessment items (questions) that utilize technology to improve the interaction of a test question in digital assessment, over and above what is possible with paper.  Tech-enhanced items can improve examinee engagement (important

modified-Angoff Beuk compromise
CredentialingPsychometricsTest Development

Modified-Angoff Method Study

A modified-Angoff method study is one of the most common ways to set a defensible cutscore on an exam.  It therefore means that the pass/fail decisions made by the test are more trustworthy than if

test response functions
PsychometricsTest Development

What is Item Response Theory (IRT)?

Item response theory (IRT) is a family of machine learning models in the field of psychometrics, which are used to design, analyze, validate, and score assessments.  It is a very powerful psychometric paradigm that revolutionized

laptop data graph
Psychometrics

Criterion-related validity

Criterion-related validity is evidence that test scores are related to other data which we expect them to be.  This is an essential part of the larger issue of test score validity, which is providing evidence

parcc ebsr items
EducationPsychometricsTest Development

Why PARCC EBSR Items Provide Bad Data

The Partnership for Assessment of Readiness for College and Careers (PARCC) is a consortium of US States working together to develop educational assessments aligned with the Common Core State Standards.  This is a daunting task,

test-scaling
CredentialingEducationPsychometricsTest Development

What is Test Scaling?

Scaling is a psychometric term regarding the establishment of a score metric for a test, and it often has two meanings. First, it involves defining the method to operationally scoring the test, establishing an underlying

certification exam development construction
CredentialingPsychometricsTest Development

How do I develop a good Certification Test that meets standards?

Certification test development refers to the process of building an exam in accordance to international standards like NCCA, then delivering it securely. It is a critical business need for credentialing organizations and awarding bodies. As

T scores
Test Development

What is a T score in Assessment?

A T Score is a conversion of scores on a test to a standardized scale with a mean of 50 and standard deviation of 10.  This is a common example of a scaled score in

Spearman-Brown
PsychometricsTest Development

What is the Spearman-Brown formula?

The Spearman-Brown formula, also known as the Spearman-Brown Prophecy Formula or Correction, is a method used in evaluating test reliability.  It is based on the idea that split-half reliability has better assumptions than coefficient alpha

item-writing-tips
PsychometricsTest Development

Item Writing: Tips for Authoring Test Questions

Item writing (aka item authoring) is a science as well as an art, and if you have done it, you know just how challenging it can be!  You are experts at what you do, and

validity threats
PsychometricsTest Development

Validity Threats and Psychometric Forensics

Validity threats are issues with a test or assessment that hinder the interpretations and use of scores, such as cheating, inappropriate use of scores, unfair preparation, or non-standardized delivery.  It is important to establish a

Previous Next