Learn more about the intersection of psychometrics and technology

Improve the quality of your tests and development processes with these whitepapers from industry-leading experts. Interested in applying some of our expertise directly? Simply contact us – we can help!

WhitePapers

Assessment, Psychometrics, and Technology: State of the Art

This paper discusses some of the ways that technology is currently impacting how we tackle psychometric issues, and the field of assessment in general.  It also discusses how Artificial Intelligence will start impacting what we do (2018).

Advantages of Computerized Adaptive Testing (CAT)

CAT is the test delivery approach of the 21st century, utilizing intelligent algorithms to tailor the test optimally for each examinee.  CAT will reduce testing time and increase security.  This paper discusses the advantages and disadvantages of CAT.

Requirements of Computerized Adaptive Testing (CAT)

CATs have many benefits, including cutting testing time in half, but require experienced psychometricians, extensive pilot samples, and specialized software. This paper provides an overview of what is needed before your organization can consider adaptive testing.

Reliability and Validity

This is a brief introduction to the topics of reliability and validity – the two core concepts of psychometrics – and how they relate to assessment, particularly certification testing.

Financial Advantages of Computer-Based Testing

When testing large volumes of examinees, delivering tests on computer will deliver substantial financial benefits, assuming that you have infrastructure already in place.

Assessment with Learning Management Systems (LMSs)

LMSs typically include rudimentary functionality for quizzes and exams. However, because they are designed for eLearning and course management, the testing functionality is extremely limited. This paper explains why systems actually designed for assessment should be used for assessment.

Item Writing and Review Manual

The basic building block of a good test is good items. There’s a lot that goes into this.  Here is an abbreviated copy of the manual that we use to train item writers, guide assessment organizations, and provide expert item review to ensure quality.

Developing An Accredited Certification

Developing an accredited certification program is no easy feat, requiring at least a year of effort from a team of experts and tens (often hundreds) of thousands of dollars. This whitepaper will explore the proper steps an organization needs to take in order to receive accreditation.

Computerized Adaptive Testing & eLearning

This paper discusses the modern approach to personalized assessment – computerized adaptive testing – and how it can impact eLearning and Distance Learning. The melding of these two topics was later terms “Computational Psychometrics.”

Item Banking, Test Development, and Test Delivery

This forthcoming chapter in the 2011 APA Handbook on Testing and Assessment discusses item banking as a foundation for efficient and effective test creation, covering processes from initial development to delivery. The text emphasizes how item banking supports modern psychometric practices and adaptive testing frameworks.

Item Response Theory (IRT) Software

This technical report by Wang (2018) examines the variability in results produced by different IRT software packages, emphasizing the impact of software selection on psychometric outcomes. It provides guidance for researchers and practitioners on selecting the right tools for their testing needs.

A Framework for the Development of Computerized Adaptive Tests

Thompson and Weiss (2011) present a structured approach to designing computerized adaptive tests. The article integrates psychometric theory with practical considerations, providing insights into adaptive testing’s benefits and challenges.

Ability Estimation with Item Response Theory (IRT)

This 2009 work by Thompson offers an accessible explanation of ability estimation within the IRT framework. It serves as a practical guide for interpreting and applying IRT in educational and professional testing scenarios.

Classical Item and Test Analysis with CITAS

Thompson (2009) introduces CITAS, a tool for performing classical test theory (CTT) analysis. The guide emphasizes the role of CTT in understanding item quality and test performance, particularly in non-IRT contexts.

A Practitioner’s Guide for Variable-Length Computerized Classification Testing

This 2007 article by Thompson provides a practical framework for implementing variable-length computerized classification tests (VL-CCTs). Thompson highlights the efficiency and flexibility of VL-CCTs for categorizing test-takers with precision.

Design and Implementation of a Microcomputer-Based Adaptive Testing System

Vale (1981) explores the early design and development of adaptive testing systems on microcomputers. This foundational article illustrates the technical and practical considerations for adaptive testing technology, influencing its modern evolution.