question bank

What is a question bank?

A question bank refers to a pool of test questions to be used on various assessments across time. For example, a Certified Widgetmaker Exam might have a pool of 500 questions that have been developed over the past 10 years. Suppose the exam…
psychometrician psychometrist

Psychometrician and Psychometrist: What's the difference?

One misconception that I often see on the internet is the distinction, or lack thereof between the words psychometrician and psychometrist. While both work in the field of assessment, they are actually quite unrelated. This post describes…
AI assessment brain

ASC to speak at ATP’s first EdTech and Computational Psychometrics Summit

The Association of Test Publishers is holding their first ever EdTech and Computational Psychometrics Summit, December 3-4 2020. Due to the coronavirus situation, this of course will be fully virtual. (The 2021 primary ATP conference will…
healthcare certification

American Chiropractic Board of Sports Physicians™ Partners with Assessment Systems Corporation to Expand ACBSP Certification Access

The American Chiropractic Board of Sports Physicians™ (ACBSP™: acbsp.com) has partnered with Assessment Systems Corporation (ASC: assess.com) to advance the written testing procedure to a digitalized assessment model with secure…
Item-review-kanban

Item Banks: 6 Ways To Improve

A core of any decent assessment program are strong item banks. Item banks are a central repository of test questions, each stored with important metadata such as Author or Difficulty. They are designed to treat items are re-usable objects,…

Tips to Improve Assessment Security During COVID-19

The COVID-19 Pandemic drastically changing all aspects of our world, and one of the most impacted areas is educational assessment and other types of assessment. Many organizations still delivered tests with methodologies from 50 years ago,…

Responses in Common (RIC)

This collusion detection (test cheating) index simply calculates the number of responses in common between a given pair of examinees.  For example, both answered ‘B’ to a certain item regardless of whether it was correct or incorrect. …
psychometric forensics, conference on test security, data forensics, test fraud

Exact Errors in Common (EEIC) - Collusion Detection

This extremely basic collusion detection index simply calculates the number of responses in common between a given pair of examinees.  For example, suppose two examinees got 80/100 correct on a test. Of the 20 each got wrong, they had 10…
item distractor students

Errors in Common (EIC) exam cheating index

This exam cheating index (collusion detection) simply calculates the number of errors in common between a given pair of examinees.  For example, two examinees got 80/100 correct, meaning 20 errors, and they answered all of the same questions…
response similarity index

Harpp, Hogan, and Jennings (1996): Response Similarity Index

Harpp, Hogan, and Jennings (1996) revised their Response Similarity Index somewhat from Harpp and Hogan (1993). This produced a new equation for a statistic to detect collusion and other forms of exam cheating: where EEIC denote…
Harpp Hogan

Harpp and Hogan (1993) Response Similarity Index

Harpp and Hogan (1993) suggested a response similarity index defined as                                                                                 where …
bellezza error similarity

Bellezza & Bellezza (1989): Error Similarity Analysis

This index evaluates error similarity analysis (ESA), namely estimating the probability that a given pair of examinees would have the same exact errors in common (EEIC), given the total number of errors they have in common (EIC) and the aggregated…