
What is a question bank?
Psychometrics
A question bank refers to a pool of test questions to be used on various assessments across time. For example, a Certified Widgetmaker Exam might have a pool of 500 questions that have been developed over the past 10 years. Suppose the exam…

Psychometrician and Psychometrist: What's the difference?
Psychometrics
One misconception that I often see on the internet is the distinction, or lack thereof between the words psychometrician and psychometrist. While both work in the field of assessment, they are actually quite unrelated. This post describes…

ASC to speak at ATP’s first EdTech and Computational Psychometrics Summit
Psychometrics
The Association of Test Publishers is holding their first ever EdTech and Computational Psychometrics Summit, December 3-4 2020. Due to the coronavirus situation, this of course will be fully virtual. (The 2021 primary ATP conference will…

American Chiropractic Board of Sports Physicians™ Partners with Assessment Systems Corporation to Expand ACBSP Certification Access
Psychometrics
The American Chiropractic Board of Sports Physicians™ (ACBSP™: acbsp.com) has partnered with Assessment Systems Corporation (ASC: assess.com) to advance the written testing procedure to a digitalized assessment model with secure…

Item Banks: 6 Ways To Improve
Psychometrics
A core of any decent assessment program are strong item banks. Item banks are a central repository of test questions, each stored with important metadata such as Author or Difficulty. They are designed to treat items are re-usable objects,…

Tips to Improve Assessment Security During COVID-19
Psychometrics
The COVID-19 Pandemic drastically changing all aspects of our world, and one of the most impacted areas is educational assessment and other types of assessment. Many organizations still delivered tests with methodologies from 50 years ago,…

Responses in Common (RIC)
Psychometrics
This collusion detection (test cheating) index simply calculates the number of responses in common between a given pair of examinees. For example, both answered ‘B’ to a certain item regardless of whether it was correct or incorrect. …

Exact Errors in Common (EEIC) - Collusion Detection
Psychometrics
This extremely basic collusion detection index simply calculates the number of responses in common between a given pair of examinees. For example, suppose two examinees got 80/100 correct on a test. Of the 20 each got wrong, they had 10…

Errors in Common (EIC) exam cheating index
Psychometrics
This exam cheating index (collusion detection) simply calculates the number of errors in common between a given pair of examinees. For example, two examinees got 80/100 correct, meaning 20 errors, and they answered all of the same questions…

Harpp, Hogan, and Jennings (1996): Response Similarity Index
Psychometrics
Harpp, Hogan, and Jennings (1996) revised their Response Similarity Index somewhat from Harpp and Hogan (1993). This produced a new equation for a statistic to detect collusion and other forms of exam cheating:
where
EEIC denote…

Harpp and Hogan (1993) Response Similarity Index
Psychometrics
Harpp and Hogan (1993) suggested a response similarity index defined as
where
…

Bellezza & Bellezza (1989): Error Similarity Analysis
Psychometrics
This index evaluates error similarity analysis (ESA), namely estimating the probability that a given pair of examinees would have the same exact errors in common (EEIC), given the total number of errors they have in common (EIC) and the aggregated…