A question bank refers to a pool of test questions to be used on various assessments across time. For example, a Certified Widgetmaker Exam might have a pool of 500 questions that have been developed over the past 10 years. Suppose the exam is delivered in June and December of every year, and each time […]
One misconception that I often see on the internet is the distinction, or lack thereof between the words psychometrician and psychometrist. While both work in the field of assessment, they are actually quite unrelated. This post describes how the two are different. The most flagrant offender, curiously, is Google. Like most companies, we utilize AdWords. […]
The Association of Test Publishers is holding their first ever EdTech and Computational Psychometrics Summit, December 3-4 2020. Due to the coronavirus situation, this of course will be fully virtual. (The 2021 primary ATP conference will be as well, which is a shame!) ASC has been invited to speak on a panel regarding artificial intelligence […]
The American Chiropractic Board of Sports Physicians™ (ACBSP™: acbsp.com) has partnered with Assessment Systems Corporation (ASC: assess.com) to advance the written testing procedure to a digitalized assessment model with secure remote proctoring for the Certified Chiropractic Sports Physician® (CCSP®) and Diplomate American Chiropractic Board of Sports Physicians® (DACBSP®) certifications. While this will provide the immediate benefit that […]
A core of any decent assessment program are strong item banks. Item banks are a central repository of test questions, each stored with important metadata such as Author or Difficulty. They are designed to treat items are re-usable objects, which makes it easier to publish new exam forms. Of course, the storage of metadata is […]
The COVID-19 Pandemic drastically changing all aspects of our world, and one of the most impacted areas is educational assessment and other types of assessment. Many organizations still delivered tests with methodologies from 50 years ago, such as putting 200 examinees in a large room with desks, paper exams, and a pencil. COVID-19 is forcing […]
This collusion detection (test cheating) index simply calculates the number of responses in common between a given pair of examinees. For example, both answered ‘B’ to a certain item regardless of whether it was correct or incorrect. There is no probabilistic evaluation that can be used to flag examinees. However, it could be of good […]
This extremely basic collusion detection index simply calculates the number of responses in common between a given pair of examinees. For example, suppose two examinees got 80/100 correct on a test. Of the 20 each got wrong, they had 10 in common. Of those, they gave the same wrong answer on 5 items. This means […]
This exam cheating index (collusion detection) simply calculates the number of errors in common between a given pair of examinees. For example, two examinees got 80/100 correct, meaning 20 errors, and they answered all of the same questions wrongly, the EIC would be 20. If they both scored 80/100 but had only 10 wrong questions […]
Harpp, Hogan, and Jennings (1996) revised their Response Similarity Index somewhat from Harpp and Hogan (1993). This produced a new equation for a statistic to detect collusion and other forms of exam cheating: where EEIC denote the number of exact errors in common or identically wrong, D is the number of items with a different […]
