Question Banks: An Introduction
What is a question bank? A question bank refers to a pool of test questions to be used on various assessments across time. For example, a Certified Widgetmaker Exam might have a pool of 500 questions developed over the past 10 years. Suppose the exam is delivered in June and December of every year, and each time 150 questions are used. This strong pool of items allows the organization to easily select questions and publish a new form of the exam each time, maintaining security and validity.
A question bank is more commonly called an item bank. It is due to the fact that the term ‘question’ is not often used because many assessment items are not actually questions; they might be statements, vignettes, simulations, or many things other than the traditional question-and-4-answers. It is important to regularly review the item bank to identify and address any ‘enemy items,’ which are items that might negatively impact the test’s reliability and fairness.
What goes into a question bank? Metadata.
A question bank is actually much more than the questions themselves. If you ran the Certified Widgetmaker Exam, you would want to keep track of some additional important information. This is all based on the concept of treating the question as a reusable object; if you use the item 4 times, you should never need to type/upload it 4 times. It should be in the system only once, with all its associated metadata!
| What to track | Examples |
|---|---|
| Which exam forms used each question | Dec 2017, May 2018, May 2019, Dec 2020 |
| Unique item ID | Math.Algebra.078 |
| Source/Reference | Wilson (2016) p. 123 |
| Status | New, Under Review, Active, Retired |
| Statistics | Classical difficulty and discrimination: Item response theory parameters |
| Reviewer comments | Jake Smith 2020/11/22: “I think that D is arguably correct, and we need to provide greater detail in the stem.” |
| Content area, domain, blueprint | Math / Algebra / Quadratic |
The Solution: Question Banking Software
As you can see, there’s actually quite a bit of functionality and data that goes into a true question bank system. And this is only regarding the questions themselves – it doesn’t get into additional topics such as media file management, Workflow Management, Automated Item Generation, or Test Assembly & Publishing. A professional question banking software system will have much, much more than just a way to store the questions. FastTest provides a powerful alternative solution to some older platforms on the market.
Looking for a deeper treatment of the topic? Check out the chapter Computerized Item Banking by ASC’s cofounder, C. David Vale, in the 2006 Handbook of Test Development.
Want to learn more about how question banking software can help your organization? Click here, check out this other post, or fill out our contact form for a demonstration.
Nathan Thompson, PhD
Latest posts by Nathan Thompson, PhD (see all)
- What is an Assessment-Based Certificate? - October 12, 2024
- What is Psychometrics? How does it improve assessment? - October 12, 2024
- What is RIASEC Assessment? - September 29, 2024
