What do we mean by “scalable test security?”
We mean that you can use a single assessment platform to deliver all types of examinations with a range of stakes: unproctored practice tests to educational benchmark tests to high stakes tests like professional certification or university admissions.
How is this done? Our platform build all the options you need into the test delivery configuration. You pick the various aspects that make sense for you, with a straightforward user interface – no paying expensive publishing fees to us!
The scalable test security can be divided into two aspects: control of the delivery/psychometrics, and control of the test-taker’s environment.
Control of Delivery/Psychometrics
Randomized item sequence
Tests delivered in FastTest and Assess.ai have the option to randomize the order of items for every examinee. So even though all examinees might see the same 100 items, the sequence will be very different.
Randomized option sequence
Tests delivered in FastTest and Assess.ai have the option to randomize the order of answers for multiple choice questions, which makes them look different to examinees.
Linear on the fly testing (LOFT)
LOFT refers to exams that are built uniquely for each examinee, but equivalently. For example, you might have a pool of 200 items, and each examinee receives 100. Rather than selecting at random, you have the option to ensure there is content balancing, so that perhaps each examinee might receive 20 items from each of 5 content areas.
Computerized adaptive testing (CAT)
CAT is a modern assessment paradigm where each test is uniquely designed for each examinee, by adapting the difficulty to their ability. Because each test is unique, the security is greatly enhanced. Moreover, CAT tests are 50% shorter on average, which greatly reduces item exposure in an aggregate sense. There are a number of other advantages; however, CAT is only relevant for large testing programs, typically 1,000 or more per year, because it requires substantial investment and the use of a psychometric approach called item response theory (IRT).