Menu
Menu
Our psychometricians will help you navigate the test development process, from job analysis to item development to statistical reports. We pride ourselves in providing sound advice in an easy-to-understand manner.
Use a scientific, data-driven approach to decide what a test should cover; survey job incumbents and statistically transform into blueprints
Train subject matter experts (SMEs) in how to write fair, effective test questions, and implement a quality assurance process
It is not defensible just pick a nice round cutscore like 70%. You need a scientific, data-driven approach to this.
There are several quantitative steps, including Equating, Test Assembly, and Psychometric Reports.
The Test Development Cycle is the industry best practice in how to develop a good assessment. It is governed by international standards such as NCCA or APA/AERA/NCME. It can be customized per assessment based on practical constraints such as whether you can Pilot Test your items before release, but the general approach remains the same.
Our team of psychometricians will help you define the best approach, and then implement. We can help with job analysis studies to define the blueprints, item writer training, item bank management, standard setting (cutscore) studies, to annual statistical reports.
Validity is the evidence you have that interpretations you make from your test scores are valid. For example, if you are certifying florists, the test will cover content that is actually important to being a florist, and that the cutscore is at an appropriate level. Reliability means that the scores are consistent on the test; you don’t want a random number generator! Here is an article on the two terms.
The validity of a test score is supported, in a large part, by appropriate use of the test development cycle, the strength of the connections between the different steps of the cycle, and your documentation of the process. We tailor both our consulting services and software platforms around helping you implement these industry standards. We can also help you achieve accreditation.
Want to learn more about the test development cycle and how it impacts Certification exams in particular? Download this whitepaper.
