Automate a psychometrician’s work for CTT item analysis: Build a comprehensive psychometric tech report in Word with graphics, tables, and narratives… in seconds! Automatically flag questions that are too hard or confusing, and dig in to diagnose with easy-to-read graphs.
Iteman™ empowers more organizations to implement best practices in Psychometrics. It uses the concepts of AI and automation to replace the time of a psychometrician to perform a classical test and item analysis – from multiple reliability indices to distractor analysis.
What is Iteman?
Iteman is a software platform for automated psychometric reporting (test and item analysis) with classical test theory. What does that mean? It means that the software doesn’t just calculate statistics – it automatically builds you a tech report in MS Word, potentially hundreds of pages, with embedded narratives, graphs, and tables like you see here. You can take the item analysis pages and share them on your screen to discuss with the content experts.
Stronger Psychometrics: Item Response Theory
Download the free version: start improving your tests today
The free version provides an account with full functionality but a limit to 100 students and 100 items. This is perfect for teaching or learning classical test theory as well as real-world application to many smaller-scale tests.
The free version allows you to get going with the program immediately and start improving your assessments by flagging items that do not meet best practices.
How can Iteman™ help your organization?
Why pay a consultant $5000 to make this report for you? For every test?
A friendly UI – no command code! Designed to make psychometrics accessible to anyone.
Output is a Word file with embedded tables, graphics, and narratives. No more ASCII!
Flag items that do not meet standards and diagnose with detailed option statistics.
I’m very pleased with ASC’s analysis platform. The ability to run both CTT and IRT methods makes for a versatile system. Easily adjustable performance groupings, differential item functions, and integrated item flagging are my favorite options. Randomized item data, non-scoring items, and items with multiple key responses are easy to control. Output reports feature customized analysis which create high-quality, thorough analysis reports. I appreciate the excellent customer service ranging from a live system demonstration to prompt email responses. Assess’s technical support is noteworthy as it offers a user-friendly technical manual which includes sample data and control files. Well done, Assess.ai!
You can upgrade your free license to a premium license at any time; contact us for more information.
What does Iteman™ look like?
Iteman provides a straightforward UI for you to specify your input files and types of classical test and item analysis you want to do. As you can see in the video, instead of having to write command code, you simply click on the options you need:
- Differential item functioning
- Mastery (cutscore) analysis
- Scaled scoring
- Automated flagging of poorly performing items
- Collusion (cheating) analysis
Of course, Iteman provides all of the standard results from CTT analysis, out of the box without you needing to check some boxes:
- Reliability & SEM analysis
- Descriptive statistics (mean, SD, Mean P, Mean Rpbis)
- Total score vs subscores (domains/areas) histograms
- Item statistics such as P and Rpbis
- Distractor analysis (option P, Rpbis, etc)
- Decision consistency
What does Iteman™ output look like?
Instead of producing output as ASCII text from the 1980s, Iteman produces a full narrative report in Microsoft Word. You can then use this as the starting point draft for your own report, saving you many hours of effort.
The program produces extensive test-level output regarding the examinee scores, including 7 estimates of reliability, complete analysis of domains (content areas), frequency distributions of scores, subscores, and statistics, and CSEM.
However, the majority of the report is item-by-item results using classical test theory like you see here, presented in detailed tables with a quantile plot for each item. Simply paste in item texts, and you have a comprehensive report ready for item reviewers!
A number of large testing companies use Iteman™ to produce reports for clients, charging up to $5,000 each time – you can now produce these reports yourself for a fraction of the cost!