Iteman: Automated Test & Item Analysis with Classical Test Theory

Iteman automates a psychometrician’s work for test and item analysis: Build a comprehensive psychometric tech report in Word with graphics, tables, and narratives… in seconds! Automatically flag questions that are too hard or confusing, and dig in to diagnose with easy-to-read graphs.

Prefer to hire a pro to analyze your data? Get in touch!

Talk to an expert

How does Iteman help your organization improve exams?

Save Money

Why pay a consultant $5000 to make this report for you? For every test?

User-Friendly UI

A friendly UI – no command code! Designed to make psychometrics accessible to anyone.

Easy-to-read Output

Output is a Word file with embedded tables, graphics, and narratives. No more ASCII!

Increase Reliability

Flag items that do not meet standards, diagnose with detailed option statistics, discuss with your SMEs.

What is Iteman?

Iteman is a software platform for automated psychometric reporting (test and item analysis) with classical test theory. What does that mean? It means that the software doesn’t just calculate statistics – it automatically builds you a tech report in MS Word, potentially hundreds of pages, with embedded narratives, graphs, and tables like you see here. You can take the item analysis pages and share them on your screen to discuss with the content experts.

Ready for the next step in psychometric technology? Start using item response theory, the modern psychometric paradigm, by downloading Xcalibre for free.

Learn about Xcalibre and IRT

Designed to help more practitioners implement Item Response Theory

Iteman comes as a free version with full functionality but a limit to 100 students and 100 items. This is perfect for teaching or learning classical test theory as well as real-world application to many smaller-scale tests. The allows you to get going with the program immediately and start improving your assessments by flagging items that do not meet best practices. The free version is governed by our terms of use.

Not quite ready for the complexity of a professional system like Iteman? Try CITAS first, it is nothing more than an Excel spreadsheet that automatically populates the most important psychometric statistics.

Learn about CITAS

I’m very pleased with ASC’s analysis platform. The ability to run both CTT and IRT methods makes for a versatile system. Easily adjustable performance groupings, differential item functions, and integrated item flagging are my favorite options. Randomized item data, non-scoring items, and items with multiple key responses are easy to control. Output reports feature customized analysis which create high-quality, thorough analysis reports. I appreciate the excellent customer service ranging from a live system demonstration to prompt email responses. ASC’s technical support is noteworthy as it offers a user-friendly technical manual which includes sample data and control files. Well done, ASC!

Tina Koepf, PhD

Psychometrician, Nocti Business Solutions

Diagnose items with easy-to-read output

Iteman provides a straightforward UI for you to specify your input files and types of classical test and item analysis you want to do.

Differential item functioning
Mastery (cutscore) analysis
Scaled scoring
Automated flagging of poorly performing items
Collusion (cheating) analysis
Reliability & SEM analysisDescriptive statistics (mean, SD, Mean P, Mean Rpbis)
Item statistics such as P and Rpbis
Distractor analysis with option statistics

How do I interpret Iteman output?

Instead of producing output as ASCII text from the 1980s, Iteman produces a full narrative report in Microsoft Word. You can then use this as the starting point draft for your own report, saving you many hours of effort.

The program produces extensive test-level output regarding the examinee scores, including 7 estimates of reliability, complete analysis of domains (content areas), frequency distributions of scores, subscores, and statistics, and CSEM.

However, the majority of the report is item-by-item results using classical test theory like you see here, presented in detailed tables with a quantile plot for each item. Simply paste in item texts, and you have a comprehensive report ready for item reviewers!

Testing companies charging up to $10,000 to run this report for you – you can now produce these reports yourself for a fraction of the cost!