psychometric forensics, conference on test security, data forensics, test fraud

Last week, I had the opportunity to attend the 2017 Conference on Test Security (COTS), hosted by the University of Wisconsin-Madison.  If your organization has any concerns about test security (that is, you have any sort of real stakes tied to your test!), I recommend that you attend COTS.  It has a great mix of psychometric research with practical discussions such as policies and procedures.  While it was originally titled “Conference on Statistical Detection of Test Fraud” it has since expanded its scope and thankfully reduced the number of syllables in the name.

The venue was the Pyle Center on the shores of Lake Mendota, just one block from the famous State Street.  Madison is a beautiful city, situated on an isthmus between two large lakes; great for visuals but not so great for traffic patterns.  The location was incredibly convenient for me, as it is driving distance from my home in Minnesota, and allowed me to stay with my family in nearby Watertown, watch my brother coach a high school football game in Columbus, and stop at the CamRock mountain bike trails that I’ve always wanted to try (highly recommend!).

One highlight of the conference was the chance to present with my friend, former colleague, and graduate school office-mate Jennifer Davis from the National Association of Boards of Pharmacy.  We compared three software programs for psychometric forensics: SIFT, CopyDetect, and Outlier Detection Tool.  SIFT and CopyDetect both provide several collusion indices, but SIFT provides more and is incredibly faster (CopyDetect took 2 hours to run 134 examinees).  The Outlier Detection Tool is an internal spreadsheet used by NABP that serves a slightly different purpose; for more information, contact them.

The best part of the Conference on Test Security, just like the IACAT conference I just attended, was the chance to spend time with old friends that I only see once every year or two, as well as make new friends such as a researcher from ASC’s partner Ascend Learning.  In fact, I didn’t even get a chance to attend any sessions on the second day, I instead spent the time talking to colleagues.

Biggest disappointment?  I didn’t hang around until Saturday to attend the Badger game and join the traditional “Jump Around!”

The following two tabs change content below.

nthompson

Nathan Thompson earned his PhD in Psychometrics from the University of Minnesota, with a focus on computerized adaptive testing. His undergraduate degree was from Luther College with a triple major of Mathematics, Psychology, and Latin. He is primarily interested in the use of AI and software automation to augment and replace the work done by psychometricians, which has provided extensive experience in software design and programming. Dr. Thompson has published over 100 journal articles and conference presentations, but his favorite remains https://pareonline.net/getvn.asp?v=16&n=1.

Latest posts by nthompson (see all)