Application of Asymmetric IRT Modeling to Discrete-Option Multiple-Choice Test Items

• Main Authors: Daniel M. Bolt, Sora Lee, James Wollack, Carol Eckerly, John Sowles
• Format: Article
• Language: English
• Published: Frontiers Media S.A. 2018-11-01
• Series: Frontiers in Psychology
• Subjects: item response theory (IRT); computerized testing; multiple-choice; latent ability estimates; Samejima's logistic positive exponent (LPE) model
• Online Access: https://www.frontiersin.org/article/10.3389/fpsyg.2018.02175/full

Asymmetric IRT models have been shown useful for capturing heterogeneity in the number of latent subprocesses underlying educational test items (Lee and Bolt, 2018a). One potentially useful practical application of such models is toward the scoring of discrete-option multiple-choice (DOMC) items. Under the DOMC format, response options are independently and randomly administered up to the (last) keyed response, and thus the scheduled number of distractor response options to which an examinee may be exposed (and consequently the overall difficulty of the item) can vary. In this paper we demonstrate the applicability of Samejima's logistic positive exponent (LPE) model to response data from an information technology certification test administered using the DOMC format, and discuss its advantages relative to a two-parameter logistic (2PL) model in addressing such effects. Application of the LPE in the context of DOMC items is shown to (1) provide reduced complexity and a superior comparative fit relative to the 2PL, and (2) yield a latent metric with reduced shrinkage at high proficiency levels. The results support the potential use of the LPE as a basis for scoring DOMC items so as to account for effects related to key location.