The four-parameter logistic item response theory model as a robust method of estimating ability despite aberrant responses

• Wen-Wei Liao

  National Taiwan Normal University

• Rong-Guey Ho

  National Taiwan Normal University

• Yung-Chin Yen

  National Taiwan Normal University

• Hsu-Chen Cheng

  Chinese Culture University

In computerized adaptive testing (CAT), aberrant responses such as careless errors and lucky guesses may cause significant ability estimation biases in the dynamic administration of test items. We investigated the robustness of the 4-parameter logistic item response theory (4PL IRT; Barton & Lord, 1981) model in comparison with the 3-parameter logistic (3PL) IRT model (Birnbaum, 1968). We applied additional precision and efficiency measures to evaluate the 4PL IRT model. We measured the precision of CAT with respect to the estimation bias and mean absolute differences (MAD) between estimated and actual abilities. An improvement in administrative efficiency is reflected in fewer items being required for satisfying the stopping rule. Our results indicate that the 4PL IRT model provides a more efficient and robust ability estimation than the 3PL model.

1. Wen-Wei Liao, National Taiwan Normal University

   Graduate Institute of Information and Computer Education

2. Rong-Guey Ho, National Taiwan Normal University

   Graduate Institute of Information and Computer Education

3. Yung-Chin Yen, National Taiwan Normal University

   Graduate Institute of Information and Computer Education

4. Hsu-Chen Cheng, Chinese Culture University
   Department of Information and Management

• PDF
  (USD 29)