Further Issues in Effect Size Estimation for One-Sample Multiple-Choice-Type Data

Abstract

This article discusses models underlying the use of 1-sample effect size indicators that permit the comparison of effect sizes obtained from different multiple-choice studies by indexing all studies to the results that would have been obtained if there had been only 2 choices. The effect size indicator, the proportion index, (II), is based on a model implying that the probability of knowing a correct response will decrease as more incorrect choices are offered. For specific applications other models may be more appropriate but, for most applications they have encountered, the authors prefer and recommend their model.