The process of generating challenging and appropriate distractors for multiple-choice questions is a complex and time-consuming task. Existing methods for an automated generation have limitations in proposing challenging distractors, or they fail to effectively filter out incorrect choices that closely resemble the correct answer, share synonymous…

When analyzing treatment effects on test scores, researchers face many choices and competing guidance for scoring tests and modeling results. This study examines the impact of scoring choices through simulation and an empirical application. Results show that estimates from multiple methods applied to the same data will vary because two-step models…

Research with school-age readers suggests that the contributions of reading and language skills vary across reading comprehension assessments and proficiency levels. With a sample of 168 struggling adult readers, we estimated the explanatory effects of decoding, oral vocabulary, listening comprehension, fluency, background knowledge, and…

Research with school-age readers suggests that the contributions of reading and language skills vary across reading comprehension assessments and proficiency levels. With a sample of 168 struggling adult readers, we estimated the explanatory effects of decoding, oral vocabulary, listening comprehension, fluency, background knowledge, and…

Background: Validity is a notable concept in language testing which has concerned many researchers and scholars in the field of language testing due to its importance in decision making process. Tests' results always introduce consequences to test takers' lives which emphasizes the need to ensure their validity. Detecting and delineating the…

A large body of work has demonstrated that reader resources influence inference processes and comprehension, but few models of comprehension have accounted for such resources. The Direct and Mediational Inference model of comprehension (DIME) assumes that general inference processes mediate the effects of reader resources on general comprehension…

A large body of work has demonstrated that reader resources influence inference processes and comprehension, but few models of comprehension have accounted for such resources. The Direct and Mediational Inference model of comprehension (DIME) assumes that general inference processes mediate the effects of reader resources on general comprehension…

Despite the critical role of emotions in multicultural teacher education, no attempt has been made to develop an instrument including affect as a dimension in measuring cultural competence for preservice teachers. To bridge this gap, the present three-study research used three distinct samples of 456 preservice teachers to develop and estimate the…

The report is the first systematic evaluation of the sentence equivalence item type introduced by the "GRE"® revised General Test. We adopt a validity framework to guide our investigation based on Kane's approach to validation whereby a hierarchy of inferences that should be documented to support score meaning and interpretation is…

Three experiments are presented that investigate the two-dimensional valence/trustworthiness by dominance model of social inferences from faces (Oosterhof & Todorov, 2008). Experiment 1 used image averaging and morphing techniques to demonstrate that consistent facial cues subserve a range of social inferences, even in a highly variable sample of…

The present article examines how suitable expository films are for learning. This question was motivated by the assumption that films are processed in a superficial manner. However, previous research has been dominated by the analyses of outcome measures and has never taken a look at online measures so that no clear conclusions have been drawn.…

Studies investigating individual differences in reading ability often involve data sets containing a large number of collinear predictors and a small number of observations. In this article, we discuss the method of Random Forests and demonstrate its suitability for addressing the statistical concerns raised by such data sets. The method is…

The argument-based approach to validation involves two steps; specification of the proposed interpretations and uses of the test scores as an interpretive argument, and the evaluation of the plausibility of the proposed interpretive argument. More ambitious interpretations and uses tend to involve an extended network of inferences and assumptions…

Regression equations have many useful roles in psychological assessment. Moreover, there is a large reservoir of published data that could be used to build regression equations; these equations could then be employed to test a wide variety of hypotheses concerning the functioning of individual cases. This resource is currently underused because…

This study introduces a co-twin control method commonly used in the medical literature but not often within educational research. This method allows for a comparison of twins discordant for an "exposure," approximating alternative outcomes in the counterfactual model. Example analyses use data drawn from the Florida Twin Project on…