The process of generating challenging and appropriate distractors for multiple-choice questions is a complex and time-consuming task. Existing methods for an automated generation have limitations in proposing challenging distractors, or they fail to effectively filter out incorrect choices that closely resemble the correct answer, share synonymous…

The Predict-Observe-Explain (POE) learning cycle improves understanding of the connection between empirical results and theoretical concepts when students engage in hands-on experimentation. This study explored whether training students to use a POE strategy when learning from social science texts that describe theories and experimental results…

This paper explores the impact on teachers' self-efficacy to teach statistics from a graduate course aimed to develop teachers' knowledge of inferential statistics through engaging in data analysis using technology. This study uses qualitative and quantitative data from the Self-Efficacy to Teach Statistics Survey (Harrell-Williams et al., 2013)…

Previous studies on dictionary consultation investigated mainly online dictionaries or simple pocket electronic dictionaries as they were commonly used among learners back then, yet the more updated mobile dictionaries were superficially investigated though they have already replaced the pocket electronic dictionaries. These studies are also…

Policymakers and school administrators have embraced value-added models of teacher effectiveness as tools for educational improvement. Teacher value-added estimates may be viewed as complicated scores of a certain kind. This suggests using a test validation model to examine their reliability and validity. Validation begins with an interpretive…

In recent years, the educational data mining and user modeling communities have been aggressively introducing models for predicting student performance on external measures such as standardized tests as well as within-tutor performance. While these models have brought statistically reliable improvement to performance prediction, the real world…

The argument-based approach to validation involves two steps; specification of the proposed interpretations and uses of the test scores as an interpretive argument, and the evaluation of the plausibility of the proposed interpretive argument. More ambitious interpretations and uses tend to involve an extended network of inferences and assumptions…

This paper explores the historical evolution of views of score validity beginning with J. Guilford (1946) and ending with the writings of L. Cronbach (1989), S. Messick (1989), M. Kane (1992), P. Moss (1992), and L. Shepard (1993). Current treatments of validity have emphasized that it is the inferences made from scores, and not tests, that are…

Approaches for norming skewed test score distributions are reviewed, and an analytical approach is proposed for norming the Behavior Assessment System for Children (BASC). Methods used in constructing norms for several well-known personality instruments that are reviewed include: (1) linear T-scores transformation in the Minnesota Multiphasic…

The clinical inference process in test interpretation is described so that people can more easily communicate about it, teach it, and learn it. Chapter 1 compares different levels (concrete, mechanical, and individualized) of interpretation of the same test. Chapter 2 offers examples of an often-neglected kind of data necessary for individualized…

In contrast to multiple choice, alternative modes of assessment afford varying degrees of openness in the allowable responses. Prominent among the alternatives is the assessment of performance, sometimes in its own right where the issue is the quality of the particular performance per se, but more often as a vehicle for the assessment of…

Possible interpretive arguments for licensure and certification test scores are examined, and evidence to support each type of argument is analyzed. Particular attention is given to a competency-based argument that involves a sequence of inferences from test scores to statements about competence and then to conclusions about expected performance.…