Feedback is a powerful instructional tool for motivating learning. But effective feedback, requires that instructors have accurate information about their students' current knowledge status and their learning progress. In modern educational measurement, two major theoretical perspectives on student ability and proficiency can be distinguished.…

With the online assessment becoming mainstream and the recording of response times becoming straightforward, the importance of response times as a measure of psychological constructs has been recognized and the literature of modeling times has been growing during the last few decades. Previous studies have tried to formulate models and theories to…

This dissertation is comprised of three papers that propose and apply psychometric models to deal with complexities and challenges in large-scale assessments, focusing on modeling rater effects and complex learning progressions. In particular, three papers investigate extensions and applications of multilevel and multidimensional item response…

Item-level information, such as difficulty and discrimination are invaluable to the test assembly, equating, and scoring practices. Estimating these parameters within the context of large-scale performance assessments is often hindered by the use of unbalanced designs for assigning examinees to tasks and raters because such designs result in very…

Digital games offer an appealing environment for assessing student proficiencies, including skills and misconceptions in a diagnostic setting. This paper proposes a dynamic Bayesian network modeling approach for observations of student performance from an educational video game. A Bayesian approach to model construction, calibration, and use in…

This paper reports the findings of an exploratory study concerning the development of higher-order conceptual understanding of Teaching Games for Understanding (TGfU) among physical education pre-service teachers. The development of such understandings has been seen as problematic among pre-service teachers (Randall, 2003). An analysis of the…

To reveal what is being learned during the gaming experience, this report proposes an approach for embedding assessments in immersive games, drawing on recent advances in assessment design. Key to this approach are formative assessment to guide instructional experiences and evidence-centered design to systematically analyze the assessment argument…

Debate about the levels-setting process for criterion-referenced tests of achievement is reviewed. An alternative framework is proposed for conceptualizing the problem and practice of setting performance standards on such tests. Standard setting is reconceptualized as the development, description, and implementation of reasonable rules for…

Explores the relationship between measurement theory and practice, considering five broad categories of: (1) models, assumptions, and terminology; (2) reliability; (3) validity; (4) scaling; and (5) setting performance standards. It must be recognized that measurement is not an end in itself. (SLD)

In a previous paper the authors presented a model of assessing portfolios, the Cognitive Model for Assessing Portfolios (CMAP), as a lens to view, think about, and make decisions about portfolio projects. Two projects in which the CMAP has been used are described. One is an authentic assessment project in mathematics and science by the Educational…