Assessment is usually considered as an afterthought in the instructional design process. Given the many challenges of assessment design--and the lack of ready solutions--teachers may fall back on familiar forms of assessments and hope for the best. As a result, the problem is not a lack of will on the part of teachers. Instead, it is the lack of…

This report characterizes forms of dialogic support that a sixth-grade teacher generated during whole-class and small-group conversations to help students develop a practice of statistical modeling. During four weeks of instruction, students constructed and revised models to account for variability and uncertainty across a variety of random…

Methods to handle ordered-categorical indicators in latent variable interactions have been developed, yet they have not been widely applied. This article compares the performance of two popular latent variable interaction modeling approaches in handling ordered-categorical indicators: unconstrained product indicator (UPI) and latent moderated…

Though there is an extensive research literature on understanding and assessing individual modeling competencies, less attention has been given to characterizing the social context of the classroom in which modeling occurs. Yet a classroom's culture of modeling--its negotiated system of beliefs and values about the nature of modeling and what…

Existing research on "school effectiveness" indicates that differences at the school level contribute significantly towards variation in student outcomes; however, less is known about the effectiveness of schooling in low- and middle-income countries (LMICs). This paper addresses this gap using quantitative analysis of data from two…

Models and modeling are central to both scientific literacy and practices as demonstrated by the Next Generation Science Standards. Through a design-based research framework, we developed a model-based assessment (MBA) and associated rubric as tools for teachers to understand and support students in their conceptualization of the flow of energy…

This study explores the use of Large Language Models (LLMs), specifically GPT-4, in analysing classroom dialogue--a key task for teaching diagnosis and quality improvement. Traditional qualitative methods are both knowledge- and labour-intensive. This research investigates the potential of LLMs to streamline and enhance this process. Using…

Open-ended questions in mathematics are commonly used by teachers to monitor and assess students' deeper conceptual understanding of content. Student answers to these types of questions often exhibit a combination of language, drawn diagrams and tables, and mathematical formulas and expressions that supply teachers with insight into the processes…

Value-added metrics or models (VAMs) are an important component of the teacher evaluation process that evaluators use to determine the value teachers add to their students' academic achievement. VAMs are used to arrive at a score that is derived from the number of the teachers' students who pass and/or fail a standardized assessment. While prior…

New national science standards have elevated attention to student performance with a core set of science and engineering practices, yet guidance about how to assess these practices is only just emerging in the literature. This is particularly true for the set of engineering design-focused concepts and practices articulated in the Next Generation…

With problem-solving as the focus and wisdom as the goal, the concept of giftedness is reconceptualized in the 21st century context. The two most prominent constructs in the field of education for the gifted, creativity and intelligence, are integrated into a view of exceptional talent as consisting of the ability and willingness to solve complex…

In educational and psychological research, it is common to use latent factors to represent constructs and then to examine covariate effects on these latent factors. Using empirical data, this study applied three approaches to covariate effects on latent factors: the multiple-indicator multiple-cause (MIMIC) approach, multiple group confirmatory…

McMillan Public Schools (MPS) is a public school system in the southeastern part of the United States that serves approximately 28,000 students. Gregory Middle School (GMS) is one of 52 schools within MPS that serves 985 students. I used MPS and GMS as pseudonyms to anonymize the school system and school. In July 2019, I was appointed as the…

In recent years, game-based learning has shown significant promise for creating engaging and effective learning experiences. Developing models that can predict whether students will struggle with mastering certain concepts could guide adaptive support to assist students with mastering those concepts. Game-based learning environments offer…

This study introduces the signal weighted teacher value-added model (SW VAM), a value-added model that weights student-level observations based on each student's capacity to signal their assigned teacher's quality. Specifically, the model leverages the repeated appearance of a given student to estimate student reliability and sensitivity…