At present, the widespread use of online education platforms has attracted the attention of more and more people. The application of AI technology in online education platform makes multidimensional evaluation of students' ability become the trend of intelligent education in the future. Currently, most existing studies are based on traditional…

Model evaluation -- the process of making inferences about the performance of predictive models -- is a critical component of predictive modelling research in learning analytics. We survey the state of the practice with respect to model evaluation in learning analytics, which overwhelmingly uses only naïve methods for model evaluation or…

The majority of states include value-added models (VAMs) or some other measure of student academic growth as a component of their teacher evaluation systems. However, there is considerable disagreement among researchers about whether states and school districts should use student growth measures to make high-stakes personnel decisions. Many…

Background: Evaluating diversity, inclusivity, and equity remains both a prevalent topic in education and a difficult challenge for most evaluators. Traditional metrics used to evaluate these constructs include questionnaires, focus groups, and anonymous comment solicitations. While each of these approaches offer value, they also possess a number…

Using an empirically-based simulation study, we show that typically used methods of choosing an item calibration sample have significant impacts on achievement bias and system rankings. We examine whether recent PISA accommodations, especially for lower performing participants, can mitigate some of this bias. Our findings indicate that standard…

This article provides a brief overview and comparison of three conditional growth percentile methods; student growth percentiles, percentile rank residuals, and a nonparametric matching method. These approaches seek to describe student growth in terms of the relative percentile ranking of a student in relationship to students that had the same…

Policy-makers are frequently interested in understanding how effective a particular intervention may be for a specific (and often broad) population. In many fields, particularly education and social welfare, the ideal form of these evaluations is a large-scale randomized experiment. Recent research has highlighted that sites in these large-scale…

Purpose: It is a normal practice that students' overall scores are computed by simple average (SA) method which considers all academic subjects as having the same weights or same degree of importance. This paper highlights the application of simple weighted average (SWA) as an alternative method in aggregating students' academic achievements. The…

The purpose of this study was to assess the value of dynamic assessment (DA; degree of scaffolding required to learn unfamiliar mathematics content) for predicting 1st-grade calculations (CAs) and word problems (WPs) development, while controlling for the role of traditional assessments. Among 184 1st graders, predictors (DA, Quantity…

This guide is intended to assist teachers in the measuring of student learning over the course of the school year. Teachers in the six groups of IMPACT will write teacher-assessed student achievement (TAS) goals at the beginning of the year to gauge student achievement. With the principal's approval, teachers may adapt, as appropriate, the…

The purpose of this technical assistance paper is to provide a description of the procedures used to determine school grades for the 2014 school year. Florida's current school accountability system originated with state legislation passed in 1999 (the "A+ Plan") and has been revised periodically to reflect increased standards and…

This report summarizes the complex research literature on quantitative methods for assessing how impacts of educational interventions on instructional practices and student learning differ across students, educators, and schools. It also provides technical guidance about the use and interpretation of these methods. The research topics addressed…

In a German out-of-school laboratory, 293 medium-achieving 10th-grade students participated in a lesson unit about gene technology. They were divided into two groups (I-1, I-2), both of which followed the same hands-on lesson procedure. Students within I-2 were additionally confronted with alternative conceptions to central issues of the specific…

Background: In line with the increase of using value-added assessment information to evaluate learning gain made by learners in different parts of the world, the Education Bureau in Hong Kong has recently introduced a system that provides value-added information of secondary school students. However, not many teachers have a clear knowledge and…

Performance-based accountability along with budget tightening has increased pressure on publicly funded organizations to develop and deliver programs that produce meaningful social benefits. As a result, there is increasing need to undertake formative evaluations that estimate preliminary program outcomes and identify promising program components…