Traditionally, cluster randomized controlled trials are analyzed with the average intervention effect of interest. However, in populations that contain higher degrees of heterogeneity or variation may differ across different values of a covariate, which may not be optimal. Within education and social science contexts, exploring the variation in…

Young children are assessed to meet federal mandates and inform policy decisions, provide teachers with useful information to make instructional decisions and set reasonable learning goals, and facilitate communication with families. While young children are frequently assessed using whole-child assessments which often yield criterion-referenced…

In this study we examined the relationship of students' 21st century skills with their academic and behavioral outcomes. We investigated K-12 teachers' (n = 150) judgment of students' (n = 3,108) use of 21st century skills (i.e., persistence, curiosity, affect, and cognition behaviors) via a Likert-type rating scale. We compared teachers' ratings…

Children from low-income households are at risk for entering school behind their more economically advantaged peers across major domains of school readiness. The Head Start program represents the federal government's response to these achievement gaps by mandating the use of scientifically based assessments and curricula to provide children with…

Bayesian Knowledge Tracing (BKT) models were in active use in the Intelligent Tutoring Systems (ITS) field for over 20 years. They have been intensively studied, and a number of useful extensions to them were proposed and experimentally tested. Among the most widely researched extensions to BKT models are various types of individualization.…

The goal of this paper is to examine the relationship of student motivation and achievement in low-stakes assessment contexts. Using Pearson product-moment correlations and hierarchical linear regression modelling to analyse data on 794 tertiary students who undertook a low-stakes engineering mechanics assessment (along with the questionnaire of…

This study investigated the relationship of kindergarten teachers' ratings of their students' 21st century skills (college readiness skills) with students' behavioral and academic performance. Teachers rated the frequency that their students (n = 579) demonstrated persistence, curiosity, affective, and cognitive (e.g., critical thinking) behaviors…

The impact of social and emotional skills on educational, career, and life outcomes is well supported in the research literature. Schools are increasingly implementing universal curricula to teach social and emotional skills to all students. Today's climate of accountability places pressure on school administrators and policy makers to evaluate…

Given the wide use of peer assessment, especially in higher education, the relative accuracy of peer ratings compared to teacher ratings is a major concern for both educators and researchers. This concern has grown with the increase of peer assessment in digital platforms. In this meta-analysis, using a variance-known hierarchical linear modelling…

Item response theory (IRT) models are the main psychometric approach for the development, evaluation, and refinement of multi-item instruments and scaling of latent traits, whereas multilevel models are the primary statistical method when considering the dependence between person responses when primary units (e.g., students) are nested within…

The factorial survey is an experimental design consisting of varying situations (vignettes) that have to be judged by respondents. For more complex research questions, it quickly becomes impossible for an individual respondent to judge all vignettes. To overcome this problem, random designs are recommended most of the time, whereas quota designs…

Introduction: Despite the fact that the capacity of non-written sources (NWS) understanding is included in the Spanish secondary education curriculum, no research has addressed this competence. The main objective of this study is analysing how teachers consider NWS understanding that should be assessed to help decide which kind of support give to…

In this study, it is aimed to examine the effect of classroom assessment on science and mathematics achievements. For this purpose, hierarchical linear modeling (HLM) is performed using variables of like learning science/maths, engage teaching in science/maths, confidence in science/maths, and home resources for learning variables at the student…

We present a multi-level model of contextual factors that may influence teachers' assessment practices, and use this model in a selected review of existing literature on teachers' assessment knowledge, views and conceptions with respect to these contextual factors. Adapting Kozma's model, we distinguish three levels of influence on teachers'…

We explored the feasibility of using automated scoring to assess upper-elementary students' reading ability through analysis of transcripts of students' small-group discussions about texts. Participants included 35 fourth-grade students across two classrooms that engaged in a literacy intervention called Quality Talk. During the course of one…