Principles of skill acquisition dictate that raters should be provided with frequent feedback about their ratings. However, in current operational practice, raters rarely receive immediate feedback about their scores owing to the prohibitive effort required to generate such feedback. An approach for generating and administering feedback responses…

This introductory article describes how constructed response scoring is carried out, particularly the rater monitoring processes and illustrates three potential designs for conducting rater monitoring in an operational scoring project. The introduction also presents a framework for interpreting research conducted by those who study the constructed…

While score comparability across test forms typically relies on common (or randomly equivalent) examinees or items, innovations in item formats, test delivery, and efforts to extend the range of score interpretation may require a special data collection before examinees or items can be used in this way--or may be incompatible with common examinee…

In today's world, Global Competence represents a fundamental disposition for teachers who must be able to teach effectively in classrooms with students from diverse backgrounds and manage multiple learning contexts. For these reasons, it is necessary to set up educational activities during initial teacher education programs aimed at developing and…

How can schools integrate the lessons of remote learning during the COVID-19 pandemic into their face-to-face teaching. What guidelines can teachers use to be sure they are integrating technology? In this article, we propose an adaptation of the Triple E Framework to guide this work. The goal of the framework is to ensure that technology use…

Multilevel modelling (MLM) is the most frequently used approach for evaluating interventions with clustered data. MLM, however, has some limitations that are associated with numerous obstacles to model estimation and valid inferences. Longitudinal multiple-group (LMG) modelling is a longstanding approach for testing intervention effects using…

Role-play is a natural and dominant form of early childhood activity. While playing, a child masters new forms of behavior, learns to interact with others, and develops imagination and self-regulation skills. The existing methods of play assessment are based on different theoretical approaches that variously define both the criteria for play and…

Feedback can improve or impair students' learning performance, depending on its timing and constructiveness. Given the diversity of students' study goals and overall performance in the assessment tasks within most classes, a group of students can experience a deteriorated performance from delayed corrective feedback, and another group can suffer…

Rubrics are a commonly used tool to evaluate student work in the introductory communication course. Although rubrics may appear objective, they are continually interpreted by both instructors and students, often reflecting traditional classroom power dynamics. In order to understand how rubrics constrain as well as expand opportunities for the…

In this study, we investigated the impact of the evaluation capacity building (ECB) efforts of an organization by examining the evaluation plans included in funding proposals over a 14-year period. Specifically, we sought to determine the degree to which and how evaluation plans in proposals to one National Science Foundation (NSF) program changed…

Background: Researchers interested in quantitative measures of student "success" in writing cannot control completely for contextual factors which are local and site-based (i.e., in context of a specific instructor's writing classroom at a specific institution). (In)ability to control for curriculum in studies of student writing…

This paper reports on the development of six student teachers' knowledge of instructional strategies (KOIS) for teaching proportions during a 2-month practicum in China. Development of four subcomponents was explored through Content Representation (CoRe) questionnaires and follow-up interviews. Data was analysed deductively and levels of each…

In chemistry, reasoning about the underlying mechanisms of observed phenomena lies at the core of scientific practices. The process of uncovering, analyzing, and interpreting mechanisms for explanations and predictions requires a specific kind of reasoning: mechanistic reasoning. Several frameworks have already been developed that capture the…

Background: Mode effects, the variations in item and scale properties attributed to the mode of test administration (paper vs. computer), have stimulated research around test equivalence and trend estimation in PISA. The PISA assessment framework provides the backbone to the interpretation of the results of the PISA test scores. However, an…

Purpose: Measures of grammatical accuracy are effective measures of children's language skills. However, many measures, such as percent grammatical utterances, were developed for children who speak General American English (GAE) and, therefore, may not be appropriate for students who speak other dialects. This study examines different scoring…