The objective in the current paper is to examine the processes of how our research team negotiated meaning using an iterative design approach as we established, developed, and refined a rubric to capture comprehension processes and strategies evident in students' verbal protocols. The overarching project comprises multiple data sets, multiple…

Rubrics have been suggested as a means to foster students' evaluative judgement, the capacity to appraise their own work and that of others; however, empirical evidence of rubrics' effectiveness is still emerging. This paper contributes findings from a randomised controlled experiment on the effect of rubrics on evaluative judgement. Participants…

Classroom observation research plays an important role in policy, practice, and scholarship for students with disabilities. When interpreting results of observation studies, it is important to consider the validity evidence provided by researchers and how that speaks to the intended use of those results. In this literature synthesis, we used…

The use of the strategic abandonment technique in educational strategic planning was investigated through a qualitative research design that explores the use of a researcher-developed rubric prototype in current educational strategic planning processes. School districts could benefit from a purposeful method for abandoning what is and what is not…

Automatic short answer grading is an important research direction in the exploration of how to use artificial intelligence (AI)-based tools to improve education. Current state-of-the-art approaches use neural language models to create vectorized representations of students responses, followed by classifiers to predict the score. However, these…

Natural Language Processing (NLP) offers methods for understanding and quantifying the similarity between written documents. Within the testing industry these methods have been used for automatic item generation, automated scoring of text and speech, modeling item characteristics, automatic question answering, machine translation, and automated…

School- and college-based vocational and technical qualifications (VTQs) in England are required to award successful candidates a grade rather than simple pass or fail. Ensuring the reliability and validity of these grades is considered vital, particularly in light of the high-stakes purposes for which school assessment results in England are…

Working memory is an often studied and important psychological construct. The growth of working memory capacity (WMC) in childhood is described as linear. Average adult WMC is estimated as either four or five "chunks." Using latent curve models of data from a measure of digit span backward that was administered longitudinally to a large…

Background: This study investigated the scoring and criterion-related validity of the TEAP, a newly developed Test of English for Academic Purposes. In this study, scoring validity was examined by investigating the factor structure, while criterion-related validity was examined by first investigating the longitudinal change of test takers'…

The use of a Practice set (case simulation) as an assessment task in management accounting is aimed at providing students with a practical experience in the application of a form of simulated real-world events. The pedagogical justification for the use of a case simulation is inherent in the concept referred to as "learn-by-doing"…

In this paper we argue that the complexity of education systems can lead to a lack of coherence in the implementation of policy. More effective educational change requires policymakers and researchers to pay more attention to supporting teachers in classrooms. As an example, we consider decades of research attempts in STEM education to implement…

Formative assessment is an important driver in supporting children's writing development. This paper describes a writing rubric designed for use by teachers to formatively assess the writing of children in Pre-K to Grade 2, how the rubric was received by teachers, and its implementation in classrooms. Writing samples from 337 children in 33…

This study aimed to develop an analytical rubric for teachers to observe and evaluate students' performance in showcasing the cooperative problem-solving process. Thus, a rubric was prepared. Angles to evaluate the student performance were included and a quad rank scale was used in the rubric. Dimensions used in the rubric were based on the PISA…

Selection methods are commonly used in talent acquisition to predict future job performance and to find the best candidates, but questionnaire-based assessments can be lengthy and lead to candidate fatigue and poor engagement, affecting completion rates and producing poor data. Gamification can mitigate some of these issues through greater…

The Regulations of the Commissioner of Education provide that an intermediate-level science test is to be administered in Grade 8 to serve as a basis for determining students' need for academic intervention services in science. The New York State Grade 8 Intermediate-Level Science Test consists of two required components: a Written Test and a…