When analyzing treatment effects on test scores, researchers face many choices and competing guidance for scoring tests and modeling results. This study examines the impact of scoring choices through simulation and an empirical application. Results show that estimates from multiple methods applied to the same data will vary because two-step models…

The current research paper investigates the impact of McCarthy's 4MAT model on developing writing skills among upper-grade primary pupils. Sixty-four pupils in six primary-stage grades were chosen as the study participants and were divided randomly into two matched groups (a control group and an experimental one). The researcher adopted the…

The primary purpose of this study is to investigate the degree to which register knowledge, register-specific motivation, and diverse linguistic features are predictive of human judgment of writing quality in three registers--narrative, informative, and opinion. The secondary purpose is to compare the evaluation metrics of register-partitioned…

Purpose: Dyslexia is characterized by its diverse causes and heterogeneous manifestations. Chinese children with dyslexia exhibit orthographic, phonological, and semantic deficits across character and radical levels when writing. However, whether character dictation can be used to distinguish children with dyslexia from their typically developing…

This paper presents a multidimensional model of variation in writing quality, register, and genre in student essays, trained and tested via confirmatory factor analysis of 1.37 million essay submissions to ETS' digital writing service, Criterion®. The model was also validated with several other corpora, which indicated that it provides a…

This article proposes a class of cognitive diagnosis models (CDMs) for polytomously scored items with different link functions. Many existing polytomous CDMs can be considered as special cases of the proposed class of polytomous CDMs. Simulation studies were carried out to investigate the feasibility of the proposed CDMs and the performance of…

Models and modeling are central to both scientific literacy and practices as demonstrated by the Next Generation Science Standards. Through a design-based research framework, we developed a model-based assessment (MBA) and associated rubric as tools for teachers to understand and support students in their conceptualization of the flow of energy…

State-wide tests are designed to measure student overall ability on grade-level standards. School leaders want fine-grained information on student performance to inform curriculum and instruction. One currently used target scoring method, which compares student scores to expected values is currently used to give this feedback to schools, but there…

This study explores using transfer learning in machine learning for natural language processing (NLP) to create generic automated essay scoring (AES) models, providing instant online scoring for statewide writing assessments in K-12 education. The goal is to develop an instant online scorer that is generalizable to any prompt, addressing the…

When teachers first wrap their heads around scientific modeling, it can be a bit tricky to distinguish scientific models from diagrams and three-dimensional models. If a fifth grader draws and labels a food web, it's a model. Right? Not necessarily. When creating a model, students should be representing a system inspired by an inquiry or…

Developing a sufficient level of writing proficiency takes time. It is also a complex skill difficult to measure. The history of writing assessments reveals changing views of construct validity, reliability and interpretation of results. This study used a binary logistic regression model with seven years of grades 3 to 12 annual direct writing…

Survey respondents use different response styles when they use the categories of the Likert scale differently despite having the same true score on the construct of interest. For example, respondents may be more likely to use the extremes of the response scale independent of their true score. Research already shows that differing response styles…

The purpose of this paper is to provide a model for educational leadership faculty who aspire to walk the talk of effective feedback by embedding standards-based grading (SBG) in their courses. Rather than focusing on learning, points are the currency of K-12 classrooms across the country. Over 100 years of grading research suggests typical…

The academic achievement of diverse kindergarten to grade 12 students in inclusive classrooms implementing the Three-Block Model (TBM) of universal design for learning was investigated. Fifty-one teachers and 684 of their students, including students with disabilities, students who were English language learners (ELL), and Indigenous students,…

As teachers are increasingly asked to respond to assessment and evaluation demands in their schools, the aim of this article is to provide suggestions and scales for singing accuracy. A description of each step in the assessment design process is provided, along with specific suggestions for a singing development scale and a singing accuracy scale.