We illustrate how to analyze complete generalizability theory (GT) designs using structural equation modeling software ("lavaan" in R), compare results to those obtained from numerous ANOVA-based packages, and apply those results in practical ways using data obtained from a large sample of respondents, who completed the Self-Perception…

Purpose: In grading, one of the most common errors is made in combining two or more different test scores. This study aimed to investigate the agreement of grades calculated by weighting raw scores and standard scores. Research Methods: In this simulation study, data were simulated for midterm and final measurements. Nine conditions [3 (class…

Rater training is necessary to accurately evaluate fundamental motor skills among children with developmental disabilities (DD). The purpose of this pilot study was to examine the impact of an online rater training program for novice raters on scoring accuracy of the run and two-hand strike skills on the Test of Gross Motor Development-Third…

The present study examined how information about different grading systems affects students' course expectations, particularly in ways that may have downstream consequences for learning and other academic outcomes. In an online experiment using a preregistered design, we prompted two samples of current and recent college students (N = 547) with a…

The last comprehensive study to examine the assessment practices promoted by school psychology programs was published 25 years ago (i.e., Wilson & Reschly, 1996). Since then, significant changes to assessment theory and practice have occurred. Data from a 2020 survey of directors of school psychology programs were collected to gain an…

Achievement tests are used to make high-stakes (e.g., special education placement) decisions, and previous research on norm-referenced assessment suggests that errors are ubiquitous. In our study of 42 teacher trainees, utilizing five of the six core subtests of the Kaufman Test of Educational Achievement, Third Edition (KTEA-3), we found that…

This article details a large-scale tutor-to-teacher pipeline created in the midst of the COVID-19 pandemic. The program addressed two vital needs: 1) improving outcomes for striving readers in high-needs communities, and 2) improving teacher training in both evidence- and research-based instruction. Across school year (SY) 2020-2021 and 2021-2022,…

The purpose of this study was to explore potential effects of a 12-week therapeutic mentoring program targeting social, emotional, and behavioral concerns in 52 children and adolescents between 11 and 17 years of age. Self-reported scores on a norm-referenced behavioral questionnaire were tracked across the span of a mentoring program, and then…

The institutions in education use various assessment methods to decide on the proficiency levels of students in a particular construct. This study investigated whether the decisions differed based on the type of assessment: norm-and criterion-referenced assessment. An achievement test with 20 multiple-choice items was administered to 107 students…

The objective structured practical examination (OSPE) is a reliable assessment of practical skills in anatomy teaching. It is often administered as low-stake assessments to track progress at multiple time points in anatomy curricula. Standard-setting OSPEs to derive a pass mark and to ensure assessment quality and rigor is a complex task. This…

Resilient readers comprehend written language despite word reading deficits. The reading resiliency framework specifies candidate protective factors hypothesized to mitigate adverse effects on reading comprehension arising from phonological decoding deficiencies and, consequently, illuminates how some individuals exhibit relative reading…

Background: Motor skill assessment is time-consuming and some difficulties are inherent in the administration of motor tests, especially in children with neurodevelopment disorders. Purpose: This study aimed to develop and investigate the face, content, and criterion validity of a Motor Skills Sequential Pictures (MSSP) for the Test of Gross Motor…

Research consistently has found teachers' use of assessment data for instructional purposes challenging and inconsistent. To support teachers' use of data, we need to develop shared knowledge about how data are and can be used to advance teaching and learning. However, the literature on the specific actions teachers take is inconsistent, creating…

Integrative learning is an important outcome for graduates of higher education. Therefore, it should be well-defined and assessed reliably. The American Association of Colleges & Universities has developed a rubric to define and assess integrative learning, but it has low reliability. This pilot study examines whether this rubric's reliability…

Thorndike (1969) proposed a three P theory of faculty grading orientations (FGOs) -- "perfection", "peers", and "potential", also known as Criterion-, Norm, and Self-referenced FGOs in the literature. Using data from a 2014 faculty survey I examined the responses of 1,742 faculty at 18 four-year, primarily teaching…