Exemplary public school library programs need to have measures in place to determine overall effectiveness. The quality of the school library program is dependent on the effectiveness of the school librarian. Given the uncertainty of the role of school librarians and the inadequacy of evaluations for them, we present a practical solution for these…

Automatic Item Generation (AIG) refers to the process of using cognitive models to generate test items using computer modules. It is a new but rapidly evolving research area where cognitive and psychometric theory are combined into digital framework. However, assessment of the item quality, usability and validity of AIG relative to traditional…

We address two persistent challenges in large-scale assessments of the Next Generation Science Standards: (a) the validity of score interpretations that target the standards broadly and (b) how to structure claims for assessments of this complex domain. The NGSS pose a particular challenge for specifying claims about students that evidence from…

Assessments are one of the most important--and often misunderstood--elements of education. In most cases, tests are administered by the state as well as by districts and schools. Assessments at each of these levels have distinct purposes, yield different information, and are part of a powerful, coordinated approach to improving student outcomes.…

The three articles that comprise this dissertation use a variety of methods associated with the field of educational measurement to address distinct research questions related to psychometric tools and their implications for practice in education. All three articles involve methods related to instrument design, while drawing on different…

In this work, the authors document an expansion of the Public Speaking Competency Rubric (PSCR). First developed in 2012 by Schreiber, et al., the original rubric has only one item related to non-verbal communication. The authors of this work expanded the rubric to include 10 items related to the non-verbal aspects of public speaking and had it…

Many Chinese universities are implementing an educational reform to transform their general English courses into academic English courses. Accordingly, how to assess students' English ability should also be reformed. In this test review, we introduce a school-based general academic English summative test developed by English instructors. An…

High-stakes examinations enjoy widespread use as summative assessments in higher education. We review the arguments for and against their use, across seven common themes: memory recall and knowledge retention; student motivation and learning; authenticity and real-world relevance; validity and reliability; academic misconduct and contract…

Summative assessments provide data to evaluate the effectiveness of schools, teachers, and educational policies, contributing to a robust accountability system worldwide. However, educators and scholars argue that summative assessments do not effectively promote ongoing learning, enhance teaching practices, or align with the skills required in the…

State summative educational assessment is about to begin in earnest. Rightfully, many are raising questions about the quality, meaning, and appropriate use of the assessment results. This document was written to support state educational agencies (SEAs) and their assessment providers in devising effective and efficient analysis plans. This…

Students with disabilities often face academic challenges while in school. They can only master academic concepts if they receive services that are appropriately monitored and assessed. This quantitative causal-comparative study analyzed the associations between academic assessment methods for students with disabilities in a local Florida school…

Background: Undergraduate engineering students experiencing distress are less likely than peers to ask for professional help. A population-specific instrument to facilitate the identification of factors that influence mental healthcare utilization could guide development and testing of interventions to increase help seeking. Purpose: We used mixed…

The Early Years Foundation Stage Profile (EYFSP) is a statutory, summative teacher assessment against nationally prescribed criteria. It is completed for all children in state education in England in summer of the reception year, when September-born children are nearly 6 and summer-born children are turning 5. This research uses quantitative…

Juries are a high-stake practice in higher education to assess complex competencies. However common, research remains behind in detailing the psychometric qualities of juries, especially when using rubrics or rating scales as an assessment tool. In this study, I analyze a case of a jury assessment (N = 191) of product development where both…

Assessment of functional impairment provides information that is complementary to diagnostic criteria information and is critical for identifying targets for intervention and evaluating treatment outcomes. This review presents summative psychometric information for five multidimensional measures of functional impairment developed for use with…