The purpose of this study was to examine the technical features of slopes produced from the curriculum-based measurement in writing (CBM-W) word dictation task. Seventy-nine elementary students in the U.S. Midwest with intensive learning needs responded to weekly word dictation probes across 20 weeks; responses were scored for correct letter…

Institutional assessments of quantitative literacy/reasoning (QL/QR) have been extensively tested and reported in the literature. While appropriate for measuring student learning at the programmatic or institutional level, such instruments were not designed for classroom grading. After modifying a widely accepted institutional rubric designed to…

Recent research has explored the use of models adapted from Mokken scale analysis as a nonparametric approach to evaluating rating quality in educational performance assessments. A potential limiting factor to the widespread use of these techniques is the requirement for complete data, as practical constraints in operational assessment systems…

Purpose: This study aims to address the reliability and validity of the shortened versions of the Arabic dimensions of the learning organization questionnaire (DLOQ) to provide evidence on the learning organization (LO) concept in Lebanon and to draw attention to the applicability of the LO concept to facilitate the development and…

Purpose: The purpose of this paper is to highlight to universities the approach of professional associations in marking large volumes of assessments. Design/methodology/approach: The issues arising in marking large undergraduate modules in universities are discussed, before describing the approach typically adopted by professional associations.…

Reliability is usually estimated for a total score, but it can also be estimated for item scores. Item-score reliability can be useful to assess the repeatability of an individual item score in a group. Three methods to estimate item-score reliability are discussed, known as method MS, method [lambda][subscript 6], and method CA. The item-score…

A readily applicable procedure is discussed that allows evaluation of the discrepancy between the popular coefficient alpha and the reliability coefficient of a scale with second-order factorial structure that is frequently of relevance in empirical educational and psychological research. The approach is developed within the framework of the…

Argument-based validation requires test developers and researchers to specify what is entailed in test interpretation and use. Doing so has been shown to yield advantages (Chapelle, Enright, & Jamieson, 2010), but it also requires an analysis of how the concerns of language testers can be conceptualized in the terms used to construct a…

This article describes and reviews the "Test of Early Communication and Emerging Language" (TECEL; Huer & Miller, 2011). The test was constructed to assess infants' and toddlers' earliest communication and language abilities. The TECEL is a revision of the Nonspeech Test for Receptive/ Expressive Language (NST; Huer, 1983, 1988). The…

The engaging nature of video games has intrigued learning professionals attempting to capture and retain learners' attention. Designing learning interventions that not only capture the learner's attention, but also are designed around the natural cycle of attention will be vital for learning. This paper introduces the temporal attentive…

The purpose of this study was to examine the histopathologic reliability of embalmed cadaveric tissue taken from the gross anatomy laboratory. Tissue samples from hearts, livers, lungs, and kidneys were collected after the medical students' dissection course was completed. All of the cadavers were embalmed in a formalin-based fixative solution.…

Cronbach's alpha is a statistic commonly quoted by authors to demonstrate that tests and scales that have been constructed or adopted for research projects are fit for purpose. Cronbach's alpha is regularly adopted in studies in science education: it was referred to in 69 different papers published in 4 leading science education journals in a…

Response to intervention (RtI) models have increasingly been adopted to improve outcomes for all students through the delivery of a continuum of supports and making timely responsive instructional decisions based on data. With this increasing popularity, researchers and practitioners have developed several RtI-related assessments, many of which…

This real-data-guided simulation study systematically evaluated the decision accuracy of complex decision rules combining multiple tests within different realistic curricula. Specifically, complex decision rules combining conjunctive aspects and compensatory aspects were evaluated. A conjunctive aspect requires a minimum level of performance,…

During the development of large-scale curricular achievement tests, recruited panels of independent subject-matter experts use systematic judgmental methods--often collectively labeled "alignment" methods--to rate the correspondence between a given test's items and the objective statements in a particular curricular standards document.…