In 2016, the Office of the Higher Education Commission issued a directive requiring all higher education institutions in Thailand to have their students take a standardized English proficiency test. According to the directive, the test's results had to align with the Common European Framework of Reference for Languages (CEFR). In response to this…

The Gilliam Autism Rating Scale-Third Edition (GARS-3) is a norm-referenced tool designed to screen for autism spectrum disorders (ASD) in individuals between the ages of 3 and 22 (Gilliam, 2014). The GARS-3 test kit consists of three different components and includes an "Examiner's Manual," summary/response forms (50), and the…

As a property of test scores, reliability/dependability constitutes an important psychometric consideration, and it underpins the validity of measurement results. A review of interpreter certification performance tests (ICPTs) reveals that (a) although reliability/dependability checking has been recognized as an important concern, its theoretical…

In 2017, the Office of Planning, Research, and Evaluation (OPRE) in the Administration for Children and Families (ACF) funded Mathematica to conduct the Infant and Toddler Teacher and Caregiver Competencies (ITTCC) project. The project aims to examine existing efforts across states, institutions of higher education, professional organizations, and…

This article provides a description and review of the "Comprehensive Executive Function Inventory" (CEFI; Naglieri & Goldstein, 2013), published by Multi-Health Systems Inc. (MHS). It is a rating scale developed to measure a wide array of Executive Function (EF) abilities in individuals aged 5 through 18 years. Completed by a parent,…

This study aimed to develop and validate a measure of emergent reading motivation designed for prekindergarten children, called the Emergent Reading Motivation Scale (ERMS). The development of the ERMS was to overcome the limitation that current existing reading motivation measures are not developmentally appropriate for young children. Fifty-six…

In high-stakes writing assessments, rater training in the use of a rating scale does not eliminate variability in grade attribution. This realisation has been accompanied by research that explores possible sources of rater variability, such as rater background or rating scale type. However, there has been little consideration thus far of…

Recent literature notes a significant increase in students being diagnosed with Autism Spectrum Disorder (ASD). Yet, no uniform testing protocol exists. It is vital for students and educators that a unified testing process be created and established. This study investigated which ASD testing instruments were currently used in Southern California…

A preliminary study is reported of the use of new multifaceted Rasch measurement mechanisms for investigating rater characteristics in language testing. Ratings from four judges of scripts from 50 candidates taking the International English Language Testing System test, a test of English for Academic Purposes, are analyzed. The analysis…

This study investigates four widely used methods of collecting direct similarity judgments for nonmetric multidimensional scaling: rating scale, triads, rank order of pairs, and conditional rank order. (Author/PN)

This review of research on second-language oral testing outlines the nature of early research in interview-format proficiency testing, then reports on new directions in investigation of construct validity of interview-format and other oral skills tests through examination of examinee, interviewer, and rater performance. Research on empirically…

Data from 2-, 3-, 6-, and 7-point rating scales were analyzed to determine whether scale length affected response patterns. Results indicate that data configurations are relatively invariant with changes in number of scale points. (Author)

Investigates the reliability of measures of linguistic accuracy in second language writing. The study uses a holistic scale, error-free T-units, and an error classification system on the essays of English-as-a-Second-Language students and discusses why disagreements arise within a rater and between raters. (24 references) (Author/CK)

This is the preliminary report of a new memory scoring method. Using the Wechsler Memory Scale as its base, it scores lateralized verbal and figural memory and long- and short-term memory. Six independent memory scales were developed. Studies of 105 subjects demonstrate that these scales are reliable and valid. (Author)

Compared three methods of rating thoughts: self-rating by subjects, rating by experts with thoughts presented randomly, and rating by experts with thoughts presented in context among 107 students who listed their thoughts prior to giving a speech. Results indicated all three methods were equal in predictions of speech anxiety and performance.…