We developed a rubric for measuring students' ability to reason and write scientifically. The Rubric for Science Writing (Rubric) was tested in a variety of undergraduate biology laboratory courses (total n = 142 laboratory reports) using science graduate students (teaching assistants) as raters. Generalisability analysis indicates that the Rubric…

The method of Direct Behavior Rating (DBR) incorporates aspects of both systematic direct observation and behavior rating scales to provide an efficient means to collect time series data. This study extended the development and evaluation of DBR Single-Item Scales (DBR-SIS) as a behavior assessment tool. Eighty-eight undergraduate students used…

This experimental study aims to investigate the effects of using collaborative learning to enhance students' speaking achievement. The study using a pre-test and post-test design was conducted with 35 undergraduate students enrolled in a fundamental English course at Bangkok University to examine their speaking achievement on an English oral test…

This article details the development of the Youth Development Assessment Device (YDAD), an instrument designed to measure a youth's experiences within youth development programs. A total of 1,074 adolescents, between 12 and 18 years of age, participated in the study. Exploratory factor analysis yielded three factors: Supportive Environment,…

The attribute hierarchy method (AHM) is a psychometric procedure for classifying examinees' test item responses into a set of structured attribute patterns associated with different components from a cognitive model of task performance. Results from an AHM analysis yield information on examinees' cognitive strengths and weaknesses. Hence, the AHM…

The development of phonological awareness (PA), the ability to reflect on the sound structure of words independent of their meaning, has been extensively explored in English-speaking children. However, this is not the case for other languages. The aim of this study was to develop a comprehensive PA test battery for German-speaking preschool…

A readily implemented procedure is discussed for interval estimation of indexes of interrelationship between items from multiple-component measuring instruments as well as between items and total composite scores. The method is applicable with categorical (ordinal) observed variables, and can be widely used in the process of scale construction,…

This article introduces the Measurement Skills Assessment (MeSA), which was designed to evaluate the mastery of measurement in elementary school students. The primary objectives for the MeSA include covering a broad range of measurement concepts, distinguishing between major subtypes of measurement, and constructing a continuum of items varying in…

Following growing interest in vocabulary acquisition, a number of researchers have proposed how learners' vocabulary knowledge can be measured both in terms of how many words they know (vocabulary size) and how well they know those words (depth of knowledge). However, most of the depth measures have addressed only a single depth aspect (often for…

This paper provides a history of ETS's role in developing assessment instruments and psychometric procedures for measuring change in large-scale national assessments funded by the Longitudinal Studies branch of the National Center for Education Statistics. It documents the innovations developed during more than 30 years of working with…

This report presents results from a new quantitative synthesis of research on the effectiveness and validity of test accommodations for English language learners (ELLs) taking large-scale assessments. In 2006, the Center on Instruction published a review of the literature on test accommodations for ELLs titled "Practical Guidelines for the…

Objective: Application of the Transtheoretical Model (TTM) to Supplemental Nutrition Assistance Program Education (SNAP-Ed) evaluation and development and validation of an evaluation tool used to measure TTM constructs is described. Methods: Surveys were collected from parents of children receiving food at Summer Food Service Program sites prior…

The purpose of the study was to develop an improved teaching evaluation questionnaire based on students' learning experiences and selected teacher characteristics identified as indicators of teaching quality. Teaching evaluation questionnaires are commonly designed either based on agreed indicators of teaching excellence, students' suggestions of…

The aim of this article is three-fold: (a) to present an example of best practices in formative assessment in university instruction, offering three different methods of learning and assessment to pass a subject; (b) to analyze differences in academic performance depending on method of learning and assessment chosen; (c) to consider professors'…

Since the 1970's there has been a movement in the United States aimed at increasing the integration of students with disabilities among non-disabled peers in general education classes. The practice of inclusion--full integration of students regardless of the severity of disability--is not uniformly accepted. While many agree with the ideals and…