Over the past twenty years in performance testing a specific item type with distinguishing characteristics has arisen time and time again. It's been invented independently by dozens of test development teams. And yet this item type is not recognized in the research literature. This article is an invitation to investigate the item type, evaluate…

Evaluation of teaching effectiveness is considered a critical element in determining whether or not faculty members are retained at higher education institutions; academic milestones such as tenure and promotion often require documentation of the quality of faculty teaching. As methods of assessing teaching effectiveness evolve, concerns about the…

A single group (SG) equating design with nearly equivalent test forms (SiGNET) design was developed by Grant (2006) to equate small volume tests. The basis of this design is that examinees take two largely overlapping test forms within a single administration. The scored items for the operational form are divided into mini-tests called testlets.…

Multiple-choice questions are widely used in higher education and have some important advantages over constructed-response test questions. It seems, however, that many teachers underestimate the value of multiple-choice questions, believing them to be useful only for assessing how well students can memorize information, but not for assessing…

This article describes a comparative study conducted at the item level for paper and online administrations of a statewide high stakes assessment. The goal was to identify characteristics of items that may have contributed to mode effects. Item-level analyses compared two modes of the Texas Assessment of Knowledge and Skills (TAKS) for up to four…

The purpose of this study is to examine whether the choice between three multiple-choice listening comprehension test formats results in any difference in listening comprehension test performance. The three formats entail (a) allowing test takers to preview both the question stem and answer options prior to listening; (b) allowing test takers to…

This exploratory study was built on research spanning three decades. Petersen, Marco, and Stewart (1982) conducted a major empirical investigation of the efficacy of different equating methods. The studies reported in Dorans (1990) examined how different equating methods performed across samples selected in different ways. Recent population…

The purpose of this dissertation was to investigate how different Item Response Theory (IRT)-based calibration methods affect student achievement growth pattern recovery. Ninety-six vertical scales (4 x 2 x 2 x 2 x 3) were constructed using different combinations of IRT calibration methods (separate, pair-wise concurrent, semi-concurrent, and…

This study examined the "communicativeness" of 22 English language tests designed and administered by 22 English instructors from 22 different colleges and universities in the Philippines. Its key objective was to answer the question "How communicative are the language tests used in assessing students' competence (knowledge of the…

All students, including students with disabilities, participate in state accountability systems. Most students with disabilities participate in the regular assessment, with or without accommodations. Students with more significant cognitive disabilities participate in the alternate assessment based on alternate achievement standards (AA-AAS). A…

Quantitative item models are item structures that may be expressed in terms of mathematical variables and constraints. An item model may be developed as a computer program from which large numbers of items are automatically generated. Item models can be used to produce large numbers of items for use in traditional, large-scale assessments. But…

A significant event for the advancement of economic education in the schools is the development of the National Assessment of Educational Progress (NAEP) in economics. For the first time, national data from a representative sample of students are available to measure the achievement of high school students in economics. The achievement results are…

Background: Existing evidence suggests that young children with specific language impairment have unusual difficulty in detecting omissions of obligatory tense-marking morphemes, but little is known about adolescents' sensitivity to such violations. Aims: The study investigated whether limitations in receptive morphosyntax (as measured by…

This study investigated the relationship between receptive and productive vocabulary size. The experimental design expanded upon earlier methodologies by using equivalent receptive and productive test formats with different receptive and productive target words to provide more accurate results. Translation tests were scored at two levels of…

Students at the University of Edinburgh do almost all their work on computers, but at the end of the semester they are examined by handwritten essays. Intuitively it would be appealing to allow students the choice of handwriting or typing, but this raises a concern that perhaps this might not be "fair"--that the choice a student makes,…