Multiple matrix sampling is a data collection technique that ensures accuracy and efficiency in group performance. It has been widely used in large-scale curriculum evaluation since the 1980s. However, the design does not always fully embrace the dynamics of local evaluation demands. The purpose of this study is to introduce a modified matrix…

This article discusses methods for evaluating students' content-area literacy skills. Four specific factors that affect content-area literacy are described: vocabulary knowledge, topic knowledge, text structure knowledge, and textbook readability, along with methods of evaluating each of the factors. Most of these methods have not yet been…

A study is reported of the use of a personal journal as a tool for transferring learning from the training room to the workplace. The targeted learning event was an English for Communication training programme. This programme was an intensive four-day course that grouped together participants from the non-UK sites of the aircraft manufacturer…

Given the perennial interest in the construct of age identity yet its persistent resistance to explanation, the purpose of this study was to re-examine the conceptual structure of age identity by using a focus group design modified to reflect contemporary social science theory. The second purpose of the study was to examine how this modified…

This article reports findings from formative assessments of one state's administrator mentoring and induction program during two years of program piloting in 2002/03 and 2003/04. The purpose of this evaluation research was to establish baseline data and to detect problem areas, so that changes could be made in subsequent years. More broadly, the…

The purpose of this mixed-methods study was to document the prevalence of sampling designs utilised in mixed-methods research and to examine the interpretive consistency between interpretations made in mixed-methods studies and the sampling design used. Classification of studies was based on a two-dimensional mixed-methods sampling model. This…

Content analysis scales apply rigorous measurement to verbal communications and make possible the quantification of text in counseling research. The limitations of the Origin and Pawn Scales (M. T. Westbrook & L. L. Viney, 1980), the Positive Affect Scale (M. T. Westbrook, 1976), the Content Analysis Scales of Psychosocial Maturity (CASPM; L.…

This study provides a framework for the evaluation of assessments that may be used in adult continuing education. It provides an example of the analysis of an examination for 33 solicitors seeking specialist accreditation. Resampling was used to generate a group of 1000 results, and responses were analysed using a Rasch model. Results indicated a…

The emergence of numerous learning style models over the past 25 years has brought increasing attention to the idea that students learn in diverse ways and that one approach to teaching does not work for every student or even most students. We have reviewed five learning style instruments (the Kolb Learning Style Indicator, the Gregorc Style…

In this article, the authors provide their critique on a set of papers that investigated Mathematics Knowledge for Teachers (MKT) assessment and the underlying theory and characteristics of the validity enterprise. Three types of assumptions and inferences--elemental, structural, and ecological--are discussed in these papers. These assumptions…

In this issue of Measurement: Interdisciplinary Research and Perspectives, Schilling et al. are explicit about the centrality of assessment design and development and psychometric analysis in validation. Schilling and colleagues, Kane (2004, 2006), other contemporary validity theorists and practitioners, and their predecessors typically discuss…

The Communities That Care Youth Survey measures risk and protective factors shown in prior studies to predict adolescent problem behaviors such as drug use, delinquency, and violence. This paper describes the development and validation of cut points for the risk and protective factor scales in the Communities That Care Youth Survey that…

The Women in Science Scale (WiSS) was first developed in 1984, and is still being used in contemporary studies, yet its psychometric properties have not been evaluated with current statistical methods. In this study, the WiSS was administered in its original 27-item form to 1,439 middle and high school students. Confirmatory factor analysis based…

Community development partnerships for youths offer valuable resources for school improvement. Unfortunately, these resources may not be tapped because school leaders have not been prepared to understand these partnerships. The evaluative research reported partnership-related understanding, aiming to prepare leaders to contribute to, and benefit…

Patriot High School (PHS) adopted a remediation strategy to help its 10th-grade students at risk of failing the Math portion of MCAS, the state's end of year competency exam. The centerpiece of that strategy was a computer-based instructional (CBI) course. PHS used a commercially available CBI product to align the course content with the…