This book addresses the validity of think-aloud protocols (TAPs) in L2 writing research through a mixed methods study and proposes effective approaches for their valid implementation. The book uncovers the reactive effects that TAPs have on L2 writing performance and processes, and examines how individual factors moderate this reactivity. It…

Discusses the conditions for validating customary phylogenetic procedures. Concludes that the requisites of homogeneity and completeness for proved short lineages seem satisfied by the Hennigian but not the Haeckelian procedure. The epistemological antinomy of the two procedures is emphasized for the first time. (Author/RH)

In recent years educators have been utilizing judgmental methods, such as the ones advocated by Ebel and Angoff, to set minimum competency standards on test items. This study was designed to investigate the reliability and validity of these two procedures in setting minimum levels of performance on 175 vocational evaluator competency statements.…

Describes three basic approaches to needs assessment--problem identification, problem analysis, and problem verification--and assesses them in terms of their potential utility to users in business and educational settings as measured by their estimated time requirement, accuracy, and cost. Needs assessment data collection resources and techniques…

Two methods of researching second language learning are described, analyzed, and compared: student diaries giving a first-person account of the second language learning experience; and participant observation, in which the observer is in the language learning situation recording in descriptive terms all possible data about the situation.…

The validity of a comparison of mean test scores for two groups and of a longitudinal comparison of means within each group is assessed. Using LISREL, factor analyses are used to test the hypotheses of similar factor patterns, equal units of measurement, and equal measurement accuracy between groups and across time. (Author/DWH)

Harter's Perceived Competence Scale for Children was administered to 714 Taiwanese fifth graders; results were compared with those from American samples. Cultural differences were found. Results among Chinese replicate the measures' factorial validity and, across the two groups, indicate a high correlation between perceived cognitive competence…

To provide a consistent framework for evaluating competing reading methods and materials, an assessment instrument was devised to help over 100 inservice educators evaluate the middle grade components of five nationally used basal reader programs: the Holt Basic Reading System; the Open Court Correlated Language Arts Program, the Ginn Reading 360…

Computer-based instruction (CBI) studies analyzed by Kulik et al. were examined to explore the validity of competing claims about the computer's contribution to measured achievement gains. Results suggest achievement gains found in CBI studies are overestimated and are due to uncontrolled but robust instructional methods embedded in CBI…

It is argued that research testing the reliability and validity of college and university reputational studies should be conducted, a concern not raised by consumers and publishers. Two studies of "America's Best Colleges," published by "U.S. News and World Report," raise questions about the guide's validity and suggest that…

Debate grows over the validity and reliability of college and university rankings, which judge rather than describe institutions, as the public's willingness to accept them increases. While many institutional characteristics can be measured, measurement methods need improvement. One solution is to publish the peer studies that the institutions…

Study of 68 school media centers in 11 states was conducted to field-test collection mapping as a technique and to amass enough data to enable individual schools to compare their collections with national pool of school collections. Collections of participating schools were also compared to nationally recognized selection lists. (CDD)