Considerable debate continues regarding the efficacy of the website RateMyProfessors.com (RMP). To date, however, virtually no direct, experimental research has been reported which directly bears on questions relating to sampling adequacy or item adequacy in producing what favorable correlations have been reported. The authors compare the data…

The dimensional comparison theory (DCT) focuses on the effects of internal, dimensional comparisons (e.g., "How good am I in math compared to English?") on academic self-concepts with widespread consequences for students' self-evaluation, motivation, and behavioral choices. DCT is based on the internal/external frame of reference model…

Although evaluators often use an interrupted time series (ITS) design to test hypotheses about program effects, there are few empirical tests of the design's validity. We take a randomized experiment on an educational topic and compare its effects to those from a comparative ITS (CITS) design that uses the same treatment group as the experiment…

Multiple-choice (MC) reading comprehension test items comprise three components: text passage, questions about the text, and MC answers. The construct validity of this format has been repeatedly criticized. In three between-subjects experiments, fourth graders (N[subscript 1] = 230, N[subscript 2] = 340, N[subscript 3] = 194) worked on three…

In recent years, the Education for All movement has focused more intensely on the quality of education, rather than simply provision. Many recent and current education quality interventions focus on literacy, which is the core skill required for further academic success. Despite this focus on the quality of literacy instruction in developing…

Peer assessment typically requires students to judge peers' work against assessment criteria. We tested an alternative approach in which students judged pairs of scripts against one another in the absence of assessment criteria. First year mathematics undergraduates (N?=?194) sat a written test on conceptual understanding of multivariable…

Secondary education in Fiji ends with the Form 7 examination. Predictive validity for academic success of Form 7 scores which form the basis for admission into the Bachelor of Medicine Bachelor of Surgery programme of the Fiji School of Medicine was examined via a cohort of 129 students. Success rates for year 1 in 2008, 2009, and 2010 were 90.7…

Background: Successfully selecting students for undergraduate courses and for teaching is notoriously difficult. Traditionally, in England, A level grades and interviews have been used in conjunction with a variety of other approaches. Purpose: This paper examines the predictive validity of students' A level grades and of scores from a structured…

Many postsecondary institutions currently administer standardized tests of general college outcomes; more than a quarter of Association of American Colleges and Universities (AAC&U) member institutions do so. Using standardized tests for accountability purposes has been contentious mainly because these tests do not measure every important…

Despite decades of research and debate, the issue of unequal outcomes continues to be a concern in educational systems worldwide. In England, published data relating to pupils' attainment across ethnic groups and by class indicators has been used to demonstrate continued inequalities in schools. This article attempts to deconstruct the…

In this research investigation of score comparability for language minority students (English language learners [ELLs] and former English language learners), we examined 3 indicators of score comparability (reliability, internal test structure, and differential item functioning) for 4th and 8th grade students who took the NCLB-mandated content…

San Francisco's Bridge to Success (BtS) initiative brings together the City and County of San Francisco, the San Francisco Unified School District (SFUSD), the City College of San Francisco (CCSF), and key community organizations to promote postsecondary success for underrepresented students. Various working groups, each comprised of staff from…

Examined concurrent validity of Stanford-Binet Intelligence Scale, 4th edition (SB IV) and the Wechsler Intelligence Scale for Children-Revised (WISC-R) in a homogeneous, nonexceptional sample of 32 early elementary school children. Findings suggest that SB IV has significant positive relationship with WISC-R. The tests displayed a moderate level…

According to a new study of Milwaukee public schools, student achievement has benefited from voucher-based school competition. A novel method, using geocoding, was proposed for measuring the degree of competition within the city of Milwaukee and, in turn, for determining whether such competition has increased or decreased the achievement of public…

The difference in gain scores produced by traditional pretests and those produced by retrospective pretests when compared to posttest scores on the Science Teaching Efficacy Belief Instrument for preservice teachers was investigated in this study. Results indicated that gain scores using the traditional pretest produced significant improvement in…