Language test preparation has often been studied within the consequential validity framework in relation to ethics, equity, fairness, and washback of assessment. The use of independent and integrated speaking tasks in the "TOEFL iBT"® test represents a significant development and innovation in assessing speaking ability in academic…

The study aimed at investigating TOEIC score distribution patterns and learner satisfaction in an intensive TOEIC course and drew implications for pedagogical practice. A one-group pre-test post-test experiment and a survey on learner satisfaction were conducted on Taiwanese college EFL students (n = 50) in a case study. Results showed that the…

This chapter introduces theory that undergirds the role of testing adaptations in assessment, provides examples of item modifications and testing accommodations, reviews research relevant to each, and introduces a new paradigm that incorporates opportunity to learn (OTL), academic enablers, testing adaptations, and inferences that can be made from…

Two models were identified for criterion-referenced tests, one based on the assumption of a continuous achievement variable and the other assuming a dichotomous or binary variable. Several test characteristics were examined and contrasted for the two models, including the distribution of scores, establishment of a cutting score, test length, item…

The relationship between true ability (operationally defined as the number of items for which the examinee actually knew the correct answer) and the effects of guessing upon observed test variance was investigated. Three basic hypotheses were treated mathematically: there is no functional relationship between true ability and guessing success;…

Forming a sequence covering the various aspects of the simplex model, four articles are presented here under the following titles: "A Simplex Model for Analyzing Academic Growth", "Analyzing Ratings With Correlated Intrajudge Measurement Errors", "The Correlation of States With Gain", and "The Reliability of…

A model is proposed for investigating test validity as a predictor of a criterion variable when there are both missing and censored scores in the data set. Implications for maximum likelihood estimation are discussed, and the method is illustrated with hypothetical data sets. (SLD)

In 1998, the British Government introduced the National Literacy Strategy (NLS) in all state primary schools (encompassing students aged 5-11) in England in a bid to raise literacy standards. A year earlier, 13 local education authorities were involved in the piloting of the project, including the city of Newcastle upon Tyne. The first Newcastle…

Describes recent research attempts to draw inferences about the relative standing of the states on the basis of mean SAT scores. This paper identifies five serious errors that call into question the validity of such inferences. Some plausible ways to avoid the errors are described. (Author/LMO)

Confidence testing has been used in varying forms over the past 40 years as a method for increasing the amount of information available from objective test items. This paper traces the development of the procedure from Hevner's beginning method up to the various methods in use today and describes both the testing procedures and scoring methods…

Draw-a-Person (DAP) samples from 108 adolescents and adults with mental retardation were scored using Naglieri's cognitive and emotional disturbance scoring systems. Visual-motor skills emerged as the best predictor of DAP cognitive scores, more predictive than intelligence. Findings suggest caution in using DAP as an index of intelligence or as a…

A random sample of 113 members of the American Vocational Education Research Association (AVERA) was surveyed to obtain baseline information regarding AVERA members' perceptions of statistical significance tests. The Psychometrics Group Instrument was used to collect data from participants. Of those surveyed, 67% were male, 93% had earned a…

The purpose of this research was to investigate whether teachers' attitudes toward specific test preparation, whether they saw administration practices such as cheating, and the amount of pressure they felt to increase standardized test scores predicted teachers' test preparation and administration practices. Using the theory of personal action of…

For 2 decades, policymakers have pretended that bureaucratic, state-imposed standards, testing, and sanctions will fundamentally raise all schoolchildren's academic achievement and create productive citizens. The losers have been children of the poor, working class, and undereducated. Policymakers are holding schools and children accountable for…

The development of the Student Selection Battery for the Beginning Teacher Evaluation Study is described. This battery, which measures reading and mathematics achievement in second and fifth grade students, will be used to select target students for the study of teaching effectiveness. Methodological considerations included: the limited amount of…