Language test preparation has often been studied within the consequential validity framework in relation to ethics, equity, fairness, and washback of assessment. The use of independent and integrated speaking tasks in the "TOEFL iBT"® test represents a significant development and innovation in assessing speaking ability in academic…

The study examined advantages and disadvantages of computerised assessment compared to traditional evaluation. It was based on two samples of college students (n=54) being examined in computerised tests instead of paper-based exams. Students were asked to answer a questionnaire focused on test effectiveness, experience, flexibility and integrity.…

Effects of item presentation mode on degree of leniency bias in responses to field research questionnaires were studied. Two modes were examined: first with items measuring the same dimensions grouped together and second with such items distributed randomly. The random mode showed substantially less leniency response bias. (Author/BW)

The empirical evidence does not support the prevailing conventional wisdom that it is advisable to mix positively and negatively worded items in psychological measures to counteract acquiescence response bias. An experiment, evaluating subjects' ability to respond accurately to both positive and reversed items on a questionnaire, analyzed post-hoc…

Reports on two studies that indicate Role Category Questionnaire-based indicators do not reflect differences in construct system development. Shows that respondents reported their actions were intentional, goal- and other-directed, and communication. Reveals a substantial correlation between verbal efficiency and number of abstract descriptors,…

Students in an introductory college course (n=275) responded to equivalent 20-item halves of a test under number-right and formula-scoring instructions. Formula scores of those who omitted items overaged about one point lower than their comparable (formula adjusted) scores on the test half administered under number-right instructions. In contrast,…

High school sophomores' (N=1,717) self-reported coursework and grade information for 26 courses was collected as part of a fall 1991 Preliminary American College Test Plus (P-ACT+) administration. Students were from 55 high schools. The accuracy with which students reported courses taken and grades earned was investigated by comparing this…

The ability of respondents to properly execute Thurstone scaling procedures as opposed to Likert scaling procedures was investigated in a sample of high school students. Results indicate difficulty among respondents using Thurstone-type instructions to resist giving Likert-type responses. (JKS)

This paper is part 3 of Research Department Report Number 123, "Exploring the T.R.Q.: An Assessment of the Effectiveness of the Teachers' Rating Questionnaire," which gave questionnaire users information necessary to tailor the instrument to their own needs. Retention of TRQ questions which generated good distributions of teacher ratings…

This report assesses the validity, reliability, and efficiency of the Teachers' Rating Questionnaire (TRQ), a pupils' school success measure developed in connection with a 1961 longitudinal Study of Achievement. TRQ ratings on nearly 14,000 pupils, gathered in the Study of Achievement and a New Canadian Report, constituted the data source.…

Three papers are included in this document. The first, "An Introduction to the Problem of Test User Qualifications," by Kevin L. Moreland, is a short history of the American Psychological Association (APA)/American Educational Research Association (AERA)/National Council on Measurement in Education (NCME) Working Group on Test User…

Measures of adults' attitudes toward nuclear war are briefly discussed, and Mayton's Modified World Affairs Questionnaire (MWAQ) is described. The 23-item MWAQ was developed from Novak and Lerner's World Affairs Questionnaire, a nuclear war attitude measure by Mayton and Delamater, and related interview items by Jeffries. When the MWAQ was…

The test battery and the norms groups are briefly described. Questions are raised about the reliability and validity data in the manual. The Test of Learning Ability and the Educational Planning Questionnaire are indicated to be useful additions to the battery. (CTM)

To determine the long-run impact of the CERLI training program, the trainees' abilities to function as Specialists in Continuing Education (SCE) had to be measured and assessed. This assessment is a followup to "Assessment of the CERLI Training Program Specialist in Continuing Education" (EA 002 706). The document reports on attempts to…