Many universities use diagnostic tests to assess incoming students' preparedness for mathematics courses. Diagnostic test results can help students to identify topics where they need more practice and give lecturers a summary of strengths and weaknesses in their class. We demonstrate a process that can be used to make improvements to a mathematics…

This study describes the development and validation of the Higher Education Student Engagement Scale (HESES). The psychometric evaluations of the scale included: (i) factor structure, (ii) internal consistency, and (iii) criterion validity. The HESES was developed based on our proposed five-factor model of student engagement, which was evolved…

The importance of spatial ability for success in a variety of domains, particularly in science, technology, engineering, and mathematics (STEM), is widely acknowledged. Yet, students with high spatial ability are rarely identified, as Talent Searches for academically talented students focus on identifying high mathematical and verbal abilities.…

Cambridge Assessment has more than 20 years experience in assessing Critical Thinking (CT) in a number of diverse tests and qualifications, unrivalled by any other body within the UK. In recent years, a number of research activities have been carried out in order to support these assessments, with a focus on the validity of measurement. This paper…

This paper serves as an illustration of the usefulness of structurally incomplete designs as an approach to reduce the length of educational questionnaires. In structurally incomplete test designs, respondents only fill out a subset of the total item set, while all items are still provided to the whole sample. The scores on the unadministered…

Development of the mathematics functional literacy test (MFLT) is described, issues of predictive and content validity are discussed, and implications for educational policy are presented. Ten basic skill areas identified by the National Council of Supervisors of Mathematics were used as the basis for the development of the MFLT. (RL)

Links the theory of washback with the broader concept of impact in educational measurement and to the recent debate on construct validity associated with Messick. Notes that for many years it was asserted that language tests negatively impacted teaching and learning, an impact known as washback. (25 references) (Author/CK)

We describe a simple classroom activity that demonstrated the process of assessing predictive validity. We assessed changes in student understanding of the process, confidence in psychological testing, and enjoyment in participating in the exercise. Students who completed the activity performed better on a test question about validity and reported…

Where human beings are concerned and complex behavior is involved, prediction of future performance is no simple matter. Scientifically developed, systematically standardized and carefully validated tests have emerged as the most reliable tools in predictive efficacy. If opponents of standardized testing win, society will lose. (Author/CM)

Reliance on subjective grant proposal review methods leads private philanthropies to underfund mental health programs, even when foundations have mental health focuses. This article describes a private mental health foundation's efforts to increase the objectivity of its proposal review process by developing a reliable, valid proposal rating form.…

A major advance in the field of reading over the past 15 years has been the development and validation of screening measures that can detect with reasonable accuracy those kindergartners and first graders likely to experience difficulty in learning to read. Increasingly, these students now receive additional instructional support during the…

In the year 2000, the Alaska High School Graduation Qualifying Examination (HSGQE) was given for the first time. The HSGQE is currently scheduled to be a graduation requirement for all students graduating as of January 2002, but early results from the use of the HSGQE in the Anchorage school district raise serious questions about the use of the…

Discussion of testing methods that adequately measure the ability to perform manipulative tasks focuses on criterion-referenced performance tests (CRPT) to evaluate trainees. Topics discussed include predictive validity; physical fidelity; test construction; testing constraints; performance conditions; criteria for attainment standards; scoring…

This study involved the development, validation, and use of the Individualized Classroom Environment Questionnaire (ICEQ), which measures classroom environment perceptions along dimensions (Personalization, Participation, Independence, Investigation, Differentiation) which differentiate individualized classes from conventional ones. The ICEQ…