This paper investigates how an online test ("Self-Test" developed at the University of Southern Queensland) can enrich students' understanding of their academic numeracy, through a purpose-built, self-assessment tool aligned with online modules. Since its creation and evaluation, the tool has been developed and tailored to suit other…

Inspection of thousands of student responses to computer-marked assessment questions has brought insight into the errors made by adult distance learners of science. Most of the questions analysed were in summative use and required students to construct their own response. Both of these things increased confidence in the reliability of the…

Brief experimental analysis (BEA) can be used to specify intervention characteristics that produce positive learning gains for individual students. A key challenge to the use of BEA for intervention planning is the identification of performance indicators (including topography of the skill, measurement characteristics, and decision criteria) that…

This paper concerns computer aided assessment (CAA) of mathematics in which a computer algebra system (CAS) is used to help assess students' responses to elementary algebra questions. Using a methodology of documentary analysis, we examine what is taught in elementary algebra. The STACK CAA system, http://www.stack.bham.ac.uk/, which uses the CAS…

The authors assessed 2,502 ten-year-old children, members of 1,251 pairs of twins, on a Web-based battery of problems from 5 diverse aspects of mathematics assessed as part of the U.K. national curriculum. This 1st genetic study into the etiology of variation in different domains of mathematics showed that the heritability estimates were moderate…

In U.S. schools, students must pass statewide competency tests to graduate from high school. In this article, the authors summarize the development and testing of a program implemented to improve the skills of students failing to "make the grade" on these high-stakes tests. District personnel randomly assigned twenty-eight students who…

Scoring accuracy and item functioning were studied for an open-ended response type test in which correct answers can take many different surface forms. Results with 1,864 graduate school applicants showed automated scoring to approximate the accuracy of multiple-choice scoring. Items functioned similarly to other item types being considered. (SLD)

Extended matching sets questions (EMSQs) are a form of multiple-choice question (MCQ) consisting of a stem (the question or scenario) with an extended number of possible answers. Although there is no consensus on their absolute format, for the purpose of this paper a multiple-choice question with ten or more alternative answers is considered to be…

The operating characteristics of 114 mathematics pretest items from the Praxis I: Computer Based Test were analyzed in terms of item attributes and test developers' judgments of item difficulty. Item operating characteristics were defined as the difficulty, discrimination, and asymptote parameters of a three parameter logistic item response theory…

A computer-delivered problem-solving task based on cognitive research literature was developed and its validity for graduate admissions assessment was studied with 107 undergraduates. Use of the test, which asked examinees to sort word-problem stems by prototypes, was supported by the findings. (SLD)

Gateway tests provide a means of assuring that students in reformed precalculus and calculus courses acquire the algebraic and computational skills needed in courses following these, while allowing the focus of the course to be on the conceptual understanding intrinsic to the reformed courses. However, logistical difficulties plague the…