Four human judges agreed highly among themselves about the presence of errors committed by 60 adults solving algebra word problems, but were in less agreement about categorizing faults. An expert system agreed with judges about correctness of answers, but was in even less agreement about categorizing the faults. (SLD)

This study evaluated expert system diagnoses of examinees' solutions to complex constructed-response algebra word problems. Problems were presented to three samples (30 college students each), each of which had taken the Graduate Record Examinations General Test. One sample took the problems in paper-and-pencil form and the other two on computer.…

Two computer-based categorization tasks were developed and pilot tested. In study 1, the task asked examinees to sort mathematical word problem stems according to prototypes. Results with 9 faculty members and 107 undergraduates showed that those who sorted well tended to have higher Graduate Record Examination General Test scores and college…