The work aims to improve the assessment of creative problem-solving in science education by employing language technologies and computational-statistical machine learning methods to grade students' natural language responses automatically. To evaluate constructs like creative problem-solving with validity, open-ended questions that elicit…

Psychometricians continue to introduce new approaches to setting cut scores for educational assessments in an attempt to improve on current methods. In this paper we describe the Item-Descriptor (ID) Matching method, a method based on IRT item mapping. In ID Matching, test content area experts match items (i.e., their judgments about the knowledge…

In the past decade, researchers have attempted to develop computer-assisted learning and testing systems to help students improve their learning performance. Conventional testing systems simply provide students with a score, and do not offer sufficient information in order to improve their learning performance. It would be of more benefit to…

Literature on coping strategies and assessments has not previously included international students, who make up approximately 4% of university students. Results of an Internet survey of 555 graduate and undergraduate international students in U.S. universities are reported. The survey included the Brief COPE, a widely used assessment of coping…

A new computerised testing system was used at home to promote learning and also to save classroom instruction time. The testing system combined the features of short-answer and multiple-choice formats. The questions of the multiple-choice problems were presented without the options so that students had to generate answers for themselves; they…

Person-fit research in the context of paper-and-pencil tests is reviewed, and some specific problems regarding person fit in the context of computerized adaptive testing (CAT) are discussed. Some new methods are proposed to investigate person fit in a CAT environment. These statistics are based on Statistical Process Control (SPC) theory. A…

The Scan-Tron Forms Analysis Package (SFAP) is a collection of integrated programs that allow an IBM-PC (or compatible) to collect data from a Scan-Tron 1200 forms reader. In addition to the basic data acquisition capability, the SFAP has additional capabilities related to the viewing and formatting of incoming data. When used in combination with…

A computerized version of the Minnesota Multiphasic Personality Inventory was developed that incorporated both administration and scoring. This method was compared with the original manual form. The results indicated that the test-retest reliability was high regardless of the method of administration and that similar results were obtained on the…

Online assessment of any type is attractive to educators because it allows large amounts of student data to be gathered and accessed quickly. Indeed, online, summative assessments--generally end-of-course, state-level, and placement exams--are making the annual student testing ritual a meaningful audit instead of what some call an…

An a-stratified design (H. Chang and Z. Ying, 1997) is a new concept proposed to address the issues of item security and pool utilization in testing. It has been demonstrated to be effective in lowering the test overlap rate and improving the use of the entire pool when content constraints are not main concerns. However, it cannot really solve the…

Computerized testing has created new challenges for the production and administration of test forms. This paper describes a multi-stage, testlet-based framework for test design, assembly, and administration called computer-adaptive sequential testing (CAST). CAST is a structured testing approach that is amenable to both adaptive and mastery…

Developed a method based on 0-1 linear programming to stratify an item pool optimally for use in alpha-stratified adaptive testing. Applied the method to a previous item pool from the computerized adaptive test of the Graduate Record Examinations. Results show the new method performs well in practical situations. (SLD)

Concerns about Internet-based career assessments include the following: users' technical skill level, lack of screening, psychological factors, cultural bias, unprotected results, technical failures, lack of standardization, digital divide, interpretation problems, outdated tests, copyright violations, administrator qualifications, and hidden…

The use of computer-based test interpretation (CBTI) in career assessment raises numerous ethical and professional issues: How do current standards apply to Internet tests? What are appropriate and inappropriate uses of CBTI? How can it be used in career counseling? Who is qualified to use CBTI? and What are the potential benefits and problems?…

Several classical approaches and alternative approaches to item selection for computerized adaptive testing (CAT) are reviewed and compared. The study also describes procedures for constrained CAT that may be added to classical item selection approaches to allow them to be used for applied testing. (TJH)