There has been considerable research regarding the extent to which psychometric sound assessments sometimes yield individual score estimates that are inconsistent with the response patterns of the individual. It has been suggested that individual response patterns may differ from expectations for a number of reasons, including subject motivation,…

Applications of item response theory to practical testing problems including equating, differential item functioning, and computerized adaptive testing, require that item parameter estimates be placed onto a common metric. In this study, three methods for developing a common metric under item response theory are compared: (1) linking separate…

A nominal response model-based computerized adaptive testing procedure (nominal CAT) was implemented using simulated data. Ability estimates from the nominal CAT were compared to those from a CAT based upon the three-parameter logistic model (3PL CAT). Furthermore, estimates from both CAT procedures were compared with the known true abilities used…

Major efforts of this project fall into four categories: (1) investigations were performed on the relationship between the dimensionality of a dataset and its underlying cognitive processes; (2) two approaches for diagnosing erroneous rules of operation were developed (an "error vector" system for constructing error diagnostic programs…

This paper has shown the advantages of tailored testing over traditional methods, the need for latent trait theory in the application of tailored testing, and some of the results available to show the quality of estimates obtained by tailored testing procedures. Since the tailored testing procedures overcome many of the problems with traditional…

Discussion of how computer technology can be integrated into elementary school instruction focuses on evaluating student learning through test scoring. Highlights include descriptions of a computer-based instructional delivery system, modified confidence weighted admissible probability measurement (MCW-APM), and computer-managed instructional…

This articles discusses ways to respond to the need for criterion referenced information using Bayes' theorem, a method coupled with criterion referenced testing in the early 1970s. The theorem determines the most likely classification for an examinee from a dichotomous choice or through placement on a categorical or interval scale. A discussion…

A small-scale study was conducted to compare test-taking strategies, problem-solving strategies, and general impressions about the test across computer and paper-and-pencil administration modes. Thirty-six examinees (high school students) participated in the study. Each examinee took a test in one of the content areas of English, Mathematics,…

This report provides a brief introduction to microcomputer technology and discusses five uses of microcomputers in classroom testing: item storage, test assembly, test administration, test scoring, and test score reporting and analysis. It focuses on the testing applications of microcomputer technology. (PN)

A total of 520 high school students were randomly assigned to a paper-and-pencil test (PPT), a computerized standard test (CST), or a computerized adaptive test (CAT) version of the Dutch School Attitude Questionnaire (SAQ), consisting of ordinal polytomous items. The CST administered items in the same order as the PPT. The CAT administered all…

One of the most significant challenges facing policy makers in education today is to ensure that state assessments designed to measure student performance across specified grade-level curriculum content standards will allow all students to demonstrate what they have learned. This challenge is made complex by the varied attributes of students with…

Criterion-referenced testing (CRT) is defined as a method of ascertaining an individual's status with respect to some performance standard. Computer-assisted testing (CAT) is a method of constructing tests using a variety of computer techniques such as a single test computer printouts, stored item banks, teacher specified criteria, machine…

In the Information Communication Technology era teachers will have to wisely use the online environment in order to realize a new pedagogy. The penetration of the internet and collaborative online instruments to teaching and learning affect the quality of teaching. We have developed a digital indicator to evaluate the quality of the online tasks…

In 2006, a consortium of state departments of education, led by the North Carolina Department of Public Instruction and the Council of Chief State School Officers, was awarded a grant from the U.S. Department of Education to investigate methods of determining comparability of variations of states' assessments used to meet the requirements of the…

This paper will explore some of the practical options that are available to teachers as we move towards Assessment 2.0. Assessment 2.0 describes an environment in which the teacher sets tasks that allow students to use more dynamic, immersive and interactive environments for exploring and creating responses to sophisticated assessment tasks.…