With the advent of big data and advances in technology, psychological assessments have become increasingly sophisticated and complex. Nevertheless, traditional psychometric issues concerning the validity, reliability, and measurement bias of such assessments remain fundamental in determining whether score inferences of human attributes are…

About 45 R packages to analyze data using item response theory (IRT) have been developed over the last decade. This article introduces these 45 R packages with their descriptions and features. It also describes possible advanced IRT models using R packages, as well as dichotomous and polytomous IRT models, and R packages that contain applications…

This article aims to provide a theoretical framework for computerized adaptive tests (CAT) and item response theory models for polytomous items. Besides that, it aims to introduce the simulation and live CAT software to the related researchers. Computerized adaptive test algorithm, assumptions of item response theory models, nominal response…

This report describes how big data and an evidence framework can align across five contexts of educational improvement. It explains that before working with big data, there is an important prerequisite: the proposed innovation should align with deeper learning objectives and should incorporate sound learning sciences principles. New curriculum…

In this essay, the author tries to look forward into the 21st century to divine three things: (i) What skills will researchers in the future need to solve the most pressing problems? (ii) What are some of the most likely candidates to be those problems? and (iii) What are some current areas of research that seem mined out and should not distract…

Discusses ways of designing software to minimize the problems associated with translating the users interface from English into a foreign language. The Examiner, a test development and delivery system that was translated from English into Dutch, is used as an example, and both its design and its implementation are described. (LRW)

Presents methodology for designing and delivering computer-assisted diagnostic tests and discusses two natural applications of this methodology: for testing purposes, and for implementing adaptive computer-assisted learning sequences based on test results. (MBR)

Combining psycholinguistic technologies and systems analysis created advances in motivational profiling and numerous new behavioral engineering applications. These advances leapfrog many mainstream statistical research methods, producing superior research results via cause-effect language mechanisms. Entire industries explore motives ranging from…

The videodisc, audiodisc, overlapping instruction, mapping, adaptive testing strategies, intricate instructional branching, and complex media selection models are common expectations for quality courseware today. A two team development structure, consisting of an instructional development team and a test development team, is proposed. This paper…

Describes a project at Chorleywood College (England) which examined the possibility of automating the transcription of braille examination responses for marking by examination boards. Discussion covers the braille code, requirements of the transcription system, an analysis of mock examination papers which led to system modification, and the final…

This article describes a prototype videodisc method of assessing social competence, knowledge, and perception in children with disabilities. It notes major hardware features (Macintosh IIx computer), software features (using SuperCard), improved examinee response modes, and improved data entry techniques. (DB)

The purpose of this paper is to identify and discuss some of the problems presented by the use of computerized adaptive testing (CAT) in an instructional programs environment versus large scale testing applications, and to describe an actual implementation of CAT in an instructional programs setting. This particular application is in the…

When the Mesa, Arizona Public Schools initiated an ambitious writing instruction program in 1978, two assessments based on student writing samples were developed. The first is based on a ninth grade proficiency test. If the student does not pass the test, high school remediation is provided. After 1987, students must pass this test in order to…

Although there are many advantages to using computer-based tests (CBTs) linked to computer-based instruction (CBI), there are also several difficulties. In certain instructional settings, it is difficult to conduct psychometric analyses of test results. Several measurement issues surface when CBT programs are linked to CBI. Testing guidelines…

The Multi-Digit (MDT) testing procedure is a computer-scored testing innovation conceptualized in 1982. It is fully compatible with multiple choice and true/false tests well suited for the testing of discreet terms and concepts such as in fill-in-the-blank examinations. The student reads the question and selects the appropriate response from an…