High-quality science assessments are multi-dimensional. They promote disciplinary practices, core ideas, cross-cutting concepts, and science sense-making. In this paper, we investigate the feasibility of using generative artificial intelligence (GenAI), specifically multimodal large language models (MLLMs), to annotate and provide improvement…

The "TextEvaluator"® text analysis tool is a fully automated text complexity evaluation tool designed to help teachers, curriculum specialists, textbook publishers, and test developers select texts that are consistent with the text complexity guidelines specified in the Common Core State Standards.This paper documents the procedure used…

In this article, Structural communication grid (SCG), an alternative measurement and evaluation technique, has been firstly summarised and the design, development and implementation of a computer based SCG system have been introduced. The system is then tested on a sample of 154 participants consisting of candidate students, science teachers and…

MicroCAT version 3.0--an integrated test development, administration, and analysis system--is reviewed in this first article of a series on testing software. A framework for comparing testing software is presented. The strength of this package lies in the development, banking, and administration of items composed of text and graphics. (SLD)

Explores how computers can assist teachers in developing tests. Describes "TESTWORKS," a computerized test generator. Lists 12 other test-generating programs available for Apple II computers, detailing data-entry features, hard copy features, and program features that permit interactive testing. Discusses using word processing or…

Reviews three software titles: (1) "Make Test for the Macintosh," a program for teachers to develop tests of any length and variety; (2) "The Great Ocean Rescue," an interactive, multimedia program that allows students to solve hypothetical problems affecting oceans; and (3) "Research Paper Writer," a computer simulation that guides students in…

Discusses the advantages and disadvantages of test generation programs. Includes setting up, printing exams and "bells and whistles." Reviews eight computer packages for Apple and IBM personal computers. Compares features, costs, and usage. (CW)

The four main subsystems of the MicroCAT Testing System for developing, administering, scoring, and analyzing computerized tests using conventional or item response theory methods are described. Judgments of three users of the system are included in the evaluation of this software. (SLD)

The development and preliminary evaluation of the Computerized Adaptive Testing System (CATSYS), a new testing package for IBM-compatible microcomputers, are described. CATSYS can be used to administer and score operational adaptive tests or to conduct on-line computer simulation studies. The package incorporates several innovative features,…

Describes capabilities of test and worksheet generator software; discusses features to consider when evaluating the software for purchase; and presents reviews of eight test and worksheet generators: P.D.Q., Testmaster, Easy Quiz Maker, EA Mathematics Worksheet Generator, Mathematics Worksheet Generator, Earth Science Test Maker, Individualized…

This paper contains the technical specifications, schematic diagrams, and program printout for a computer software package for the development and administration of diagnostic tests. The second version of the Diagnostic Testing Package DX consists of a PASCAL-based set of modules located in two main programs: (1) EDITTEST creates, modifies, and…

The purpose of this paper is to describe some of the current changes in test development that are taking place because of the availability and capabilities of computers, especially microcomputers. Item banking and test assembly are discussed, and a comprehensive testing system is described. (BW)

This instructional module presented by the National Council on Measurement in Education (NCME) provides guidelines for teachers and other test developers to help them construct test item banks. Setting up an item bank and using it are described, with a consideration of software that can be used. (SLD)

Computer adaptive testing is the study of scoring tests and questions based on assumptions concerning the mathematical relationship between examinees' ability and the examinees' responses. Adaptive student tests, which are based on item response theory (IRT), have many advantages over conventional tests. We use the least square method, a…

The constructive use of microcomputers in the development of tests requires thoughtful attention to the questions addressed in this paper: What is the purpose for testing? How can a microcomputer help? Which microcomputer system is best? What pitfalls should be avoided? (BW)