Many researchers have investigated the effects of students' prior knowledge upon learning chemistry, for example, the tenacity of alternative conceptions. Knowledge about learning also shapes students' learning of chemistry. This research describes the development of CHEMX, a survey instrument that measures an aspect of knowledge about learning…

Recent research studies have reported on how novices and experts differ in storing, organizing, and retrieving subject matter knowledge and on how they apply their knowledge to solve new problems. These findings have been integrated and implemented in a computer environment to help novices improve their problem-solving skills. An outline of this…

In this paper, it was investigated the effect of digital portfolio assessment process on the drawing and story writing performances of the 14-15 ages students. For this reason, a digital portfolio assessment rubric was prepared in order to evaluate students' drawing and story writing works. For the validity and reliability analyze was applied to…

In this paper, it was investigated the effect of digital portfolio assessment process on the drawing and story writing performances of the 14-15 ages students. For this reason, a digital portfolio assessment rubric was prepared in order to evaluate students' drawing and story writing works. For the validity and reliability analyze was applied to…

At the Orange County Public School District in Orlando, Florida, assessing reading skills among the youngest students used to be quite a process. Relying on rudimentary products such as paper and pencils, the strategy hinged on the bubble sheets teachers administered to students once a year. After teachers scored the exams, they sent them to the…

Research on computer-based writing evaluation has only recently focused on the potential for providing formative feedback rather than summative assessment. This study tests the impact of an automated essay scorer (AES) that provides formative feedback on essay drafts written as part of a series of online teacher education case studies. Seventy…

The attractiveness of computer-based tests (CBTs) is due largely to their capability to expand the ways we conduct testing. A relatively unexplored application, however, is actively using the computer to reduce construct-irrelevant variance while a test is being administered. This investigation introduces the effort-monitoring CBT, in which the…

Two local methods for observed-score equating are applied to the problem of equating an adaptive test to a linear test. In an empirical study, the methods were evaluated against a method based on the test characteristic function (TCF) of the linear test and traditional equipercentile equating applied to the ability estimates on the adaptive test…

Researchers studying monitoring accuracy currently use two different indexes to estimate accuracy: relative accuracy and absolute accuracy. The authors compared the distributional properties of two measures of monitoring accuracy using Monte Carlo procedures that fit within these categories. They manipulated the accuracy of judgments (i.e., chance…

Objective: The Accreditation Council for Graduate Medical Education and the Liaison Committee on Medical Education have mandated the transition from written global evaluation methods to competency-based assessments in resident and medical student training. Assessment of competency requires analysis of performance data from numerous sources. This…

The College of Business and Economics at the University of Idaho conducted a pilot study that used commercially available encryption software called Securexam to deliver computer-based examinations. A multi-step implementation procedure was developed, implemented, and then evaluated on the basis of what students viewed as valuable. Two key aspects…

Much has been written in recent years about advances in assessment technologies designed to aid decision making in the juvenile justice system. Adoption and implementation of this latest generation of actuarial tools, however, have lagged behind their development. Assessment in juvenile justice exemplifies the "science-practice gap" that…

Computer aided assessment (CAA) tools are more and more widely adopted in academic environments mixed to other assessment means. In this article, we present a CAA Web application, named eWorkbook, which can be used for evaluating learner's knowledge by creating (the tutor) and taking (the learner) on-line tests based on multiple choice, multiple…

Simulated data were used to investigate the performance of modified versions of the Mantel-Haenszel and standardization methods of differential item functioning (DIF) analysis in computer-adaptive tests (CATs). Each "examinee" received 25 items out of a 75-item pool. A three-parameter logistic item response model was assumed, and…

The General Computer Adaptive Test (CAT) of the Graduate Record Examinations (GRE) includes three operational sections that are separately timed and scored. A "no score" is reported if the examinee answers fewer than 80% of the items or if the examinee does not answer all of the items and leaves the section before time expires. The 80%…