Adaptive measurement of change (AMC) is a psychometric method for measuring intra-individual change on one or more latent traits across testing occasions. Three hypothesis tests--a Z test, likelihood ratio test, and score ratio index--have demonstrated desirable statistical properties in this context, including low false positive rates and high…

Two independent statistical tests of item compromise are presented, one based on the test takers' responses and the other on their response times (RTs) on the same items. The tests can be used to monitor an item in real time during online continuous testing but are also applicable as part of post hoc forensic analysis. The two test statistics are…

The computer based tests are capable of putting together a lot of interactions and fascinating question types, such as simulations, online tests, and measurement of skills, rather than simply assessing by paper-pencil tests. The computerized test result has greater standardization of test administration. The aim of this study is to seek out the…

This article deals with a theory-based investigation of the diagnostic problem-solving process in professional contexts. To begin with, a theory of the diagnostic problem-solving process was developed drawing on findings from different professional contexts. The theory distinguishes between four sub-processes of the diagnostic problem-solving…

Meijer and van Krimpen-Stoop noted that the number of person-fit statistics (PFSs) that have been designed for computerized adaptive tests (CATs) is relatively modest. This article partially addresses that concern by suggesting three new PFSs for CATs. The statistics are based on tests for a change point and can be used to detect an abrupt change…

An IRT-based sequential procedure is developed to monitor items for enhancing test security. The procedure uses a series of statistical hypothesis tests to examine whether the statistical characteristics of each item under inspection have changed significantly during CAT administration. This procedure is compared with a previously developed…

As online education becomes a more popular and permanent option for obtaining an education after high school, it also raises questions as to the academic rigor of such classes and the academic integrity of the students taking the classes. The purpose of the current study is to explore the integrity issue and to investigate student performance on…

We examine the impact of remedial and developmental courses on college students with varying levels of academic preparedness, thus focusing on a wider range of students than previous studies. Using a regression discontinuity design, we provide causal estimates of the effects of placement in different levels of remedial courses on short-,…

With an increase in the number of online tests, the number of interruptions during testing due to unexpected technical issues seems to be on the rise. For example, interruptions occurred during several recent state tests. When interruptions occur, it is important to determine the extent of their impact on the examinees' scores. Researchers such as…

The purpose of this study was to examine the relationship between metacognition as measured in real-life situations and IQ scores as reflected by performance on the Raven Standard Progressive Matrices Scale. It is also intended in this study to report on whether or not there were significant differences in performance on the metacognitive…

Multimedia in assessing clinical decision-making skills (CDMS) has been poorly studied, particularly in comparison to traditional text-based assessments. The literature suggests multimedia is more difficult for trainees. We hypothesize that pediatric residents score lower in diagnostic skill when clinical vignettes use multimedia rather than text…

In this paper we report the results of an experiment designed to test the hypothesis that when faced with a question involving the inverse direction of a reversible mathematical process, students solve a multiple-choice version by verifying the answers presented to them by the direct method, not by undertaking the actual inverse calculation.…

This study investigated the ability of test takers' behaviors during online assessments to detect probable cheating incidents. Specifically, this study focused on the role of time delay and head pose for detection of cheating incidences in a lab-based online testing session. The analysis of a test taker's behavior indicated that not only time…

The definition of what it means to take a test online continues to evolve with the inclusion of a broader range of item types and a wide array of devices used by students to access test content. To assure the validity and reliability of test scores for all students, device comparability research should be conducted to evaluate the impact of…

It was investigated how domain-specific knowledge, fluid intelligence, vocational interest and work-related self-efficacy predicted domain-specific problem-solving performance in the field of office work. The participants included 100 German VET (vocational education and training) students nearing the end of a 3-year apprenticeship program as an…