The goal of this study is to show a novel way of using large-scale data (N = 6203) to identify pupils' strategies when solving missing value number equations. It is based on the assumption that wrong numerical results appearing more frequently than would be the case if they were consequences of random guessing can be expected to be underlain by a…

Using classical test theory and item response theory, this study applied sequential procedures to a real operational item pool in a variable-length computerized adaptive testing (CAT) to detect items whose security may be compromised. Moreover, this study proposed a hybrid threshold approach to improve the detection power of the sequential…

One major aim of international large-scale assessments (ILSA) like PISA is to monitor changes in student performance over time. To accomplish this task, a set of common items (i.e., link items) is repeatedly administered in each assessment. Linking methods based on item response theory (IRT) models are used to align the results from the different…

Wollack, Cohen, and Eckerly suggested the "erasure detection index" (EDI) to detect fraudulent erasures for individual examinees. Wollack and Eckerly extended the EDI to detect fraudulent erasures at the group level. The EDI at the group level was found to be slightly conservative. This article suggests two modifications of the EDI for…

Wollack, Cohen, and Eckerly (2015) suggested the "erasure detection index" (EDI) to detect fraudulent erasures for individual examinees. Wollack and Eckerly (2017) extended the EDI to detect fraudulent erasures at the group level. The EDI at the group level was found to be slightly conservative. This paper suggests two modifications of…

Simultaneous with a call for standardized assessments to assess developing rather than preexisting or surface knowledge (Sawyer, 2006) has been a growth in awareness of the unavoidable interactive nature of any form of assessment and this awareness has created a social turn towards approaches to language assessment (McNamara & Roever, 2006).…

A total of 19 graduate students enrolled in a graduate course conducted 6 consecutive administrations of the Wechsler Intelligence Scale for Children, 4th edition (WISC-IV, Canadian version). Test protocols were examined to obtain data describing the frequency of examiner errors, including administration and scoring errors. Results identified 511…

Investigated most frequent types of examiner errors made by graduate students (n=26) in administering Wechsler Intelligence Scale for Children-Revised (WISC-R) and examined on which items these mistakes were most likely to occur. Findings identified deficiencies in traditional methods of teaching students how to administer the WISC-R. Students…

Two indices for measuring the degree of conformity or consistency of an individual examinee's response pattern on a set of items are developed. The use of the indices for spotting aberrant response patterns of examinees is detailed. (Author/JKS)

Examined the number and type of scoring errors made on Holland's Self-Directed Search-R (SDS-R). Participants were high school juniors and seniors (N=91). Results indicate that although some errors were made, the SDS-R was perceived as a useful career assessment tool. Implications are discussed. (Author/RJM)

The concepts of cognitive development and objectivity are explored preparatory to a discussion of a suitable theory of development to be used as the foundation for developmentally-based standardized tests. It is hypothesized that Piagetian theory is the most appropriate basis for such tests and two possible approaches for constructing…

The biasing effects of a pretest on subsequent post-test results were investigated in two experimental studies. In general, the results argue for using designs without pretests. (Author/JKS)

Appropriateness measurement is a general approach to the problem caused by multiple choice tests failing to measure accurately the ability of atypical examinees. The conceptual framework of appropriateness measurement is presented, and several statistical indices of the appropriateness of a multiple choice test for an examinee are noted. A series…

Major efforts of this project fall into four categories: (1) investigations were performed on the relationship between the dimensionality of a dataset and its underlying cognitive processes; (2) two approaches for diagnosing erroneous rules of operation were developed (an "error vector" system for constructing error diagnostic programs…

Two studies are presented in this report. The first is titled "Empirical Studies of Multilevel Approaches to Test Development and Interpretation: Measuring Between-Group Differences in Instruction." Because of a belief that schooling does affect student achievement, researchers have questioned the empirical and measurement techniques…