Current interest in measuring quality of life is generating interest in the construction of computerized adaptive tests (CATs) with Likert-type items. Calibration of an item bank for use in CAT requires collecting responses to a large number of candidate items. However, the number is usually too large to administer to each subject in the…

Metacognitions of agency were investigated using a computer task in which X's and O's streamed from the top of a computer screen, and the participants moved the mouse to get the cursor to touch the X's and avoid the O's. After each 15 s trial, participants made judgments of agency and judgments of performance. Objective control was either…

The use of timed, essay examinations is a well-established means of evaluating student learning in higher education. The reliability of essay scoring is highly problematic and it appears that essay examination grades are highly dependent on language and organisational components of writing. Computer-assisted scoring of essays makes use of language…

Temporal patterns of behavior have been observed in real-life performances such as bill passing in the U.S. Congress, in-class studying, and quiz taking. However, the practical utility of understanding these patterns has not been evaluated. The current study demonstrated the presence of temporal patterns of quiz taking in a university-level…

Aim: The purpose of this study was to characterize handwriting deficits in children with developmental coordination disorder (DCD) using computerized movement analyses. Method: Seventy-two children (40 females, 32 males; mean age 7y, SD 7mo; range 6y 2mo to 7y 11mo) with handwriting deficits (33 with DCD, 39 without DCD); and 22 age- and…

This article details the construction of a computer program to test cognitive processing differences in adolescents engaged in a standard presentation of tests versus a fantasy-based game presentation. The article will discuss the challenges of creating a replication of traditional psychological tests into a new medium which holds comparable…

The Missionary Training Center (MTC), affiliated with the Church of Jesus Christ of Latter-day Saints, needs a reliable and cost effective way to measure the oral language proficiency of missionaries learning Spanish. The MTC needed to measure incoming missionaries' Spanish language proficiency for training and classroom assignment as well as to…

This study explores the potential for automated indices related to speech delivery, language use, and topic development to model human judgments of TOEFL speaking proficiency in second language (L2) speech samples. For this study, 244 transcribed TOEFL speech samples taken from 244 L2 learners were analyzed using automated indices taken from…

This paper presents a novel task-oriented, user-centered, multi-method evaluation (TUME) technique and shows how it is useful in providing a more complete, practical and solution-oriented assessment of the accessibility and usability of Learning Management Systems (LMS) for blind and visually impaired (BVI) students. Novel components of TUME…

The Program for International Student Assessment (PISA) is a system of international assessments that allows countries to compare outcomes of learning as students near the end of compulsory schooling. PISA core assessments measure the performance of 15-year-old students in mathematics, science, and reading literacy every 3 years. Coordinated by…

This article reports on the content range and measurement precision of an upper extremity (UE) computer adaptive testing (CAT) platform of physical function in children with cerebral palsy. Upper extremity items representing skills of all abilities were administered to 305 parents. These responses were compared with two traditional standardized…

This article delves into a relatively unexplored area of measurement by focusing on adaptive testing with unidimensional pairwise preference items. The use of such tests is becoming more common in applied non-cognitive assessment because research suggests that this format may help to reduce certain types of rater error and response sets commonly…

The interpretation of retest scores is problematic because they are potentially affected by measurement and predictive bias, which impact construct validity, and because their size differs as a function of various factors. This paper investigates the construct stability of scores on a figural matrices test and models retest effects at the level of…

Research on written language comprehension has generally assumed that the phonological properties of a word have little effect on sentence comprehension beyond the processes of word recognition. Two experiments investigated this assumption. Participants silently read relative clauses in which two pairs of words either did or did not have a high…

In Hong Kong, onscreen marking (OSM) is superseding paper-based marking (PBM) across the entire national examinations system. This paper describes a qualitative study of the attitudes of Liberal Studies markers towards OSM. This becomes a compulsory subject in Hong Kong's new senior secondary school curriculum to be first examined in 2012, with a…