Both testlet design and hierarchical latent traits are fairly common in educational and psychological measurements. This study aimed to develop a new class of higher order testlet response models that consider both local item dependence within testlets and a hierarchy of latent traits. Due to high dimensionality, the authors adopted the Bayesian…

The Framework for K-12 Science Education (NRC, 2011) outlines core disciplinary ideas, scientific practices and cross-cutting ideas as dimensions on which to base science education. This study outlines the use of core ecological ideas and two scientific practices as a way to examine the cognitive complexity of released large-scale assessment items…

This article considers various approaches to consulting primary pupils about mathematics. This is done first through a literature review and second by drawing on our experience of designing and piloting pupil consultation in collaboration with staff in one primary school. Our concern is with the utility and drawbacks of the methods used rather…

A scale was developed to measure perceptions of sexual abuse in youth sports by assessing (a) the perceived prevalence of sexual abuse committed by pedophilic youth sport coaches, (b) the perceived likelihood that a coach is a pedophile, (c) perceptions on how youth sport organizations should manage the risk of pedophilia, and (d) media influence…

The purposes of this study were to develop and to conduct an initial psychometric evaluation of the Interactive Whiteboard Acceptance Scale (IWBAS). The process of item-generation for the IWBAS was carried out through the sequential mixed-method approach. A total of 149 student teachers from a teacher-education institution in Australia…

This paper aims to tell how the Russian national examination in mathematics (the Uniform State Examination or USE) has been conducted most recently. The author must say at once that the history of the system of secondary school graduation examinations or even the history of the USE will be covered only to the small degree that is necessary for…

In this paper, we describe the initial stage of reliability and validity testing for the Mathematics Education of English Learners Scale (MEELS), which is designed to measure preservice teachers' beliefs about the mathematics education of English learners. To address the content validity, we consulted with experts within the field of mathematics…

Over recent years, UK medical schools have moved to more integrated summative examinations. This paper analyses data from the written assessment of undergraduate medical students to investigate two key psychometric aspects of this type of high-stakes assessment. Firstly, the strength of the relationship between examiner predictions of item…

In a selected response test, aberrant responses such as careless errors and lucky guesses might cause error in ability estimation because these responses do not actually reflect the knowledge that examinees possess. In a computerized adaptive test (CAT), these aberrant responses could further cause serious estimation error due to dynamic item…

L1-L2 translation of separate sentences is one kind of task format used by mainstream EFL teachers to assess their learners' grammatical accuracy. Aimed at improving teacher-written translation items, this study analyses linguistic features potentially causing such decontextualized cues (and their target responses) to sound odd or untypical of…

For several decades, the "three-parameter logistic model" (3PLM) has been the dominant choice for practitioners in the field of educational measurement for modeling examinees' response data from multiple-choice (MC) items. Past studies, however, have pointed out that the c-parameter of 3PLM should not be interpreted as a guessing…

In recent years, many computerized test systems have been developed for diagnosing students' learning profiles. Nevertheless, it remains a challenging issue to find an adaptive testing algorithm to both shorten testing time and precisely diagnose the knowledge status of students. In order to find a suitable algorithm, four adaptive testing…

Every widely used psychological assessment instrument is under scrutiny in terms of cultural fairness. The expectation of the reduced-language (Nonverbal) section of the Stanford-Binet Intelligence Scales, Fifth Edition (SB5; Roid, 2003) is that language ought not to be a modifying factor in terms of final score. The purpose of the present study…

The purpose of the study was to (a) examine the psychometric properties of The Assessment, Evaluation, and Programming System for Infants and Children (AEPS Test); (b) provide a process for establishing psychometric properties for other Curriculum Based Assessments (CBAs); and (c) identify and guide evaluation and subsequent revisions of the AEPS…

Traditionally, women and minorities have not been fully represented in science and engineering. Numerous studies have attributed these differences to gaps in science achievement as measured by various standardized tests. Rather than describe mean group differences in science achievement across multiple cultures, this study focused on an in-depth…