Online testing holds much promise for assessing students' complex science knowledge and inquiry skills. In the current study, we examined the comparative effectiveness of assessment tasks and test items presented in online modules that used either a static, active, or interactive modality. A total of 1,836 students from the classrooms of 22 middle…

Many latent traits in social sciences display a hierarchical structure, such as intelligence, cognitive ability, or personality. Usually a second-order factor is linearly related to a group of first-order factors (also called domain abilities in cognitive ability measures), and the first-order factors directly govern the actual item responses.…

Discipline-based science concept assessments are powerful tools to measure learners' disciplinary core ideas. Among many such assessments, the Brief Electricity and Magnetism Assessment (BEMA) has been broadly used to gauge student conceptions of key electricity and magnetism (E&M) topics in college-level introductory physics courses.…

Purpose: This study evaluated psychometric properties of 2 phonological awareness (PA) tests normed for hearing children when used with deaf and hard-of-hearing (DHH) children with functional hearing. It also provides an in-depth description of these children's PA. Method: One hundred and eight DHH children (mean age = 63.3 months) with cochlear…

This study compared the functioning of positively and negatively worded personality items using item response theory. In Study 1, word pairs from the Goldberg Adjective Checklist were analyzed using the Graded Response Model. Across subscales, negatively worded items produced comparatively higher difficulty and lower discrimination parameters than…

Qian and Schedl's Depth of Vocabulary Knowledge Test was administered to 31 native-speaker undergraduates under an "unconstrained" condition, in which the number of responses to headwords was unfixed, whereas a corresponding group ("n" = 36) completed the test under the original "constrained" condition. Results…

This study contributed to the school readiness literature by examining the factor structure and reliability of a revised version of the Kindergarten Student Entrance Profile (KSEP). Teachers rated 579 Latino/a children during the first month of kindergarten using the KSEP. Factor analysis procedures (exploratory factor analysis [EFA] and…

Analyzing examinees' responses using cognitive diagnostic models (CDMs) has the advantage of providing diagnostic information. To ensure the validity of the results from these models, differential item functioning (DIF) in CDMs needs to be investigated. In this article, the Wald test is proposed to examine DIF in the context of CDMs. This study…

Objective structured clinical examinations (OSCEs) are used worldwide for summative examinations but often lack acceptable reliability. Research has shown that reliability of scores increases if OSCE checklists for medical students include only clinically relevant items. Also, checklists are often missing evidence-based items that high-achieving…

The full-information maximum likelihood (FIML) method makes it possible to estimate and analyze structural equation models (SEM) even when data are partially missing, enabling incomplete data to contribute to model estimation. The cornerstone of FIML is the missing-at-random (MAR) assumption. In (unidimensional) computerized adaptive testing…

Does correctly answering a test question about a multiterm fact enhance memory for the entire fact? We explored that issue in 4 experiments. Subjects first studied Advanced Placement History or Biology facts. Half of those facts were then restudied, whereas the remainder were tested using "5 W" (i.e., "who, what, when, where",…

This study aims at determining to what extent visuals contribute to success in non-routine problem solving process and what types of errors are made when solving with visuals. Comparative model was utilized for identifying the effect of visuals on student achievement, and clinical interview technique was used to determine the types of errors. In…

There are many reasons to believe that open-ended (OE) and multiple-choice (MC) items elicit different cognitive demands of students. However, empirical evidence that supports this view is lacking. In this study, we investigated the reactions of test takers to an interactive assessment with immediate feedback and answer-revision opportunities for…

The OECD is planning to enhance existing PISA assessment instruments in reading, mathematics and science so that they will be more suitable to the context of developing countries. The main purpose of this paper is to identify the main technical issues associated with this aim. The paper reports detailed analysis of the existing PISA item pool and…

Although several scales are used to measure general and clinical learning climates, there are no scales that assess the preclinical learning climate. Therefore, the purpose of this study was to develop an effective measurement tool in order to assess the preclinical learning climate. In this cross-sectional study, data were collected from 3,540…