a-Stratified computerized adaptive testing with b-blocking (AST), as an alternative to the widely used maximum Fisher information (MFI) item selection method, can effectively balance item pool usage while providing accurate latent trait estimates in computerized adaptive testing (CAT). However, previous comparisons of these methods have treated…

An observational study has been carried out to analyse differences in performance between students of different undergraduate curricula in the same written business administration examination, focusing particularly on possible effects of "integrated" or "multi-modular" examinations, a recently widespread format in Italian…

The purpose of this study was to describe the development of a valid and reliable rubric to assess secondary-level solo instrumental music performance based on principles of invariant measurement. The research questions that guided this study included (1) What is the psychometric quality (i.e., validity, reliability, and precision) of a scale…

Objective: This article reports a study that developed and validated the Perceived Social Work Competence Scale (PSWCS) for assessing social work students' competence in Mainland China. Method: The indicators were generated by a broad empirical review of recent literature, confirmed by experts, and indigenized by means of two focus groups of…

The purpose of this study is twofold. The first objective is to develop a valid and reliable measurement tool for measuring the attitudes and opinions of classroom teachers regarding multiculturalism. The second one is to study the classroom teachers' attitudes and opinions towards multiculturalism in terms of gender, socio-economic and devoutness…

The intent of this research was to find an item selection procedure in the multidimensional computer adaptive testing (CAT) framework that yielded higher precision for both the domain and composite abilities, had a higher usage of the item pool, and controlled the exposure rate. Five multidimensional CAT item selection procedures (minimum angle;…

This simulation study examines the measurement precision, item exposure rates, and the depth of the MAP® Growth™ item pools under various grade-level restrictions. Unlike most summative assessments, MAP Growth allows examinees to see items from any grade level, regardless of the examinee's actual grade level. It does not limit the test to items…

The "Moodle" platform has been used to put into practice an ongoing evaluation of the students' Physics learning process. The evaluation has been done on the frame of the course General Physics, which is lectured during the first year of the Physics, Mathematics and Electronic Engineering Programmes at the Faculty of Science and…

The psychometrically sound development of assessment instruments requires pilot testing of candidate items as a first step in gauging their quality, typically a time-consuming and costly effort. Crowdsourcing offers the opportunity for gathering data much more quickly and inexpensively than from most targeted populations. In a simulation of a…

This study aimed to investigate the effects of calibration sample size and item bank size on examinee ability estimation in computerized adaptive testing (CAT). For this purpose, a 500-item bank pre-calibrated using the three-parameter logistic model with 10,000 examinees was simulated. Calibration samples of varying sizes (150, 250, 350, 500,…

We analyzed a pool of items from an admissions test for differential item functioning (DIF) for groups based on age, socioeconomic status, citizenship, or English language status using Mantel-Haenszel and item response theory. DIF items were systematically examined to identify its possible sources by item type, content, and wording. DIF was…

The development of the 21-item Learner Awareness Levels Questionnaire (LALQ) was carried out using data from three separate studies. The LALQ is a self-reporting questionnaire assessing how and why students learn. Study 1 refined the initial pool of items to 21 using exploratory factor analysis. In Study 2, the analysis showed evidence for a…

Optimal test-design methods are applied to rule-based item generation. Three different cases of automated test design are presented: (a) test assembly from a pool of pregenerated, calibrated items; (b) test generation on the fly from a pool of calibrated item families; and (c) test generation on the fly directly from calibrated features defining…

Purpose: To examine the cross-cultural applicability of the Communicative Participation Item Bank (CPIB) through a comparison of respondents with Parkinson's disease (PD) from the United States and New Zealand. Method: A total of 428 respondents--218 from the United States and 210 from New Zealand-completed the self-report CPIB and a series of…

One approach to plagiarism prevention focuses on improving students' authorial identity, but work in this area depends on robust measures. This paper presents the development of a psychometrically robust measure of authorial identity--the Student Attitudes and Beliefs about Authorship Scale. In the item generation phase, a pool of items was…