The purpose of this study is to determine the extent of scale drift on a test that employs cut scores. It was essential to examine scale drift for this testing program because new forms in this testing program are often put on scale through a series of intermediate equatings (known as equating chains). This process may cause equating error to…

Numerous studies have compared the Angoff standard-setting procedure to other standard-setting methods, but relatively few studies have evaluated the procedure based on internal criteria. This study uses a generalizability theory framework to evaluate the stability of the estimated cut score. To provide a measure of internal consistency, this…

The paper by Rupp and Templin (2008) is an excellent work on the characteristics and features of cognitive diagnostic models (CDM). In this article, the authors comment on some substantial and methodological aspects of this focus paper. They organize their comments by going through issues associated with the terms "cognitive,"…

Purpose: To validate an 80-item self-report measure, A Systems Approach to Placement: Self-Assessment for Students and Counselors (SAP-SASC), designed to identify critical areas of knowledge, skills, and competencies possessed by rehabilitation counselors in state vocational rehabilitation (VR) agency settings. Participants: 275 rehabilitation…

The suitability of 52 items for measuring Blackboard course management system success was investigated with the aim of validating the Blackboard CMS success scale in an educational context. Through a survey, the Blackboard course management system (BCMS) success scale was administered to 503 students at the University of Botswana. Data collected…

This research investigates the effect of a web-based model, named "Practicing, Reflecting, and Revising with Web-based Assessment and Test Analysis system (P2R-WATA) Assessment Literacy Development Model," on enhancing assessment knowledge and perspectives of secondary in-service teachers, and adopts a single group experimental research…

When comparing data derived from tests or questionnaires in cross-national studies, researchers commonly assume measurement invariance in their underlying scaling models. However, different cultural contexts, languages, and curricula can have powerful effects on how students respond in different countries. This article illustrates how the…

New testing theories, concepts, and psychometric methods (e.g., item response theory, test equating, and item bank) developed during the past several decades have many advantages over previous theories and methods. In spite of their introduction to the field, they have not been fully accepted by physical educators. Further, the manner in which…

The Mathematics Teaching Efficacy Beliefs Instrument (MTEBI), developed in the United States, is one of the most popular scales used in the study of mathematics teaching efficacy. However, the MTEBI might not be trustworthy in other cultures. This study described the development of a new instrument measuring mathematics teaching efficacy beliefs…

This study reports the construction of the Dialogic Reading Inventory (DRI), a tool for assessing a parent and child's storybook reading behaviors. Twenty-three parent-child dyads participated in the study. The Adult-Child Interactive Reading Inventory (DeBruin-Parecki, 1999) items were grouped into four categories and revised to reflect current…

This study assessed teacher education students' perceptions and satisfaction of their learning experiences concerning an accelerated summer pilot program. In addition, the study provided information on the impact and teaching effectiveness of the accelerated teacher education summer pilot program on participating students. Results from this study…

The accuracy of item parameter estimates in the multidimensional item response theory (MIRT) model context is one that has not been researched in great detail. This study examines the ability of two confirmatory factor analysis models specifically for dichotomous data to properly estimate item parameters using common formulae for converting factor…

The purpose of the study reported herein was to identify the common mistakes made by junior secondary students in Hong Kong when learning algebra and to compare teachers' perceptions of students' ability with the results of an algebra test. An algebra test was developed and administered to a sample of students (aged between 13 and 14 years). From…

Qualitative research methods were employed to investigate characterization of preservice teachers' mathematical understanding. Responses on test items involving algebraic relationships were analyzed using with-in case analysis (Miles and Huberman, 1994) and Pirie and Kieren's (1994) model of growth of mathematical understanding. Five elementary…

This paper presents Programming Adaptive Testing (PAT), a Web-based adaptive testing system for assessing students' programming knowledge. PAT was used in two high school programming classes by 73 students. The question bank of PAT is composed of 443 questions. A question is classified in one out of three difficulty levels. In PAT, the levels of…