Presented at the national conference for the American Educational Research Association (AERA) in 2009. This discussed the development and implementation of the new SAT writing section.

Introduction: Health educators who teach professionals about evidence-based practice (EBP) need instruments to measure change in skills and knowledge. This study aimed to develop and evaluate the interrater reliability, internal consistency, and responsiveness of the Adapted Fresno Test (AFT) of competence in EBP. Methods: Reliability testing…

This study uses PISA cycle 3 field trial data to investigate the relationships between gender differential item functioning (DIF) across countries and test languages for science items and their formats and the four other dimensions defined in PISA framework: focus, context, competency, and scientific knowledge. The data used were collected from 60…

In operational testing programs using item response theory (IRT), item parameter invariance is threatened when an item appears in a different location on the live test than it did when it was field tested. This study utilizes data from a large state's assessments to model change in Rasch item difficulty (RID) as a function of item position change,…

The purpose of this study is to determine the extent of scale drift on a test that employs cut scores. It was essential to examine scale drift for this testing program because new forms in this testing program are often put on scale through a series of intermediate equatings (known as equating chains). This process may cause equating error to…

Numerous studies have compared the Angoff standard-setting procedure to other standard-setting methods, but relatively few studies have evaluated the procedure based on internal criteria. This study uses a generalizability theory framework to evaluate the stability of the estimated cut score. To provide a measure of internal consistency, this…

The paper by Rupp and Templin (2008) is an excellent work on the characteristics and features of cognitive diagnostic models (CDM). In this article, the authors comment on some substantial and methodological aspects of this focus paper. They organize their comments by going through issues associated with the terms "cognitive,"…

Purpose: To validate an 80-item self-report measure, A Systems Approach to Placement: Self-Assessment for Students and Counselors (SAP-SASC), designed to identify critical areas of knowledge, skills, and competencies possessed by rehabilitation counselors in state vocational rehabilitation (VR) agency settings. Participants: 275 rehabilitation…

The suitability of 52 items for measuring Blackboard course management system success was investigated with the aim of validating the Blackboard CMS success scale in an educational context. Through a survey, the Blackboard course management system (BCMS) success scale was administered to 503 students at the University of Botswana. Data collected…

This research investigates the effect of a web-based model, named "Practicing, Reflecting, and Revising with Web-based Assessment and Test Analysis system (P2R-WATA) Assessment Literacy Development Model," on enhancing assessment knowledge and perspectives of secondary in-service teachers, and adopts a single group experimental research…

When comparing data derived from tests or questionnaires in cross-national studies, researchers commonly assume measurement invariance in their underlying scaling models. However, different cultural contexts, languages, and curricula can have powerful effects on how students respond in different countries. This article illustrates how the…

New testing theories, concepts, and psychometric methods (e.g., item response theory, test equating, and item bank) developed during the past several decades have many advantages over previous theories and methods. In spite of their introduction to the field, they have not been fully accepted by physical educators. Further, the manner in which…

The Mathematics Teaching Efficacy Beliefs Instrument (MTEBI), developed in the United States, is one of the most popular scales used in the study of mathematics teaching efficacy. However, the MTEBI might not be trustworthy in other cultures. This study described the development of a new instrument measuring mathematics teaching efficacy beliefs…

This study reports the construction of the Dialogic Reading Inventory (DRI), a tool for assessing a parent and child's storybook reading behaviors. Twenty-three parent-child dyads participated in the study. The Adult-Child Interactive Reading Inventory (DeBruin-Parecki, 1999) items were grouped into four categories and revised to reflect current…

This study assessed teacher education students' perceptions and satisfaction of their learning experiences concerning an accelerated summer pilot program. In addition, the study provided information on the impact and teaching effectiveness of the accelerated teacher education summer pilot program on participating students. Results from this study…