Students' performances in introductory programming courses show large variation across students. There may be many reasons for these variations, such as methods of teaching, teacher competence in the subject, students' coding backgrounds and abilities, students' self-discipline, the teaching environment, and the resources available to students,…

This study investigated the responses of 531 preservice teachers to a "Beliefs About Assessment" questionnaire in China. The questionnaire focused on understanding the purposes, practices and principles of assessment for and of learning. Using factor analysis, an inter-correlated two-order model fitted well to the responses. This model…

Evaluation of instruction has typically occurred during development, before implementation, and after course completion. The problem is that evaluation is typically post delivery; courses are not traditionally updated in real time with feedback from students in the classroom. However the potential to evaluate and modify instruction during delivery…

Extensive graded reading (EGR) was carried out with a cohort of 600 engineering students in a university in northern Japan. Pre-and post-surveys were conducted to discover changes in the general reading habits of students, their attitudes toward the assessment method and how goals changed over the course of study. The first survey was carried out…

Most implementations of the Mantel-Haenszel differential item functioning procedure delete records with missing responses or replace missing responses with scores of 0. These treatments of missing data make strong assumptions about the causes of the missing data. Such assumptions may be particularly problematic when groups differ in their patterns…

This article delves into a relatively unexplored area of measurement by focusing on adaptive testing with unidimensional pairwise preference items. The use of such tests is becoming more common in applied non-cognitive assessment because research suggests that this format may help to reduce certain types of rater error and response sets commonly…

Classification testing has been widely used to make categorical decisions by determining whether an examinee has a certain degree of ability required by established standards. As computer technologies have developed, classification testing has become more computerized. Several approaches have been proposed and investigated in the context of…

Antony John Kunnan is a language assessment specialist. His research interests are fairness of tests and testing practice, assessment literacy, research methods and statistics, ethics and standards, and language assessment policy. His most recent publications include a four-volume edited collection of 140 chapters titled "The Companion to…

Designing assessments and tests is one of the more challenging aspects of creating an accessible learning environment for students who are deaf or hard of hearing (DHH), particularly for deaf students with a disability (DWD). Standardized assessments are a key mechanism by which the educational system in the United States measures student…

Joint stimulus control occurs when responding is determined by the correspondence of elements of a complex sample and a complex comparison stimulus. In academic settings, joint stimulus control of behavior would be evidenced by the selection of an accurate description of a complex graph in which each element of a graph corresponded to particular…

How should a wide variety of educational activities be sequenced to maximize student learning? Although some experimental studies have addressed this question, educational data mining methods may be able to evaluate a wider range of possibilities and better handle many simultaneous sequencing constraints. We introduce Sequencing Constraint…

The purpose of this study is to investigate the impact of discrete anchor items versus passage-based anchor items on observed score equating using empirical data.This study compares an "SAT"® critical reading anchor that contains more discrete items proportionally, compared to the total tests to be equated, to another anchor that…

This exploratory study investigated potential sources of setting accommodation resulting in differential item functioning (DIF) on math and reading assessments for examinees with varied learning characteristics. The examinees were those who participated in large-scale assessments and were tested in either standardized or accommodated testing…

Purpose: Older school-aged children and adolescents with persistent language and literacy impairments vary in their individual profiles of linguistic strengths and weaknesses. Given the multidimensional nature and complexity of language, designing an assessment protocol capable of uncovering linguistic variation is challenging. A process of…

The rigors of standardized testing make for numerous opportunities for examiner error, including simple computational mistakes in scoring. Although experts recommend that test scoring be double-checked, the extent to which independent double-checking would reduce scoring errors is not known. A double-checking procedure was established at a…