The purpose of this study was to evaluate the use of performance-based feedback (PF) delivered via email on early childhood teachers' sustained use of recommended practices within inclusive early childhood classrooms. A multiple baseline design across behaviors was replicated across three teachers to examine the relation between PF delivered via…

The current study evaluated the effects of the "Superheroes Social Skills" program (Jenson et al. 2011) in promoting accurate demonstration of target social skills in training and generalization conditions in young children with autism spectrum disorder (ASD) and peers with shared social deficits. Three preschool-age children with ASD…

Undergraduate research (UR) is a vetted educational tool that is commonly perceived to prepare students for entering graduate school and careers in STEM fields; however, scholarly attention to date has largely relied on self-report data, which may limit inferences about the causal effects on student outcomes. In light of this, recent calls have…

Although problem-based learning (PBL) has been widely used in medical schools, few studies have attended to the assessment of PBL processes using validated instruments. This study examined reliability and validity for an instrument assessing PBL performance in four domains: Problem Solving, Use of Information, Group Process, and Professionalism.…

All students, including those with significant cognitive disabilities, must participate in accountability testing under NCLB regulations. Each state must provide an alternate assessment for students unable to participate in general accountability testing. Carefully designed alternate assessment systems have the potential to go beyond meeting…

The purposes of this study were to investigate the effects of rater training in an L2 performance assessment and to examine the eligibility of L2 users of English as raters in L2 performance assessment. Rater training was conducted in order for raters to clearly understand the criteria, the evaluation items, and the evaluation procedure. In this…

This study examined the extent to which ethnic-based differences exist in teacher ratings of African American students and White students on the language and literacy domain of a curriculum-embedded performance assessment for students in grade 1. It extended previous research on performance assessments to focus on issues related to equity in…

Assessment reforms might fail because high stakes will be attached to them too soon, judgments will be unreliable, and lawsuits will occur. Educators need to consider technical issues including score reliability, task validity, portfolio sampling, and generalizability problems. U.S. schools would improve considerably if national Advanced Placement…

Describes and evaluates a holistic resocialization program used by the Texas Youth Commission that has been integrated into the state's education, treatment, and correctional programs for incarcerated youth. Goals of the program are to help ensure that the youth can generalize the skills they gain through these processes to situations outside the…

Six distinguishable aspects of construct validity are discussed as they apply to performance assessment, emphasizing content, substantive, structural, generalizability, external, and consequential aspects. Taken together, these aspects provide a way to address validity questions in score interpretation and use. (SLD)

A proposed model for the validity of measures of professional competence treats validation as the evaluation of inferences drawn from test scores, focusing on evaluation, generalization, and extrapolation. The model is used to indicate strengths and weaknesses of assessments of professional competence: observations of performance, simulations, and…

This study provides empirical evidence about the sampling variability and generalizability (reliability) of a statewide performance assessment for grade six. Results for 600 students at individual and school levels indicate that task-sampling variability was the major source of measurement error. Rater-sampling variability was negligible. (SLD)

Issues pertaining to the quality of performance assessments, including reliability and validity, are discussed. The relatively limited generalizability of performance across tasks is indicative of the care needed to evaluate performance assessments. Quality control is an empirical matter when measurement is intended to inform public policy. (SLD)

Current national efforts to expand the role of educational assessment and change the nature of assessments are discussed. Rationales for expectations that a new national examination would spur educational reform are analyzed; and the challenges of performance-based assessment, particularly in its validation, are examined. (Author/SLD)