The purpose of this study was to evaluate the use of performance-based feedback (PF) delivered via email on early childhood teachers' sustained use of recommended practices within inclusive early childhood classrooms. A multiple baseline design across behaviors was replicated across three teachers to examine the relation between PF delivered via…

The current study evaluated the effects of the "Superheroes Social Skills" program (Jenson et al. 2011) in promoting accurate demonstration of target social skills in training and generalization conditions in young children with autism spectrum disorder (ASD) and peers with shared social deficits. Three preschool-age children with ASD…

Undergraduate research (UR) is a vetted educational tool that is commonly perceived to prepare students for entering graduate school and careers in STEM fields; however, scholarly attention to date has largely relied on self-report data, which may limit inferences about the causal effects on student outcomes. In light of this, recent calls have…

There are well-acknowledged challenges to scaling computerized performance-based assessments. One such challenge is reliably and validly identifying ill-defined skills. We describe an approach that leverages a data mining framework to build and validate a detector that evaluates an ill-defined inquiry process skill, designing controlled…

Although problem-based learning (PBL) has been widely used in medical schools, few studies have attended to the assessment of PBL processes using validated instruments. This study examined reliability and validity for an instrument assessing PBL performance in four domains: Problem Solving, Use of Information, Group Process, and Professionalism.…

When validating assessment models built with data mining, generalization is typically tested at the student-level, where models are tested on new students. This approach, though, may fail to find cases where model performance suffers if other aspects of those cases relevant to prediction are not well represented. We explore this here by testing if…

Many theories, methods, and practices are utilized to evaluate teachers with the intention of determining teacher effectiveness to better inform decisions about retention, tenure, certification and performance-based pay. In the 21st century there has been a renewed emphasis on teacher evaluation in public schools, largely due to federal "Race…

All students, including those with significant cognitive disabilities, must participate in accountability testing under NCLB regulations. Each state must provide an alternate assessment for students unable to participate in general accountability testing. Carefully designed alternate assessment systems have the potential to go beyond meeting…

The purposes of this study were to investigate the effects of rater training in an L2 performance assessment and to examine the eligibility of L2 users of English as raters in L2 performance assessment. Rater training was conducted in order for raters to clearly understand the criteria, the evaluation items, and the evaluation procedure. In this…

This study examined the extent to which ethnic-based differences exist in teacher ratings of African American students and White students on the language and literacy domain of a curriculum-embedded performance assessment for students in grade 1. It extended previous research on performance assessments to focus on issues related to equity in…

Assessment reforms might fail because high stakes will be attached to them too soon, judgments will be unreliable, and lawsuits will occur. Educators need to consider technical issues including score reliability, task validity, portfolio sampling, and generalizability problems. U.S. schools would improve considerably if national Advanced Placement…

Describes and evaluates a holistic resocialization program used by the Texas Youth Commission that has been integrated into the state's education, treatment, and correctional programs for incarcerated youth. Goals of the program are to help ensure that the youth can generalize the skills they gain through these processes to situations outside the…

Six distinguishable aspects of construct validity are discussed as they apply to performance assessment, emphasizing content, substantive, structural, generalizability, external, and consequential aspects. Taken together, these aspects provide a way to address validity questions in score interpretation and use. (SLD)

The purpose of this study was to describe elementary preservice teachers' difficulties with understanding algebraic generalizations that were set in an authentic context. Fifty-eight preservice teachers enrolled in an elementary mathematics methods course participated in the study. These students explored and practiced with authentic, hands-on…

The use of the Work Keys Listening and Writing Assessment, part of an assessment system of the generic employability skills of individuals, needs to be accompanied by systematic evaluation of its technical qualities. This study examined sampling variability and generalizability of Listening and Writing scores when multiple forms, raters, and…