We revisit the merits of the retrospective pretest-posttest (RPP) design for repeated-measures research. The underutilized RPP method asks respondents to rate survey items twice during the same posttest measurement occasion from two specific frames of reference: "now" and "then." Individuals first report their current attitudes…

This study explored motivation and engagement among North American (the United States and Canada; n = 1,540), U.K. (n = 1,558), Australian (n = 2,283), and Chinese (n = 3,753) secondary school students. Motivation and engagement were assessed via students' responses to the Motivation and Engagement Scale-High School (MES-HS). Confirmatory factor…

Classic parametric statistical significance tests, such as analysis of variance and least squares regression, are widely used by researchers in many disciplines, including psychology. For classic parametric tests to produce accurate results, the assumptions underlying them (e.g., normality and homoscedasticity) must be satisfied. These assumptions…

Assesses techniques used by researchers to collect and analyze data on how people with visual impairments or blindness learn, understand, and think about geographic space. Recommendations are made for increasing the validity of studies, including the use of multiple, mutually supportive tests; larger samples; and real-world environments.…

This article discusses evidence for functional behavioral assessment (FBA) procedures in terms of the meaning and interpretation of different forms of reliability and validity in FBA. It concludes that additional research needs to be conducted with various target behaviors across different settings to support the continued use of FBA. (Contains…

Aserts that it is unclear how the Ages and Stages Questionnaires: Social-Emotional ratings link to other critical child and family risk factors. Identifies questions regarding how well individual dimensions of social behavior are measured and concerns about the partial overlap between competent and problem behavior. Expresses concerns about the…

Research on teacher evaluation and teacher effectiveness indicates that there are serious problems with the reliability of presage, process, and product findings. Quality in teaching can best be assessed by measuring process in the classroom and by using observation instruments which record the occurrence of specific, well-defined behaviors. (PP)

The research literature provides important guidance to counselors working to keep abreast of the latest thinking regarding best practices and recently developed counseling tools. The purpose of this digest is to highlight a few errors that seem to recur within the literature, and to provide some helpful references that further explore these…

Despite questions about their reliability and validity, student evaluations of teaching (SETs) are a primary measure of instructor performance. The current study examines SETs, including a thorough list of potentially relevant variables. The findings suggest that how much students perceive they learned in a course is an important predictor of SET…

The report of the National Academy of Education (NAE), "Setting Performance Standards for Student Achievement," provides an interpretation of NAE investigations into the procedures surrounding establishment of achievement levels for the National Assessment of Educational Progress (NAEP). The NAE report synthesizes the investigations of…

The National Academy of Education (NAE) Panel has drawn two major conclusions in its evaluation of the National Assessment Governing Board's (NAGB) efforts to set achievement levels for the National Assessment of Educational Progress (NAEP). They are that the Angoff procedure is fundamentally flawed for the setting of achievement levels, and that…

This handbook has been prepared to address one specific problem: How can the techniques of program evaluation be effectively applied to produce useful information about the operations and impact of moral education programs in secondary schools? The handbook is divided into five chapters. The introductory chapter describes the background and…

School effectiveness indices (SEIs), based on regressing test performance onto earlier test performance and a socioeconomic status measure, were obtained for eight subject-grade combinations from 485 South Carolina elementary schools. The analysis involved school means based on longitudinally matched student data. Reading and mathematics…