Methodologists have written for years about the importance of attending to important details in quantitative research, yet there has been little research investigating methodological practice in the social sciences. This study assessed the extent to which innovations and practices are adopted by researchers voluntarily. In particular, I use the…

Teacher evaluation has emerged as a major focus for reform at the highest levels of education policymaking, and for good reason. Most evaluations are based on scant evidence of actual effectiveness, produce inflated ratings, and provide teachers with little useful feedback. This paper offers policymakers and practitioners important "lessons…

The purpose of this article is to reflect on the state of the theorizing and praxis of DIF in general: where it has been; where it is now; and where I think it is, and should, be going. Along the way the major trends in the differential item functioning (DIF) literature are summarized and integrated providing some organizing principles that allow…

To many of today's teachers, assessment is synonymous with high-stakes standardized tests. It is often viewed as something in competition with teaching, rather than as an integral part of teaching and learning. In the current accountability environment, assessment is not regarded as a source of information that can be used during instruction.…

Fumiko Samejima is best known for her pioneering work in polytomous response item response theory (IRT), yielding the eponymous model that has been used broadly for more than 30 years. In this interview, Samejima, on the verge of retiring from her faculty position at the University of Tennessee, discusses her life and career. She also describes…

Lissitz and Samuelsen (2007) have proposed a framework that seemingly deems construct validity evidence irrelevant to supporting educational test meaning. The author of this article agrees with Lissitz and Samuelsen that internal evidence establishes test meaning, but she argues that construct validity need not be removed from the validity sphere.…

This comprehensive "Handbook" focuses on the most used polytomous item response theory (IRT) models. These models help us understand the interaction between examinees and test questions where the questions have various response categories. The book reviews all of the major models and includes discussions about how and where the models…

Objective: The incremental utility of symptoms of conduct disorder (CD), oppositional defiant disorder (ODD), attention-deficit/hyperactivity disorder (ADHD), and callous-unemotional (CU) traits for predicting psychosocial outcomes across multiple domains was examined in a community sample of 1,517 boys. Method: Several outcomes were assessed…

This study provides a simultaneous examination of all components of the Community of Inquiry (CoI) framework (Garrison, Anderson & Archer, 2000; Anderson, Rourke, Garrison & Archer, 2001; and Rourke, Garrison, Anderson & Archer, 1999) and seeks to extend previous work into the nature, development, and relationships between the constructs of…

This report critically examines studies of how scientific research drives innovation which is then translated into socio-economic benefits. It focuses on research evaluation insights that are relevant not only to the academic community, but also to policymakers and evaluation practitioners--and particularly to biomedical and health research…

The recent "Nationwide academic achievement and study situation survey" was clearly influenced by the idea of "authentic assessment", an educational assessment perspective focused on "quality" and "engagement". However, when "performance assessment", the assessment method corresponding to this…

In this article, we introduce a person-fit statistic called the hierarchy consistency index (HCI) to help detect misfitting item response vectors for tests developed and analyzed based on a cognitive model. The HCI ranges from -1.0 to 1.0, with values close to -1.0 indicating that students respond unexpectedly or differently from the responses…

In this article, I specify a conceptual framework for test validity research on content assessments taken by English language learners (ELLs) in U.S. schools in grades K-12. This framework is modeled after one previously delineated by Willingham et al. (1988), which was developed to guide research on students with disabilities. In this framework…

This study reports on the development and evaluation of a rating tool to assess the scientific utility and cultural appropriateness of community-level indicators for application with Indigenous populations. Indicator criteria proposed by the U.S. Institute of Medicine were culturally adapted through reviewing the literature and consultations with…

In our pre-service department, university practicum supervisors are faculty members who offer academic, social, and personal support to teacher candidates during their year-long program. Their role is described as one designed primarily to provide formative assessment and feedback to improve classroom practice and reflection on practice. This…