Focus groups have an established history in applied research and evaluation. The fundamental methods of the focus group technique have been well discussed, as have their potential advantages. Less guidance tends to be provided regarding the analysis of data resulting from focus groups or how to organize and defend conclusions drawn from the…

State education agencies and school districts are increasingly using measures based on student test-score growth in their systems for evaluating school and teacher performance. In many cases, these systems inform high-stakes decisions such as which schools to close and which teachers to retain. Performance metrics tied directly to student…

In the United States, but not only here, the movement to evaluate teachers based on student test scores has received powerful political and parental support. The logic is simple. From one testing occasion to another students should show growth in their knowledge and skill. Similar types of students should show similar patterns of growth. Those…

Researchers and evaluators have encountered a number of challenges in conducting empirically-rigorous research within juvenile correctional facilities. The purpose of this guide is to provide new researchers and evaluators with an overview of the possible challenges they may encounter when conducting research in juvenile correctional facilities so…

This paper reports on the outcomes of a three-year study investigating the use of digital technologies to increase the authenticity of high-stakes summative assessment in four Western Australian senior secondary courses. The study involved 82 teachers and 1015 students and a range of digital forms of assessment using computer-based exams, digital…

The aim of this chapter is to characterize educational reforms in Latin America over the last 25 years, and the way they reflect the role, method, and use of evaluation processes. The main theoretical and methodological tensions that are created by the development of evaluations will be reviewed, concluding with the identification of some of the…

In this study, the authors evaluated aspects of criterion validity and clinical utility of the grandiosity and vulnerability components of the Pathological Narcissism Inventory (PNI) using two undergraduate samples (N = 299 and 500). Criterion validity was assessed by evaluating the correlations of narcissistic grandiosity and narcissistic…

Mindfulness, a construct that entails moment-to-moment effort to be aware of present experiences and positive attitudinal features, has become integrated into the sciences. The Five Facet Mindfulness Questionnaire (FFMQ), one popular measure of mindfulness, exhibits different responses to positively and negatively worded items in nonmeditating…

There is a lack of research on the effects of outliers on the decisions about the number of factors to retain in an exploratory factor analysis, especially for outliers arising from unintended and unknowingly included subpopulations. The purpose of the present research was to investigate how outliers from an unintended and unknowingly included…

Anxiety disorders are among the most common comorbid conditions in children and adolescents with autism spectrum disorders (ASDs), although assessment presents unique challenges. Many symptoms of anxiety appear to overlap with common presentations of autism. Furthermore, deficits in language and cognitive functioning make it difficult for such…

If you really want to see how innovative a school is, inquire about its thinking and practices regarding assessment. For the students, does the mere thought of assessment trigger stress? Do the teachers rely heavily on high-stakes, multiple-choice, Bell Curve-generating tests? Or do the students seem relaxed and engaged as teachers experiment with…

The quality of evaluation of essay type answer books involving multiple evaluators for courses with large number of enrollments is likely to be affected due to heterogeneity in experience, expertise and maturity of evaluators. In this paper, we present a strategy to detect anomalies in evaluation of essay type answers by multiple evaluators based…

There is growing interest in the concept of "mechanism" across many areas of the social sciences. In the field of program and policy evaluation, a number of scholars have also emphasized the importance of causal mechanisms for explaining how and why programs work. However, there appears to be some ambiguity about the meaning and uses of…

This paper explores the methodology and application of an assessment philosophy known as standards-based grading, via a critical comparison of standards-based grading to other assessment philosophies commonly employed at the elementary, secondary, and post-secondary levels of education. Evidenced by examples of increased student engagement and…

At 12:30 p.m. on December 8, 1941, in front of a joint session of Congress, one day after Japanese planes struck Pearl Harbor and killed 2,402 Americans, President Franklin Delano Roosevelt declared December 7 a date that would live in infamy. He spoke of rage and betrayal, hardships and determination. Thirty-three minutes after he finished…