In education research test scores are a common object of analysis. Across studies test scores can be an important outcome, a highly predictive covariate, or a means of assigning treatment. However, test scores are a measure of an underlying proficiency we can't observe directly and so contain error. This measurement error has implications for how…

Evidence-based assessment (EBA) requires that investigators employ scientific theories and research findings to guide decisions about what domains to measure, how and when to measure them, and how to make decisions and interpret results. To implement EBA, investigators need high-quality assessment tools along with evidence-based processes. We…

In this article, I respond to Noel Card's "Methodological Issues in Measuring the Development of Character." I focus on the ways in which social scientific knowledge represents human constructions of the world and the implications of this stance for the measurement of character. Further, I consider how context influences those…

Factor analysis is a versatile class of psychometric techniques used by researchers to provide insight into the psychological dimensions (factors) that may account for the relationships among variables in a given dataset. The primary goal of a factor analysis is to determine a more parsimonious set of variables (i.e., fewer than the number of…

In this article I provide an overview of the methodological issues involved in measuring constructs relevant to character development and education. I begin with a nontechnical overview of the 3 fundamental psychometric properties of measurement: reliability, validity, and equivalence. Developing and evaluating measures to ensure evidence of all 3…

Over the past 14 years, AEA's Oral History Project Team (Robin Lin Miller, Jean A. King, Valerie Caracelli, and Melvin M. Mark) has conducted interviews with individuals who have made signal contributions to evaluation theory and practice, tracing their professional development and contextualizing their work within the social and political…

Many of the instruments developed for research use by the chemistry education community are relatively new. Because psychometric evidence dictates the validity of interpretations made from test scores, gathering and reporting validity and reliability evidence is of utmost importance. Therefore, the purpose of this study was to investigate what…

This paper is about a design-based research project which evaluated the novel use of Lesson Study for assessment (LSfA) purposes. It starts by explaining the principles and design of LSfA procedures based on a Lesson Study model and dynamic assessment principles. It outlines the training and support provided to six Lesson Study teams in three…

Sustainability of effective practices in schools is a critical area for research in any domain. The purpose of this article is to describe and evaluate the validity and reliability of a recently developed research instrument designed to evaluate schools' capacity to sustain school-wide positive behavior support (SWPBS) efforts at the universal…

This dissertation comprises three papers that propose, discuss, and illustrate models to make improved inferences about research questions regarding student achievement in education. Addressing the types of questions common in educational research today requires three different "extensions" to traditional educational assessment: (1)…

Standardizing aspects of assessments has long been recognized as a tactic to help make evaluations of examinees fair. It reduces variation in irrelevant aspects of testing procedures that could advantage some examinees and disadvantage others. However, recent attention to making assessment accessible to a more diverse population of students…

The aim of this study was to obtain information on feasibility, reliability and validity of available instruments screening for depression applied in people with intellectual disabilities (ID). Therefore, literature was systematically reviewed. For self-report, the Glasgow Depression scale for people with a Learning Disability appears most…

Classrooms are a primary site of evidence about learning. Yet classroom proceedings often occur behind closed doors and hence evidence of student learning is observable only to the classroom teacher. The informal and undocumented nature of this information means that it is rarely included in statistical models or quantifiable analyses. This…

The aim of this study was to develop an instrument to evaluate the knowledge of preschool children about healthy lifestyle behavior. The innovation was that the instrument was designed to get direct evidence about healthy lifestyle from children aged 4-6 years old. Usually, children knowledge is estimated indirectly (parents, teachers), but the…

The authors (a) discuss the importance of alignment for facilitating proper assessment and instruction, (b) describe the three most common methods for evaluating the alignment between state content standards and assessments, (c) discuss the relative strengths and limitations of these methods, and (d) discuss examples of applications of each…