Learning curves can support a competency-based approach to assessment for learning. When interpreting repeated assessment data displayed as learning curves, a key assessment question is: "How well is each learner learning?" We outline the validity argument and investigation relevant to this question, for a computer-based repeated…

In this technical report, the Center for Research Use in Education (CRUE) presents the methodological design of a large-scale quantitative investigation of research use by school-based practitioners through the "Survey of Evidence in Education for Schools (SEE-S)." It documents the major technical aspects of the development of SEE-S,…

This resource has been written specifically for higher education practitioners who are interested in improving students' learning experiences through the process of researching their own practice. We use the term 'higher education practitioners' to describe all who work in universities and who have a stake in students' learning experiences.…

Special education researchers conduct studies that can be considered replications. However, they do not often refer to them as replication studies. The purpose of this article is to consider the potential benefits of conceptualizing special education intervention research within a framework of systematic, conceptual replication. Specifically, we…

This article discusses critical methodological design decisions for collecting, interpreting, and synthesizing empirical evidence during the design, deployment, and operational quality-control phases for automated scoring systems. The discussion is inspired by work on operational large-scale systems for automated essay scoring but many of the…

Uncertainty occurs when there is more than one realization that can represent an information. This dissertation concerns merely discrete realizations of an uncertainty. Different interpretations of an uncertainty and their relationships are addressed when the uncertainty is not a probability of each realization. A well known model that can handle…

Written by a social worker for social work students, this is a nuts and bolts guide to statistics that presents complex calculations and concepts in clear, easy-to-understand language. It includes numerous examples, data sets, and issues that students will encounter in social work practice. The first section introduces basic concepts and terms to…

Examines national Current Population Survey data to indicate the impact of sample size on the standard error of subpopulations in the sample and to show how these errors can influence policy conclusions. Examines the unemployment rate cross-sectionally for 11 states to demonstrate that the monthly unemployment rate should not be used to make fine…

Evaluates arguments concerning the generality and statistical analysis of single-subject data. Considers the role of philosophy of science in evaluating research methodology. Single-subject data have special relevance for psychologists and educators who focus on the individual but statistical techniques for analyzing data have numerous…

Develops basic concepts of generalizability theory using hypothetical study of reliability of scores of vocational interest inventory. Asserts that generalizability theory makes it possible to consider all possible sources of unreliability simultaneously and to design optimal decision-making study. (NB)

The application of mathematical programming techniques is extended to the construction of measurement instruments in generalizability theory. Key concepts in generalizability theory are explained and a description is given of: (1) the one-facet crossed design; (2) the two-facet crossed design; and (3) a two-facet nested design. The optimization of…

In this study, we discuss the use of generative evaluation as an innovative approach in the analysis of qualitative interview data for evaluating simultaneous renewal of Iowa State University's PT3 grant. Goodlad's (1994) simultaneous renewal framework forms the basis of our argument. We focused on the CREATER+ model designed to explain the…

In this study, we discuss the use of generative evaluation as an innovative approach in the analysis of qualitative interview data for evaluating simultaneous renewal of Iowa State University's PT3 grant. Goodlad's (1994) simultaneous renewal framework forms the basis of our argument. We focused on the CREATER+ model designed to explain the…

The framework and procedures of generalizability theory are introduced and illustrated in this instructional module that uses a hypothetical scenario involving writing proficiency. Generalizability analyses are useful for understanding the relative importance of various sources of error and for designing efficient measurement procedures. (SLD)

Discusses issues relating to the reliability, validity, utility, and information value of unobtrusive testing of library reference services; provides suggestions for practical applications of these criteria; applies study findings to library decision making and planning; and identifies topics for further methodological refinement. (Author/CLB)