One question frequently included in surveys asks about respondents' earnings. As this information serves, for example, as a basis for evaluating policy interventions, it must be of high quality. This study aims to advance knowledge about possible measurement errors in earnings data and the potential of data linkage to improve substantive…

Interest in the study of gene-environment interaction has recently grown due to the sudden availability of molecular genetic data--in particular, polygenic scores--in many long-running longitudinal studies. Identifying and estimating statistical interactions comes with several analytic and inferential challenges; these challenges are heightened…

Latent state-trait (LST) analysis is frequently applied in psychological research to determine the degree to which observed scores reflect stable person-specific effects, effects of situations and/or person-situation interactions, and random measurement error. Most LST applications use multiple repeatedly measured observed variables as indicators…

The study of prediction bias is important and the last five decades include research studies that examined whether test scores differentially predict academic or employment performance. Previous studies used ordinary least squares (OLS) to assess whether groups differ in intercepts and slopes. This study shows that OLS yields inaccurate inferences…

Classroom context and climate are inherently classroom-level (L2) constructs, but applied researchers sometimes--inappropriately--represent them by student-level (L1) responses in single-level models rather than more appropriate multilevel models. Here we focus on important conceptual issues (distinctions between climate and contextual variables;…

Introduction: The aim of our research was to investigate the modality effect in more detail by measuring it in a direct way. Two studies were conducted using the same subject and material. Method: Computer-based learning material was presented on several screens, each containing a short text and a picture. Modality was varied by presenting written…

This report examines the differences in impact estimates and standard errors that arise when these are derived using state achievement tests only (as pre-tests and post-tests), study-administered tests only, or some combination of state- and study-administered tests. State tests may yield different evaluation results relative to a test that is…

This chapter summarizes ten selected issues and common problems that arise in most assessment research projects. These include: (1) the uses of grades in assessment; (2) institutional review boards; (3) research design as a compromise; (4) standardized testing; (5) self-reported measures; (6) missing data; (7) weighting data; (8) conditional…

Written by a social worker for social work students, this is a nuts and bolts guide to statistics that presents complex calculations and concepts in clear, easy-to-understand language. It includes numerous examples, data sets, and issues that students will encounter in social work practice. The first section introduces basic concepts and terms to…

This study empirically investigates the effectiveness of Distributed Leadership Teacher Training (DLT) program on improving student's academic achievement. In addition, it both tests the assumption that the year 1 impacts are stable across calendar years and examines the importance of properly accounting for the fact that the standard error of the…

Purpose of this article is to explain the fundamental nature and sources of regression toward the mean. The ultimate goal is that developmental psychologists understand regression effects well enough so that they will not make erroneous interpretations of such effects in their empirical data. (Author)

Focuses on regression effects that arise from measurement error, and examines methods used to evaluate pre- to post-therapy score changes that attempt to take these regression effects into account. Discusses statistical and practical problems, identifies and analyzes specific examples, and distinguishes objectives of these methods from other…

Extensive evidence exists demonstrating the utility of Curriculum-Based Measurement in reading (R-CBM) for progress-monitoring purposes; however, most studies have evaluated R-CBM from a traditional psychometric perspective, which allows for variability in individual student's data that is not a function of increased skills (i.e., measurement…

Because surveys now can be implemented with relative ease and little cost, many researchers are overlooking the basic principles of survey research. This chapter discusses sources of error that researchers should consider when conducting a survey, and gives readers basic suggestions for reducing error. (Contains 1 table and 1 figure.)

Rules, procedures, and algorithms intended to aid researchers and practitioners in the application of generalizability theory to a broad range of measurement problems are presented. Two examples of measurement research are G studies, which examine the dependability of some general measurement procedure; and D studies, which provide the data for…