This dissertation is composed of projects on three aspects of gathering and learning from data in the social sciences: drawing representative samples, taking valid measurement, and making warranted inductive inferences. Chapter one studies the challenge of drawing representative human samples. It is well documented that most samples used by…

Including students with disabilities requires schoolwide interventions that are implemented with fidelity (adherence). Collection of fidelity data may become problematic when multiple evidence-based treatments exist in one setting. To address concerns around efficiency of data collection, this study hypothesized that the three sampling approaches…

Rural districts have long faced challenges in closing achievement gaps between subgroups of students. This brief report describes key decision points and considerations for decision-makers interested in identifying rural districts that have closed academic achievement gaps. Examining practices in these districts may suggest activities associated…

This toolkit is designed to assist states as they plan for and carry out their efforts to collect, report, analyze, and use high-quality parent and family involvement data. It defines key concepts; offers guidance on ways to improve the quality of the collection, analysis, and use of parent and family involvement data; and provides resources and…

Compressed sensing (CS) is an emerging signal acquisition framework that goes against the traditional Nyquist sampling paradigm. CS demonstrates that a sparse, or compressible, signal can be acquired using a low rate acquisition process. Since noise is always present in practical data acquisition systems, sensing and reconstruction methods are…

Action Research on Measuring Literacy Programme Participants' Learning Outcomes (RAMAA) aims to develop, implement and collaborate on the creation of a methodological approach to measure acquired learning and study the various factors that influence its development. This report examines how RAMAA I has been implemented over the past four years in…

Social validity is the extent to which procedures, goals, and outcomes are acceptable and important to end users and is not commonly addressed during assessment development. This article pilots a process of triangulating multiple methods to evaluate the social validity of a self-report assessment. These procedures were piloted using the Child…

Purpose: The main aim of this paper is to develop guidelines on the critical issues to consider in research design in an action research (AR) environment for SME network capability development. Design/methodology/approach: The issues in research design for AR studies are developed from the authors' experience in running learning sets but, in…

This guide is designed to help researchers make sure that their research reports include enough information about study measures so that readers can assess the quality of the study's methods and results. The guide also provides examples of write-ups about measures and suggests resources for learning more about these topics. The guide assumes…

This manual provides guidance and documentation for users of the eighth-grade data of the Early Childhood Longitudinal Study, Kindergarten Class of 1998-99 (ECLS-K). It begins with an overview of the ECLS-K study. Subsequent chapters provide details on the instruments and measures used, the sample design, weighting procedures, response rates, data…

The procedures involve a planned data gathering strategy consisting of at least two different groups, each receiving two different test batteries. A combination of Tucker's interbattery technique and congruence measures was the recommended strategy. Limitations of the concept of factor invariance are briefly discussed. (Author/BJG)

A reliable description of the person who writes media letters to newspapers and broadcast stations can be compiled from a combination of telephone and mail data less expensively than attempting to locate these letter writers through a random sample. (Author/JEG)

This paper presents a plan for obtaining statistical information for justifying budget requests, planning staffing, and assessing service without placing heavy burdens on the staff. (Author/JAB)

Three questions are discussed: (1) what approach will be taken to gain and maintain access to school districts and schools to administer assessment instruments? (2) what procedures should be employed in the difficult and complex task of gaining access to nonstudents (age 17)? and (3) what problems are likely to be encountered in doing this? Access…

This study comparing momentary time sampling against the real time obtained with handheld computers confirmed laboratory findings that short-elementary time sampling estimates percentage time accurately for a wide range of behavior frequencies and durations, and suggested that observers using momentary time sampling in a natural setting are able…