Cognitive interviewing (CI) is a method to identify sources of confusion in assessment items and to assess validity evidence on the basis of content and response processes. We introduce readers to CI and describe a process for conducting such interviews and analyzing the results. Recommendations for best practice are provided.

This manual provides guidance and documentation for users of the longitudinal kindergarten-fourth grade (K-4) data file of the Early Childhood Longitudinal Study, Kindergarten Class of 2010-11 (ECLS-K:2011). It mainly provides information specific to the fourth-grade round of data collection. The first chapter provides an overview of the…

We assessed the prevalence of a range of psychopathology among African unaccompanied refugee minors (URMs) in Austria. Additionally, the predictive value of war exposure on PTSD symptoms was examined. Forty-one URMs were assessed with the Mini-International Neuropsychiatric Interview for children and adolescents, the Youth Self-Report, the UCLA…

This manual provides guidance and documentation for users of the longitudinal kindergarten-fourth grade (K-4) public-use data file of the Early Childhood Longitudinal Study, Kindergarten Class of 2010-11 (ECLS-K:2011), which includes the first release of the public version of the third-grade data. This manual mainly provides information specific…

This booklet is intended to help curriculum development personnel select an appropriate task list verification technique. The first sections of the guide introduce the concept of verification of task lists, provide a rationale for it, and define various terms connected with verification. The following four sections describe and make a case for…

Describes Family Task Interview (FTI), multiple task interview administered by tape recorder and designed to elicit clinically relevant family interaction. Notes that results from studies conducted to evaluate FTI's validity, reliability, and acceptability suggest the FTI is well-standardized, easily administered instrument for assessment of…

Discusses the need for child care quality assessment by regulatory agencies, researchers, and parents. Examines the usefulness of telephone interviews for assessing child care quality, focusing on research usage, the inclusion of family child care, and generating items for telephone interviews. (Author/KB)

This paper discusses a method of eliciting parental self-reports about child-rearing behavior. The method, called computer-presented social situations (CPSS), uses vignettes that are presented on computers. Several studies examined: (1) what mothers think about the technique; (2) reliability of data collected by the technique; and (3) validity of…

Discusses findings that child care quality can be measured effectively and efficiently through telephone interview. Notes that interview items were more highly correlated to the materials composite than to the interaction composite of the Environment Ratings Scales. Describes situations where on-site observation is necessary. Suggests that one…

Examined whether data on child care quality obtained from a telephone interview with the provider could serve as an adequate proxy for data obtained from direct observation of 89 child care homes and 92 centers. Found that a 25-item interview predicted accurately the quality classification of 92 percent of homes and 89 percent of centers.…

The usefulness of small-scale interview studies to explore the validity of science achievement tests in several formats was studied with 141 high school students and 49 fifth and sixth graders. Results, which provided evidence of test validity, also support the use of small-scale qualitative interviews in test validation. (SLD)

Quality measures were originally developed for research aimed at describing the settings that children spend time in and identifying the characteristics of these environments that contribute to children's development. They were also developed to guide improvements in practice. Increasingly, however, measures of quality are being used for further…

To assess structural coupling in schools, investigators must first have measures with established reliability and validity levels. Structural coupling refers to the mechanisms and norms in organizations that influence interactions among individuals. For three structural coupling measurement techniques--participant observation, interviews, and…

In this study, retrospective interviews were used to investigate reliability (and thus validity) threats to a computerized ESL listening comprehension test administered at a university in the US. The participants in the investigation, six international graduate students, were asked to respond to semi- and open-ended questions during individual…

The usefulness of studying thought processes in the construct validation of ability tests was examined using a sample consisting of 343 Canadian senior high school students. Four levels of probing were used by the interviewer to examine the students' thinking processes while taking the Test on Appraising Observations: (1) think aloud; (2)…