Understanding the reason(s) for Differential Item Functioning (DIF) in the context of measurement is difficult. Although identifying potential DIF items is typically a statistical endeavor, understanding the reasons for DIF (and item repair or replacement) might require investigations that can be informed by qualitative work. Such work is…

In this commentary, we offer a set of visual tools that can assist education researchers, especially those in the field of mathematics, in developing cohesiveness from a mixed methods perspective, commencing at a study's research questions and literature review, through its data collection and analysis, and finally to its results. This expounds…

The 2011 NAEP-TIMSS linking study conducted by the National Center for Education Statistics (NCES) was designed to predict Trends in International Mathematics and Science Study (TIMSS) scores for the U.S. states that participated in 2011 National Assessment of Educational Progress (NAEP) mathematics and science assessment of eighth-grade students.…

The 2012 National Survey of Science and Mathematics Education was designed to provide up-to-date information and to identify trends in the areas of teacher background and experience, curriculum and instruction, and the availability and use of instructional resources. This compendium, one of a series, details the results of a survey of high school…

The 2012 National Survey of Science and Mathematics Education was designed to provide up-to-date information and to identify trends in the areas of teacher background and experience, curriculum and instruction, and the availability and use of instructional resources. This compendium, one of a series, details the results of a survey of high school…

An assessment framework is like a blueprint, laying out the basic design of the assessment by describing the mathematics content that should be tested and the types of assessment questions that should be included. It also describes how the various design factors should be balanced across the assessment. This is an assessment framework, not a…

Tips on constructing survey instruments and examples of alternative formats for questionnaire items are provided in this paper. The 18 tips cover such areas as instructions for respondents, wording of questionnaire items, grouping of items, handling of difficult or sensitive questions, fixed-response items, open-ended questions, and questionnaire…

The "2004/06 Beginning Postsecondary Students Longitudinal Study (BPS:04/06)" is sponsored by the U.S. Department of Education to respond to the need for a national, comprehensive database concerning issues students may face in enrollment, persistence, progress, and attainment in postsecondary education and in consequent early rates of…

This digest reviews the basic building blocks of a structured interview, points out some of the pitfalls in interviewing, and suggests ways for researchers to avoid these difficulties to produce questions that have the best possibility of generating reliable and accurate data on the topics of interest. The data collection instrument is a document…

This manual explains how to construct a questionnaire. It is intended for the novice researcher who has little experience in questionnaire construction. The first seven chapters discuss the following seven stages in questionnaire development: (1) establishing the guiding questions; (2) operationalizing and clarifying the guiding questions; (3)…

A rationale is presented for the "control items" technique, the technique of using control (nonexperimental) test items to provide a baseline for estimating the effects indicated by scores on the experimental test items. For evaluating the effects of a curriculum, a test can be made of two types of items--ones that test explicit program objectives…

A practical application of generalizability theory, demonstrating how the variance components contribute to understanding and interpreting the data collected to evaluate a program, is described. The evaluation concerned 120 learning modules developed for the Dental Auxiliary Education Project. The goals of the project were to design, implement,…

This manual contains information for conducting regular student surveys at Kalamazoo Valley Community College. Questionnaires, designed for new, returning, and former student populations, are presented together with the methods by which the instruments should be administered. Guidelines for data analysis and report writing are also outlined. The…

Work on the development of the intensive time-series design was initiated because of the dissatisfaction with existing research designs. This dissatisfaction resulted from the paucity of data obtained from designs such as the pre-post and randomized posttest-only designs. All have the common characteristic of yielding data from only one or two…

This report describes the methods and procedures used for the Beginning Postsecondary Students Longitudinal Study: 1996-2001 (BPS:1996/2001). These students, who started their postsecondary education during the 1995-96 academic year, were first interviewed in 1996 as part of the National Postsecondary Student Aid Study (NPSAS:96). A follow-up…