Student responses to a large number of constructed response items in three Math and three Reading tests were scored on two occasions using three ways of assigning raters: single reader scoring, a different reader for each response (item-specific), and three readers each scoring a rater item block (RIB) containing approximately one-third of a…

The Longitudinal Surveys of Australian Youth (LSAY) is a research program that tracks young people as they move from school into further study, work and other destinations. This "User guide" has been developed for users of the LSAY data. The guide endeavours to consolidate existing technical documentation and other relevant information…

Reliability Analysis for the Internationally Administered 2002 Series GED (General Educational Development) Tests Reliability refers to the consistency, or stability, of test scores when the authors administer the measurement procedure repeatedly to groups of examinees (American Educational Research Association [AERA], American Psychological…

Secondary data analysis as a methodological approach is not without its critics. Indeed, three main objections to the use of secondary data analysis in social research stand out: first that because of the socially constructed nature of social data, the act of reducing it to a simple numeric form cannot fully encapsulate its complexity. Secondly,…

An examinee-level (or conditional) reliability is proposed for use in both classical test theory (CTT) and item response theory (IRT). The well-known group-level reliability is shown to be the average of conditional reliabilities of examinees in a group or a population. This relationship is similar to the known relationship between the square of…

This article introduces a multinomial error model, which models an examinee's test scores obtained over repeated measurements of an assessment that consists of polytomously scored items. A compound multinomial error model is also introduced for situations in which items are stratified according to content categories and/or prespecified numbers of…

Some authors have suggested that sample size in covariance structure modeling should be considered in the context of how many parameters are to be estimated (e.g., Kline, 2005). Previous research has examined the effect of varying sample size relative to the number of parameters being estimated (N:q). Although some support has been found for this…

In behavioral research, interest is often in examining the degree to which the effect of an independent variable X on an outcome Y is mediated by an intermediary or mediator variable M. This article illustrates how generalized estimating equations (GEE) modeling can be used to estimate the indirect or mediated effect, defined as the amount by…

This paper uses a new survey of graduates from one large civil university in the UK to examine the determinants of over-education and its subsequent impact on labour market earnings. Multiple measurements of over-education were collected to assess the effect of measurement error on the estimated pay penalty associated with over-education. Panel…

A psychological measurement model provides an explicit definition of (a) the theoretical and (b) the numerical relationships between observed scores and the latent variables that underlie the observed scores. Examination of the metric invariance of a measurement model involves testing the hypothesis that all components of the model relating…

While the National Center for Education Statistics (NCES) has conducted surveys of attrition and mobility among school teachers for two decades, little was known about similar movements among school principals. In order to inform discussions and decisions among policymakers, researchers, and parents, the 2008-09 Principal Follow-up Survey (PFS)…

This report provides national data on the availability and use of educational technology among teachers in public elementary and secondary schools during the winter and spring of 2009. The data are the results of a national teacher-level survey that is one of a set that includes district, school, and teacher surveys on educational technology.…

The GED[R] English as a Second Language (GED ESL) Test was designed to serve as an adjunct to the GED test battery when an examinee takes either the Spanish- or French-language version of the tests. The GED ESL Test is a criterion-referenced, multiple-choice instrument that assesses the functional, English reading skills of adults whose first…

This discussion paper represents one of the National Association for College Admission Counseling's (NACAC's) first post-Testing Commission steps in advancing the knowledge base and dialogue about test preparation. It describes various types of test preparation programs and summarizes the existing academic research on the effects of test…

Accurate assessment of attitudes about intimate partner violence is important for evaluation of prevention and early intervention programs. Assessment of attitudes about cross-gender interactions is particularly susceptible to bias because it requires specifying the gender of the perpetrator and the victim. As it is likely that respondents will…