This study constitutes the secondary analysis of data collected as part of classroom instruction in a prior practitioner inquiry study. Consequently, IRB approval, parental consent, and participant assent for the present study were obtained after the conclusion of the original study.

This study examined how much improvement was attainable with respect to accuracy of differential item functioning (DIF) measures and DIF detection rates in the Mantel-Haenszel procedure when employing focal and reference groups with notably unbalanced sample sizes where the focal group has a fixed small sample which does not satisfy the minimum…

A total of 19 graduate students enrolled in a graduate course conducted 6 consecutive administrations of the Wechsler Intelligence Scale for Children, 4th edition (WISC-IV, Canadian version). Test protocols were examined to obtain data describing the frequency of examiner errors, including administration and scoring errors. Results identified 511…

The 2011 NAEP-TIMSS linking study conducted by the National Center for Education Statistics (NCES) was designed to predict Trends in International Mathematics and Science Study (TIMSS) scores for the U.S. states that participated in 2011 National Assessment of Educational Progress (NAEP) mathematics and science assessment of eighth-grade students.…

This paper examines factors that influence the post-adoption satisfaction of educators with e-learning systems. Based on the expectation-confirmation framework, we propose a research model that demonstrates how post-adoption beliefs affect post-adoption satisfaction. The model was tested at a university by educators (n = 175) who use an e-learning…

This report examines the differences in impact estimates and standard errors that arise when these are derived using state achievement tests only (as pre-tests and post-tests), study-administered tests only, or some combination of state- and study-administered tests. State tests may yield different evaluation results relative to a test that is…

Large sample standard errors for the Tucker method of linear equating under the common item nonrandom groups design are derived under normality assumptions as well as under less restrictive assumptions. Standard errors of Tucker equating are estimated using the bootstrap method described by Efron. The results from different methods are compared…

This work presents a methodological critique and secondary analysis of a large scale societal experiment, performed by Kellaghan, that studied the educational and psychological effects of the introduction of standardized achievement/ability testing in elementary schools in Ireland. (Author/PN)

Despite its widespread use in evaluation data analysis, statistical testing has come under persistent criticism resulting in calls for its rethinking, and even possible elimination (Carver, 1978, 1993). Saxon and Boylan issue a call "to strengthen developmental education research and to make it more accessible" (2003, p. 2). Among the types of…

To evaluate test speededness and to derive implications for test program activity, this study reviewed the literature on speed and power, identifying four major approaches to the assessment of speed: the Gulliksen approach, the Cronbach and Warrington approach, the Stafford approach, and the approach of the Educational Testing Service (ETS) as…

The National Assessment of Educational Progress in-school sampling design is a three-stage stratified design. Stratification variables include region, size of community and socioeconomic status. The three levels of sample selection are Primary Sampling Units (PSUs), schools and students. In general, two and sometimes three PSUs are selected from…

Means of interpreting norm-referenced tests to lead to more accurate reporting results are discussed, with particular emphasis on state-level and district-level data. Suggestions fall into the categories of documentation, frequency norming, and multiple form use. (TJH)

The Connecticut Assessment of Educational Progress (CAEP) is designed to provide legislators and educators with information on the strengths and weaknesses of students in 11 curricula areas. In addition, the Educational Evaluation and Remedial Assistance (EERA) program was developed to assess student proficiency in the basic skills of reading,…

This paper presents two examples of how methodological research in testing and evaluation simultaneously served the needs of both researchers and practitioners. The first example focuses on Center for the Study of Evaluation (CSE) research in writing assessment. This research investigated issues in domain definition, cognitive processing…

Beginning with the planning stages of the National Assessment of Educational Progress (NAEP), careful attention has been given to the design of efficient probability sampling methods for the selection of class-age respondents and the assignment of test packages. With these methods, it is possible for NAEP researchers to make relatively precise…