Commonly used machine learning applications seem to relate to big data. This article provides a gentle review of machine learning and shows why machine learning can be applied to small data too. An example of applying machine learning to screen irregularity reports is presented. In the example, the support vector machine and multinomial naïve…

The objectives of this two-part study were to: (a) investigate English learner (EL) accommodation practices on state accountability assessments of reading/English language arts and mathematics in grades 3-8, and (b) conduct a meta-analysis of EL accommodation effectiveness on improving test performance. Across all distinct testing programs, we…

Making causal inferences from a quasi-experiment is difficult. Sensitivity analysis approaches to address hidden selection bias thus have gained popularity. This study serves as an introduction to a simple but practical form of sensitivity analysis using Monte Carlo simulation procedures. We examine estimated treatment effects for a school-based…

Items on test score scales located at and below the Proficient cut score define the content area knowledge and skills required to achieve proficiency. Alternately, examinees who perform at the Proficient level on a test can be expected to be able to demonstrate that they have mastered most of the knowledge and skills represented by the items at…

In large-scale assessments, such as state-wide testing programs, national sample-based assessments, and international comparative studies, there are many steps involved in the measurement and reporting of student achievement. There are always sources of inaccuracies in each of the steps. It is of interest to identify the source and magnitude of…

An effect size of about 0.70 (or 0.40-0.70) is often claimed for the efficacy of formative assessment, but is not supported by the existing research base. More than 300 studies that appeared to address the efficacy of formative assessment in grades K-12 were reviewed. Many of the studies had severely flawed research designs yielding…

Students who are deaf or hard of hearing (SDHH) often use test accommodations when they participate in large-scale, standardized assessments. The purpose of this article is to present findings from the "Third Annual Survey of Assessment and Accommodations for Students who are Deaf or Hard of Hearing". The "big five" accommodations were reported by…

Reports on an ongoing evaluation of the Vermont portfolio assessment program. Indicates that the positive news about the instructional effects of the assessment program are in contrast with the empirical findings about the quality of the data the program has yielded. (SLD)

Recommendations from the Wirtz/Lapointe report, "Measuring The Quality of Education" (ED 213 769), which evaluates National Assessment of Educational Progress (NAEP), are presented. Six educators respond to the concern that NAEP's reports and material are not widely known or as useful to educators as they should be. (CM)

A conceptual analysis of gain scores and a technically sound procedure for using such scores to compare different instructional programs are presented. The procedure proposed makes use of an index called Rescaled and Adjusted Gains within Strata (RAGS), together with a flexible but explicit procedure for score analysis and reporting. (LC)

With 3 years and counting since its inception, the scope and impact of "No Child Left Behind" is now being felt in classrooms across the nation. Although some successes have been identified, concerns about the implementation and expectations of the legislation are emerging. As a result of the legislation's emphasis on the development of…

When STARS reform efforts were launched in 2000, teacher training in assessment was seen as crucial to the success of the program. The STARS reform efforts focus on both supporting the implementation of quality classroom assessment practices and implementing a district-based accountability system. The training programs described in this article…

The No Child Left Behind Act allows states to vary (a) the trajectories they select to move from the baseline percent proficient or above in 2002 to the 100% proficient goal in 2014, (b) the minimum number of students required for reporting of disaggregated subgroup results, and (c) whether or not they will use confidence intervals when…

This reaction paper stresses the importance of matching the qualitatively different types of educational decisions with appropriate types of tests. Reading instruction is used to illustrate that while standardized tests are helpful for student classification and program accountability, they are hazardous to instructional process decisions which…