In light of the emergence of statistical analysis techniques based on data mining in education sciences, and the potential they offer to detect non-trivial information in large databases, this paper presents a procedure used to detect factors linked to academic achievement in large-scale assessments. The study is based on a non-experimental,…

College completion rates in the U.S. are stubbornly low despite the large and rising returns to a college degree. Efforts to increase student success in college have largely ignored a potentially key factor: the instruction that students receive in the sequence of courses that add up to a college education. Improving the quality of instruction may…

This dissertation comprises three papers that propose, discuss, and illustrate models to make improved inferences about research questions regarding student achievement in education. Addressing the types of questions common in educational research today requires three different "extensions" to traditional educational assessment: (1)…

In the United States, when English language learners (ELLs) are tested, they are usually tested in English and their limited English proficiency is a potential cause of construct-irrelevant variance. When such irrelevancies affect test scores, inaccurate interpretations of ELLs' knowledge, skills, and abilities may occur. In this article, we…

Responds to an article that questioned the authors' previous attempts to define "subject difficulty" and compare subjects based on their level of difficulty. Argues that "subject difficulty" is a reasonable term and is important to the interpretation of examination data. Questions arguments that only qualitative judgments of…

In this article we report a 3-yr study of a large-enrollment Cell Biology course focused on developing student skill in scientific reasoning and data interpretation. Specifically, the study tested the hypothesis that converting the role of exams from summative grading devices to formative tools would increase student success in acquiring those…

A study compared the effects of different methods of analyzing trends to illustrate how failure to account for change in classification will lead to misinterpretation of data on the performance of students with disabilities. Data from five years of assessment in Texas is used to illustrate effects of classification changes. (Contains references.)…

This article discusses Rochester's two academic models that offer different tools for different purposes--measuring individual learning and measuring what affects learning. The main focus of currently available growth measures is formative assessment--providing data to inform instructional planning. Value-added assessment is not a student…

While the "Standards for Evaluations of Educational Programs, Projects and Materials" provides a good checklist of prerequisites, such standards do not guarantee indisputable outcomes. Reanalysis of reading comprehension and mathematics mean achievement data from an international evaluation study illustrates how political bias can…

Calls for simplicity when presenting data on student achievement. Data should help teachers improve teaching and learning, and focus on specific goals such as determining how many students are succeeding in a subject and, within that subject, what are the areas of strength or weakness. (Contains 22 references.) (WFA)

Discusses how to examine and evaluate claims of improved academic performance in advertisements for computer-assisted instruction. Highlights include the proper use of comparison groups; types of statistical analyses; the Hawthorne effect; the interpretation of scores; interpreting graphic presentations; tests of significance; and cost…

Identifies situations in which there is disparity between coefficients calculated from aggregate versus individual level data. Determines the magnitudes of these discrepancies, and discusses the implications for test score reporting and policy decisions based in whole or in part on the aggregate level relationships and discrepancies identified.…

This report discusses the outcomes of a study that investigated the relationship between student scores on the five sub-scales of the School Attitude Assessment Survey-Revised (SAAS-R) and the academic achievement of known groups of gifted achievers and gifted underachievers. The study examined whether gifted achievers and gifted underachievers…

The results from high-stakes assessments have often been used to merely grade and rank schools and students. But a new trend is emerging, according to this brief. Educators are beginning to see the power of using assessment data to improve instruction. This brief discusses ways to use data to improve instruction at the school, classroom, and…

Discusses which kinds of data educators should respect and which they should reject. Asserts that most state accountability tests fail to produce the kinds of data that will improve teaching and learning. Teachers can get the data they need from their own instructionally useful classroom assessments. (WFA)