We present findings from an analysis of the Calculus Concept Inventory. Analysis of data from over 1500 students across four institutions indicates that there are deficiencies in the instrument. The analysis showed the data is consistent with a unidimensional model and does not have strong enough reliability for its intended use. This finding…

Background/Context: As increasing attention is paid to preparing students to succeed in school, the development and adoption of research-based curricula have become progressively more important. However, many curricular designs lack a basis in scientific evidence; research and curricular design are frequently treated as two separate enterprises.…

In Gargani and Strong (2014), we describe The Rapid Assessment of Teacher Effectiveness (RATE), a new teacher evaluation instrument. Our account of the validation research associated with RATE inspired a review by Good and Lavigne (2015). Here, we reply to the main points of their review. We elaborate on the validity, reliability, theoretical…

This study evaluates the efficacy of a mathematics intervention devised by Essex Educational Psychology Service (EPS), UK. The intervention was designed to develop understanding and skills across four key domains within arithmetical development, by applying the principles of errorless learning, distributed practice and teaching to mastery. A…

We study the properties of two specification tests that have been applied to a variety of estimators in the context of value-added measures (VAMs) of teacher and school quality: the Hausman test for choosing between random and fixed effects and a test for feedback (sometimes called a "falsification test"). We discuss theoretical…

The Student Response to Faculty Instruction (SRFI) is an instrument designed to measure the student perspective on courses in higher education. The SRFI was derived from decades of empirical studies of student evaluations of teaching. This article describes the development of the SRFI and its psychometric attributes demonstrated in two pilot study…

Previous research on the effectiveness of clickers has found their use to be positively associated with exam scores but not without methodological issues that hinder the conclusions that can be drawn. To address these limitations, the current studies isolated the effects of clickers from the effects of questions presented with clickers. Study 1…

Life sciences faculty agree that developing scientific literacy is an integral part of undergraduate education and report that they teach these skills. However, few measures of scientific literacy are available to assess students' proficiency in using scientific literacy skills to solve scenarios in and beyond the undergraduate biology classroom.…

We have developed and validated a tool for assessing understanding of a selection of fundamental concepts and basic knowledge in undergraduate introductory molecular and cell biology, focusing on areas in which students often have misconceptions. This multiple-choice Introductory Molecular and Cell Biology Assessment (IMCA) instrument is designed…

The National Survey of Student Engagement (NSSE), one of the most widely used annual surveys of undergraduates in the country, is specifically designed to assess the extent to which college students are engaged in empirically vetted good practices in undergraduate education. One of the major assumptions of the NSSE is that in measuring the extent…

The current study evaluated whether a manualized training in functional behavioral assessment (FBA) would result in typical school professionals being able to conduct a procedurally adequate FBA with a technically accurate summary statement for student behavior. Additionally, the study examined whether summary statements obtained by trained school…

The Collegiate Learning Assessment (CLA) is a measure of how much students' critical thinking improves after attending college or university. This report illustrates how institutions can set their own standards on the CLA using a method that is appropriate for the CLA's unique characteristics. The authors examined evidence of reliability and…

Purpose: This paper aims to describe a method of teaching that is based on Novak's concept-mapping technique. Design/methodology/approach: The paper shows how concept mapping can be used to measure prior knowledge and how simple mapping exercises can promote the integration of teachers' and students' understandings in ways that are meaningful.…

Several factors in the H. J. Walberg Educational Productivity Model, which assumes that 9 factors affect academic achievement, were examined with a limited sample of 1st-year students in the University of Groningen. Information concerning 8 of these factors--grades, motivation, age, prior achievement, home environment, support from peers,…

Responding to doubts about the validity of test results that showed the Pittsburgh School District's school improvement project to be highly successful, the district validated its results by administering a different test to a representative sample of students in secure conditions. (MCG)