The subjective aspect of standard-setting is often criticized, yet data-driven standard-setting methods are rarely applied. Therefore, we applied a mixture Rasch model approach to setting performance standards across several testing programs of various sizes and compared the results to existing passing standards derived from traditional…

Background: Engineers operate in an increasingly global environment, making it important that engineering students develop global engineering competency to prepare them for success in the workplace. To understand this learning, we need assessment approaches that go beyond traditional self-report surveys. A previous study (Jesiek et al.,…

As access to smartphones and emerging technologies has become ubiquitous in our daily lives and in language learning, technology-mediated social interaction has become common in teaching and assessing L2 speaking. The changing ecology of L2 spoken interaction provides language educators and testers with opportunities for renewed test design and…

In this technical report, the Center for Research Use in Education (CRUE) presents the methodological design of a large-scale quantitative investigation of research use by school-based practitioners through the "Survey of Evidence in Education for Schools (SEE-S)." It documents the major technical aspects of the development of SEE-S,…

Increasingly content area projects and programs at the K-12 level, such as in mathematics, involve a programmatic component or project emphasis on developing "teacher leadership". However, there is no consistent definition or framework for this construct and even fewer validated tools for measuring it. This paper describes our efforts in…

Assessing complex constructs such as those discussed under the umbrella of 21st century constructs highlights the need for a principled assessment design and validation approach. In our discussion, we made a case for three considerations: (a) taking construct complexity into account across various stages of assessment development such as the…

This article presents information on the development and initial validation of the 16-item Response to Intervention (RTI) Beliefs Scale. The scale is designed to measure the extent to which educators working in schools hold beliefs consistent with the tenets of RTI. The authors administered the instrument to 2,430 educators in 62 elementary…

English language learners (ELLs) with disabilities are an increasing presence in schools in the United States. Title I and Title III of the Elementary and Secondary Education Act require that these students meet the same academic grade-level standards and participate in content assessments as their fluent-English speaking peers without…

Real-life, complex problems often require that decisions are made despite limited information or insufficient time to explore all relevant aspects. Incorporating authentic uncertainties into an assessment, however, poses problems in establishing results and analysing their methodological qualities. This study aims at developing a test on clinical…

This pragmatic, accessible book presents an empirically supported conceptual framework and hands-on instructions for conducting curriculum-based measurement (CBM) in grades K-8. The authors provide everything needed to evaluate student learning in reading, spelling, writing, and math; graph the resulting data; and use this information to make…

A decision model designed to determine the reliability and validity of criterion referenced measures (CRMs) is presented. General procedures which pertain to the model are discussed as to: Measures of relationship, Reliability, Validity (content, criterion-oriented, and construct validation), and Item Analysis. The decision model is presented in…

Evaluation of the ratio of cost to benefit of instruction must play an important part in the formation of a public policy on education. However, it is doubtful if evaluation is sufficiently developed to play such a role, because evaluation is based on student responses to test items which contain an indefinite bias and cannot be accepted as…

In the twenty-first century, for a growing number of people around the world, the Internet is used not only for gathering information but also for self-help. The uses of the Internet are steadily growing, and it has become an inseparable part of everyday life for ordinary people (Barak, 1999; Barak & English, 2002; Gore & Leuwerke, 2000;…

State Departments of Education are turning to the use of criterion referenced, as opposed to norm referenced, models for statewide assessment. The underlying assumption in this turn of events is that results generated by criterion referenced tests within the statewide assessment context permit the drawing of value inferences about the…

Symposium topics and speakers include "Choosing Needs for Needs Assessment" (Stephen P. Klein); "Selecting Tests to Assess the Needs" (Ralph Hoepfner); "Making Better Decisions on Assessed Needs: Differentiated School Norms" (Paul A. Bradley and Dale Woolley); and "Allocating Resources by Subject Area"…