This report includes three papers that address critical "next generation" issues in assessment policy that can help to guide the choices made about system design: computer adaptive assessments, assessment of English learners and assessing science. None of these topics has received the attention that it deserves in the current debate on assessment…

Evaluating the impact of instructional innovations and coordinating instruction, assessment, and testing present complex tensions. Many evaluation and coordination efforts aim to address these tensions by using the coherence provided by modern cognitive science perspectives on domain-specific learning. This paper introduces an alternative…

The world in which learning and assessment must take place is rapidly changing. The digital revolution has created a vast space of interconnected information, communication, and interaction. Functioning effectively in this environment requires so-called 21st century skills such as technological fluency, complex problem solving, and the ability to…

Two extensions of the Mantel Haenszel procedure that may be useful in assessing differential item functioning (DIF) are explored. Simulation results showed that, for both inferential procedures, the studied item should be included in the matching variable, as in the dichotomous case. (SLD)

The effectiveness of alternative procedures to correct for rater leniency/stringency effects was studied when true scores were known. Ordinary least squares, weighted least squares, and imputation of the missing data consistently outperformed averaging the observed ratings; and the imputation technique was superior to the least squares methods.…

Performance rating systems frequently use multiple raters in order to improve the reliability of ratings. However, unless all candidates are rated by the same raters, some candidates will be at an unfair advantage or disadvantage solely because they were rated by more stringent or lenient raters. To obtain fair and accurate evaluations of…

A scoring algorithm for performance assessments is described that is based on expert judgments but requires the rating of only a sample of performances. A regression-based policy capturing procedure was implemented for clinicians evaluating skills of 280 medical students. Results demonstrate the usefulness of the algorithm. (SLD)

Explores the concept of outcomes-based education using authentic assessment. Highlights implications for information literacy using the following electronic products: newspaper or magazine simulation, videotape production, computer-aided design (CAD), multimedia presentation, and Web page publication. Suggests ways to integrate assessment in the…

Many educators are shifting their teaching strategies and approaches to include more emphasis on critical thinking skills, the communication of ideas, a variety of approaches to content emphasizing varied student learning styles, and the need to draw explicit connections among topics for retention of learning. Real-world assessment measures, then,…

Guidelines for developing performance assessments in science education allied with current research and reform are presented. The guidelines are applied to 3 hands-on science investigations performed by over 300 fifth and sixth graders and scored by science educators. Although difficult to develop, such assessments can be scored reliably. (SLD)

As part of a series of documents describing assessment of student learning in various curriculum areas in South Carolina, this document reviews the assessment of student learning in the science classroom. The report begins with a discussion of effective science learning, and outlines the knowledge, skills, and dispositions that encompass science…

The IADIS CELDA 2012 Conference intention was to address the main issues concerned with evolving learning processes and supporting pedagogies and applications in the digital age. There had been advances in both cognitive psychology and computing that have affected the educational arena. The convergence of these two disciplines is increasing at a…