The use of the aggregate scoring method for scoring concordance tests requires the weighting of test items to be derived from the performance of a group of experts who take the test under the same conditions as the examinees. However, the average score of experts constituting the reference panel remains a critical issue in the use of these tests.…

In this article, the author shares some tips for improving university-wide assessment conversations, focusing on meetings with faculty creating and doing assessment. The lessons are from a multi-year project where the author observed meetings and interviewed faculty about their involvement in university-wide assessment.

In 1998, Plucker and Runco provided an overview of creativity assessment, noting current issues (fluency confounds, generality vs. specificity), recent advances (predictive validity, implicit theories), and promising future directions (moving beyond divergent thinking measures, reliance on batteries of assessments, translation into practice). In…

Simulation has been considered a valid pedagogy for health professionals in education and actual practice. Its proper execution is vital for proper assimilation of knowledge, skills, and attitudes within the pre-licensure students throughout their curricular journey. High fidelity and multi-patient simulation scenarios were employed for beginner…

RISE was designed and revised to provide a quality system, aligned with current legislative requirements that local corporations can adopt in its entirety, or use as a model as they develop evaluation systems to best suit their local contexts. A representative group of teachers and leaders from across the state, along with staff from the Indiana…

This study uses a computerized formative assessment system that provides automated scoring and feedback to help students write scientific arguments in a climate change curriculum. We compared the effect of contextualized versus generic automated feedback on students' explanations of scientific claims and attributions of uncertainty to those…

Intersection of education and deep learning method of artificial intelligence (AI) is gradually becoming a hot research field. Education will be profoundly transformed by AI. The purpose of this review is to help education practitioners understand the research frontiers and directions of AI applications in education. This paper reviews the…

The KeyMath-3 Diagnostic Assessment (KM-3) is an individually-administered math assessment used in educational placement and diagnostic decisions. It includes 10 subtests making up Basic Concepts, Operations, and Applications indexes and a "Total Test" composite that measures overall math ability. Here, covariances among subtests from…

Substantial research has explored the connection between children's spontaneous focusing on numerosity (SFON) and their current and later mathematical achievement. However, the findings have been inconsistent, and no comprehensive investigation has yet been conducted. This meta-analysis examines the relation between SFON and mathematics…

Scoring in creativity research has been a central problem since creativity became an important issue in psychology and education in the 1950s. The current study examined the psychometric properties of 27 creativity indices derived from summed and averaged scores using 15 scoring methods. Participants included 2802 middle-school students. Data…

In design-oriented biomedical engineering courses, some instructors teach need-driven methods for health technology innovation that use a "need statement" to reflect a student team's hypothesis about the most fruitful direction for their project. While need statements are of the utmost importance to the projects, we were not aware of any…

Courses are the fundamental building blocks of educational programs, serving as a tangible representation of student attainment and the desired learning outcomes of the program. Despite their pivotal role in education, however, a standardized framework for the development, implementation, and enhancement of course specifications remains elusive.…

In Canada, high stakes objective structured clinical examinations (OSCEs) administered by the Medical Council of Canada have relied exclusively on physician examiners (PEs) for scoring. Prior research has looked at using SPs to replace PEs. This paper reports on two studies that implement and evaluate a standardized patient (SP) scoring tool to…

Interim and summative assessments often are used to make decisions about student writing skills and needs for instruction, but the extent to which different raters and score types might introduce bias for some groups of students is largely unknown. To evaluate this possibility, we analyzed interim writing assessments and state summative test data…

The objective for all three phases of this study was to make improvements to an existing measure, the Dispositional Evaluation Rubric (DER), and then establish reliability and validity of the measure, which will support schools and teacher preparation programs in measuring teacher candidates' professional dispositions. This study was designed to…