In order to evaluate the effectiveness of an experimental elementary mathematics field experience course, we have designed a new assessment instrument. These video-based prediction assessments engage prospective teachers in a video analysis of a child solving mathematical tasks. The prospective teachers build a model of that child's mathematics…

Introduction: The Colleges of Physicians and Surgeons of Alberta and Nova Scotia (CPSNS) use a standardized multisource feedback program, the Physician Achievement Review (PAR/NSPAR), to provide physicians with performance assessment data via questionnaires from medical colleagues, coworkers, and patients on 5 practice domains: consultation…

People are inundated with technology on campuses and in their lives. Students are increasingly technology savvy, expecting faculty and administrators to function comfortably within the digital world. They have responded by using technology more and more in teaching and learning. In this article, the author focuses on one such use--student…

Using the off-level test scores of more than 250,000 students who participated in talent search testing from 2000 to 2008, this study examined if previously reported gender differences in students' performances in math versus verbal areas as well as the reported ratios of males and females for specific scoring levels still existed across years.…

Multiple-choice tests such as the Vocabulary Levels Test (VLT) are often viewed as a preferable estimator of vocabulary knowledge when compared to yes/no checklists, because self-reporting tests introduce the possibility of students overreporting or underreporting scores. However, multiple-choice tests have their own unique disadvantages. It has…

This study explores measurement of a construct called knowledge integration in science using multiple-choice and explanation items. We use construct and instructional validity evidence to examine the role multiple-choice and explanation items plays in measuring students' knowledge integration ability. For construct validity, we analyze item…

A rubric is a scoring guide that consists of specific pre-established performance criteria, used for evaluating students' work. iRubric is a comprehensive digital rubric development, assessment, and sharing tool that shows the major skills and sub-skills to be mastered, the different mastery levels, and marks allocated to each level. This article…

This paper is concerned with research in measuring receptive and productive vocabulary knowledge in second language (L2) learning, including English as a second language (ESL) learning and English as a foreign language (EFL) learning. The paper will begin with a brief introduction to the role of vocabulary in language learning, and then an…

Multilevel data often exist in educational studies. The focus of this study is to consider differential item functioning (DIF) for dichotomous items from a multilevel perspective. One of the most often used methods for detecting DIF in dichotomously scored items is the Mantel-Haenszel log odds-ratio. However, the Mantel-Haenszel reduces the…

Any assessment primer cautions that course grades are not ordinarily considered outcomes assessments. The rationale for excluding grades as an assessment mechanism uses the following logic: because grades measure a variety of learning outcomes and probably take into account factors like attendance that have nothing to do with evidence of learning,…

We investigated the influence of the level of cognitive functioning on sequence-specific learning in Parkinson's disease (PD). This was done by examining the relationship between the scales for outcomes in Parkinson's disease-cognition [SCOPA-COG, Marinus, J., Visser, M., Verwey, N. A., Verhey, F. R. J., Middelkoop, H. A. M.,Stiggelbout, A., et…

The aim of this paper is to develop a more thorough, empirically-based understanding of the differences in measurement of written argumentation when alternative scoring frameworks are employed. Reflective compositions of 127 elementary school children were analyzed using analytic and holistic scales. The scales were derived from Argument Schema…

Research and development of a new type of scoring rubric for the integrated speaking tasks of "TOEFL iBT"® are described. These "analytic rating guides" could be helpful if tasks modeled after those in TOEFL iBT were used for formative assessment, a purpose which is different from TOEFL iBT's primary use for admission…

As digital media practices become readily available in today's classrooms, literacy and literacy instruction are changing in profound ways (Alvermann, 2010). Professional organizations emphasize the importance of integrating new literacies (New London Group, 1996) practices into language-arts instruction (IRA, 2009; NCTE, 2005). As a result,…

Speaking performance tests typically employ raters to produce scores; accordingly, variability in raters' scoring decisions has important consequences for test reliability and validity. One such source of variability is the rater's level of expertise in scoring. Therefore, it is important to understand how raters' performance is influenced by…