This paper describes an expanded framework to aid chemical educators in constructing exams for their courses. The framework has three primary levels: definition, algorithmic, and conceptual. These primary levels have often been used in chemical education research to analyze and describe exam questions, but in this study the definition,…

In this article we provide an overview of the nature and scope of multisource feedback (MSF) and provide empirical evidence of its reliability, validity, and feasibility in one of the health professions. The overall internal consistency reliability (Cronbach alpha) of MSF instruments is generally greater than 0.96 for self and informants such as…

This paper provides an overview of evidence-centered assessment design (ECD) and some general information about of the Advanced Placement (AP[R]) Program. Then the papers in this special issue are discussed, as they relate to the use of ECD in the revision of various AP tests. This paper concludes with some observations about the need to validate…

Hooker, Finkelman, and Schwartzman ("Psychometrika," 2009, in press) defined a paradoxical result as the attainment of a higher test score by changing answers from correct to incorrect and demonstrated that such results are unavoidable for maximum likelihood estimates in multidimensional item response theory. The potential for these results to…

Assessments matter in education. Testing is nothing new; tests have been around as long as school itself. However, over the last 15 years, state assessments have grown to be an increasingly central, and often controversial, part of schooling. As states raise their standards, it is more important than ever to ask: What is a high-quality assessment?…

In the U.S., writing proficiency exams (WPEs) often employ a construct of writing proficiency that is based on U.S. English and essay-text literacy. As universities internationalize, they should reconsider whether such exams reflect the literacy requirements of a globalizing world. Since the ways in which universities respond to international…

In this essay I argue that the effects of federal policy can be examined through a scale analysis that helps deconstruct the effect of the current widespread accountability movement in the US educational system. I first discuss the concept of scale, including its thus-far limited use in educational research. I define scales not only as…

In this technical report, we document the development and piloting of easyCBM reading measures aligned to the Common Core State Standards, designed for use in screening students at risk for reading difficulty and monitoring their progress as they develop reading skills. The measures, which assess students' ability to respond to…

With growing concerns over higher education accountability and diminishing resources, student retention rates and the reasons why students remain at a post-secondary institution continue to persist. Since the 1960s, researchers have examined cognitive and non-cognitive factors that impact whether or not students stay at a particular post-secondary…

This paper describes a study that evaluates fifteen-year-old Chilean students Information and Communication Technology (ICT) skills. The paper presents an operational definition of ICT skills, an instrument measuring these skills as well as the students' results in the test. The definition of ICT skills used considers Chile's curricular framework,…

Past research with the Communication Attitude Test (CAT) has shown it to be a valid and reliable instrument for assessing speech-associated attitude of children who stutter (CWS). However, in Japan, the CAT has not been used extensively to examine the communication attitude of CWS. The purpose of this study was to determine if a Japanese version…

Objective: To develop and validate measures of parental social support to increase their child's fruit and vegetable (FV) consumption. Design: Cross-sectional study design. Setting: School and home. Participants: Two hundred three parents with at least 1 elementary school-aged child. Main Outcome Measure: Parents completed a questionnaire that…

This article introduces the development and validation of the spatial thinking ability test (STAT). The STAT consists of sixteen multiple-choice questions of eight types. The STAT was validated by administering it to a sample of 532 junior high, high school, and university students. Factor analysis using principal components extraction was applied…

A primary difficulty with music performance assessment is managing its subjective nature. To help improve objectivity, rubrics can be used to develop a set of guidelines for clearly assessing student performance. Moreover, rubrics serve as documentation for student achievement that provides music teachers with a written form of accountability.…

The construct of perfectionism is related to many important outcome variables. However, the term "perfectionism" has been defined in many different ways, and items comprising the different existing scales appear to be very different in content. The overarching aim of the present set of studies was to help clarify the specific…