Multiple choice results are inherently probabilistic outcomes, as correct responses reflect a combination of knowledge and guessing, while incorrect responses additionally reflect blunder, a confidently committed mistake. To objectively resolve knowledge from responses in an MC test structure, we evaluated probabilistic models that explicitly…

Increasing linguistic diversity in classrooms has led researchers to examine the validity and fairness of standardized achievement tests, specifically concerning whether test score interpretations are free of bias and score use is fair for all students. This study examined whether mathematics achievement test items that contain complex language…

Item development is a time- and resource-intensive process. Automatic item generation integrates cognitive modeling with computer technology to systematically generate test items. To date, however, items generated using cognitive modeling procedures have received limited use in operational testing situations. As a result, the psychometric…

A self-report scale that measures teachers' confidence in teaching students about twenty-first century skills was developed and validated with pre-service and in-service teachers. First, 16 items were created to measure teaching confidence in six areas: information literacy, collaboration, communication, innovation and creativity, problem solving,…

Advances in technology have increased the likelihood that engineers will have to work in a global, culturally diverse setting. Many schools of engineering are currently revising their curricula to help students to develop cultural competence. However, our ability to measure cultural dispositions can be a challenge. The purpose of this project was…

We have designed, developed, and validated a 17-question Meiosis Concept Inventory (Meiosis CI) to diagnose student misconceptions on meiosis, which is a fundamental concept in genetics. We targeted large introductory biology and genetics courses and used published methodology for question development, which included the validation of questions by…

We followed established best practices in concept inventory design and developed a 12-item inventory to assess student ability in statistical reasoning in biology (Statistical Reasoning in Biology Concept Inventory [SRBCI]). It is important to assess student thinking in this conceptual area, because it is a fundamental requirement of being…

Purpose: The aim of this study was to develop and validate a scale to assess work role motivation in school principals: the Work Role Motivation Scale for School Principals (WRMS-SP). The WRMS-SP is designed to measure intrinsic motivation, three types of extrinsic motivation (identified, introjected, and external), and amotivation with respect to…

The evidence gathered in the present study supports the use of the simultaneous development of test items for different languages. The simultaneous approach used in the present study involved writing an item in one language (e.g., French) and, before moving to the development of a second item, translating the item into the second language (e.g.,…

Introduction: Interprofessional education (IPE) is interactive and constructivist in nature and requires specific facilitation skills to engage participants in a unique body of content, interpersonal interaction, and learning from each other. This article describes the development and testing of a scale, the Interprofessional Facilitation Scale…

"Differential Ability Scales," Second Edition (DAS-II; Elliott, 2007), was developed to measure the cognitive abilities of children and adolescents from age 2 years, 6 months to 17 years, 11 months. The test is designed to be individually administered, measuring general conceptual and reasoning ability ("g") as well as specific…

The School Motivation and Learning Strategies Inventory (SMALSI) is a diagnostic tool that helps educators identify and measure strategies that are actively used by students for learning. It is a self-report inventory for use with students 8 through 12 years of age (SMALSI-Child Form) and also with older students aged 13 to 18 years (SMALSI-Teen…

Presented a distinction between concepts of face validity and item subtlety. Trait categories were differentially accessible to individual judges. Higher criterion validities were associated with less subtle and more face-valid items. Results support a rational approach to test construction and emphasize the use of relevant test item content.…

A model and method for developing a valid and reliable paper-and-pencil test for evaluating the technical knowledge of baseball coaches in the National Coaching Certification Program (NCCP) in Canada are discussed. Development of a general theoretical and operational model for the evaluation of NCCP coaches in all sports are also studied. The…

A study was commissioned to develop and validate a test to assess the attitudes of Alberta (Canada) students toward the world of work. An instrument was needed to examine the following five areas of concern: (1) attitudes toward earning a living; (2) perceptions about employer expectations; (3) perceptions about available opportunities; (4)…