To describe development and pilot testing of the Test of Adolescent Sexual Knowledge (TASK) developed by the researcher using content recommendations of the National Sexuality Education Standards. TASK development was guided by a systematic process described by Kirby and Mathtec. Pilot testing involved the use of talk-aloud interviews with 10…

Cronbach's coefficient alpha has been widely known and used in educational research. Many education research practitioners, however, may not be aware of the potential issues when the main assumptions for coefficient alpha are violated in research practice. This paper provides a brief discussion about two assumptions that may make the use and…

The purpose of this study was to describe the development of a valid and reliable rubric to assess secondary-level solo instrumental music performance based on principles of invariant measurement. The research questions that guided this study included (1) What is the psychometric quality (i.e., validity, reliability, and precision) of a scale…

In this article, we describe and illustrate the process by which we developed and validated short, multiple-choice, reliable tests to assess undergraduate students' comprehension of three mathematical proofs. We discuss the purpose for each stage and how it benefited the design of our instruments. We also suggest ways in which this process could…

Current preservice teacher education practice related to data use has been deemed inadequate, in that it is unevenly distributed and often superficial. In response, this article describes a course-based classroom assessment data-literacy experience for preservice elementary teachers. Grounded in extant theory and research concerning data literacy…

This article contains two measurement development studies on writing apprehension. Study 1 reexamines the validity of the writing apprehension measure based on the finding from prior research that a second false factor was embedded. The findings from Study 1 support the validity of a reduced measure with 6 items versus the original 20-item…

In order to progress as a field, school psychology research must be informed by effective measurement techniques. One approach to address the need for careful measurement is Rasch analysis. This technique can (a) facilitate the development of instruments that provide useful data, (b) provide data that can be used confidently for both descriptive…

This report describes efforts by a group of science teachers, teacher educators, researchers, and content specialists to conceptualize, develop, and pilot practice-based assessment items designed to measure elementary science teachers' content knowledge for teaching (CKT). The report documents the framework used to specify the content-specific…

To demonstrate how methodologies for assessing reading comprehension can grow out of views of the construct suggested in the reading research literature, we constructed tasks and carried out psychometric analyses that were framed in accordance with 2 leading reading models. In estimating item difficulty and subsequently, examinee proficiency, an…

Cognitive validity examines the relationship between what an assessment aims to measure and what it actually elicits from test takers. The present study examined whether multiple-choice items from the National Assessment of Educational Progress (NAEP) grade 12 U.S. history exam elicited the historical thinking processes they were designed to…

The Saudi National Assessment Centre administers the Computer Science Teacher Test for teacher certification. The aim of this study is to explore gender differences in candidates' scores, and investigate dimensionality, reliability, and differential item functioning using confirmatory factor analysis and item response theory. The confirmatory…

In this paper, we undertake a content analysis of mathematics assessment tasks to understand how often graphical representations are embedded within high-stakes national and international tests. A total of 274 items were analysed, consisting of 160 Grade 9 UN items, 88 Grade 8 TIMSS items, and 26 PISA items. Analysis showed that all items in the…

Reading comprehension is often treated as a multidimensional construct. In many reading tests, items are distributed over reading process categories to represent the subskills expected to constitute comprehension. This study explores (a) the extent to which specified subskills of reading comprehension tests are conceptually conceivable to…

This study examines the effects of text length and question type on Korean EFL readers' reading comprehension of the fill-in-the-blank items in Korean CSAT. A total of 100 Korean EFL college students participated in the study. After divided into three different proficiency groups, the participants took a reading comprehension test which consisted…

The purpose of this study was to translate Arnold and her colleagues' (Arnold, Fletcher, & Daniels, 2013) Organizational Stressor Indicator for Sport Performers (OSI-SP) into Chinese and examine its psychometric properties with Taiwanese athletes. In study 1, the psychometric properties of the items and the underlying structure of the…