This article describes the process of developing and implementing a quick Web-based screening test designed for the purpose of identifying, within a large, culturally diverse population of undergraduates enrolled at an English-medium university, those students unlikely to require English language support during their 1st year of academic study.…

This article describes the development of a measure of adult sleep quality: the Adult Sleep-Wake Scale (ADSWS). The ADSWS is a self-report pencil-and-paper measure of sleep quality consisting of five behavioral dimensions (Going to Bed, Falling Asleep, Maintaining Sleep, Reinitiating Sleep, and Returning to Wakefulness). Data were collected from…

This exploratory study investigates the potential of Wiki technology as a tool for teaching and learning. Wikis are a component of Web 2.0 technology tools that provide collaborative features and active learning opportunities in a web-based environment. This research study sought to empirically determine the pedagogical value of using Wiki…

Differential item functioning (DIF) assessment attempts to identify items or item types for which subpopulations of examinees exhibit performance differentials that are not consistent with the performance differentials typically seen for those subpopulations on collections of items that purport to measure a common construct. DIF assessment…

Three papers describe the three stages of developing the National Teacher Examination (NTE) School Psychologist Specialty Area Test. The first stage is described in the paper entitled "Knowledge Areas Important to School Psychology." A survey of the membership of the National Association of School Psychologists helped determine knowledge…

The purpose of this paper is to clarify the seemingly discrepant views of test theorists and test developers about terminology related to the evaluation of test content. The origin and evolution of the concept of content validity are traced, and the concept is reformulated in a way that emphasizes the notion that content domain definition,…

The relationship between the multiple-choice and free-response sections of the Computer Science and Chemistry tests of the College Board's Advanced Placement program was studied. Confirmatory factor analysis showed that the free-response sections measure the same underlying proficiency as the multiple-choice sections for the most part. However,…

This study describes the creation of measures of teachers' use of ability grouping in instruction using Rasch analysis. The dimensionality of the proposed construct was also investigated. Results of the Rasch analysis are compared to the results using composites to illustrate how the description of a construct can vary depending on the method used…

Performance tasks build on earlier content knowledge, progress skills, and work habits. They are not add-ons at the end of instruction, but an integral part of the learning and an opportunity to assess the quality of student performance. This guide was written by teachers to share their experiences in the introduction of performance based…

This study uses generalizability theory to examine the dependability of anchoring labels of Likert-type scales. Variance components associated with labeling were estimated in two samples using a two-facet random effect generalizability-study design. In one sample, 173 graduate students in education were administered 7 items measuring attitudes…

Differential item functioning (DIF), or item bias, occurs when individuals in a focal group respond differently to a test item than do individuals in a reference group even when comparisons are restricted to individuals with similar overall skill levels on the trait in question. It is common in constructing a questionnaire or survey to recommend…

Test developers continue to struggle with the technical and logistical problems inherent in assessing achievement across different languages. Many testing programs offer separate language versions of a test to evaluate the achievement of examinees in different language groups. However, comparisons of individuals who took different language…

Using an anchor-item design of test equating, the effects of three equating methods (Tucker linear and two three-parameter item-response-theory-based (3PL-IRT) methods), and the content representativeness of anchor items on the accuracy of equating were examined; and an innovative way of evaluating equating accuracy appropriate for the particular…

Bringing structure to the reading assessment process, this paper presents a draft proposal of an assessment structure which practitioners can follow, one which can be applied systematically within the Instructional Support Team process across Pennsylvania. After some background information, the paper briefly discusses features of effective reading…

Fred N. Kerlinger has been hailed as having contributed to the transformation of the way that behavioral scientists and educators read research reports, design and execute research, and draw conclusions about research. In 1960 he introduced the notion that educational research is fraught with mythology. Three of the research myths that he…