The purpose of this study was to determine the extent that diagrammatic literacy is necessary for success on standardized science tests at the late-elementary and middle grade levels. Towards this goal, we quantified the frequency, form and function of graphical representations on select state science tests. 985 tests items from 14 states were…

Lord (1980) proposed formulas that provide direct relationships between IRT discrimination and difficulty parameters and conventional item statistics. The purpose of the present study was to determine the robustness of the formulas beyond the initial and restrictive conditions identified by Lord. Simulation and real achievement data were employed.…

The No Child Left Behind act resulted in an increased reliance on large-scale standardized tests to assess the progress of individual students as well as schools. In addition, emphasis was placed on including all students in the testing programs as well as those with disabilities. As a result, the role of testing accommodations has become more…

Ratings scales are a common component of many multisource, multimethod frameworks for socioemotional and behavior assessment of children. There is a modest literature base to support the use of attitudinal, behavioral, and personality rating scales. Much of that historic literature focuses on the characteristics and interpretations of specific…

This study examined the extent to which log-linear smoothing could improve the accuracy of differential item functioning (DIF) estimates in small samples of examinees. Examinee responses from a certification test were analyzed using White examinees in the reference group and African American examinees in the focal group. Using a simulation…

Higher education experts tout learning outcomes assessment as a vehicle for program improvement. To this end the authors share a rubric designed explicitly to evaluate the quality of assessment and how it leads to program improvement. The rubric contains six general assessment areas, which are further broken down into 14 elements. Embedded within…

Ability tests play an important role in the assessment programs of many schools. However, the inferences about ability made from such tests presume that students understand the tasks they are attempting. Task familiarity can vary by student as well as by format. By design, nonverbal reasoning tests use formats that are intended to be novel. The…

Using Rasch analysis, the psychometric properties of a newly developed 35-item parent-proxy instrument, the Caregiver Assessment of Movement Participation (CAMP), designed to measure movement participation problems in children with Developmental Coordination Disorder, were examined. The CAMP was administered to 465 school children aged 5-10 years.…

The purpose of this study was to investigate the construct validity of the Self-Efficacy/Social Support for Activity for persons with Intellectual Disability (SE/SS-AID) scales developed by Peterson, Peterson, Lowe, & Nothwehr (2009). A total of 146 participants with intellectual disabilities completed 6 self-efficacy (SE) items and 18 social…

This article provides an overview of the development and validation of the Student Tool for Technology Literacy (ST[superscript 2]L). Developing valid and reliable objective performance measures for monitoring technology literacy is important to all organizations charged with equipping students with the technology skills needed to successfully…

The aim of this study was to examine the validation of the Hooper Visual Organization Test (HVOT) for use in children by testing for item fit, unidimensionality, item hierarchy, reliability, and screening capacity. A modified scoring system was devised for the HVOT so that children received some credit for being able to describe the function of…

This study investigated the use of performance-confidence relationships to signal the presence of alternative conceptions and inadequate problem-solving skills in mechanics. A group of 33 students entering physics at a South African university participated in the project. The test instrument consisted of 20 items derived from existing standardised…

The current experiment examined the use of plausibility judgments by children to reject distractors presented on "yes/no" recognition memory tests. Participants studied two lists of word pairs that shared either a categorical or rhyme association, which constituted the global nature of the two study conditions. During the recognition memory tests,…

This study examined variations of the nonequivalent-groups equating design for mixed-format tests--tests containing both multiple-choice (MC) and constructed-response (CR) items--to determine which design was most effective in producing equivalent scores across the two tests to be equated. Four linking designs were examined: (a) an anchor with…

The purpose of this study is to describe how the attribute hierarchy method (AHM) can be used to evaluate differential group performance at the cognitive attribute level. The AHM is a psychometric method for classifying examinees' test item responses into a set of attribute-mastery patterns associated with different components in a cognitive model…