Analyzing heterogeneous treatment effects (HTEs) plays a crucial role in understanding the impacts of educational interventions. A standard practice for HTE analysis is to examine interactions between treatment status and preintervention participant characteristics, such as pretest scores, to identify how different groups respond to treatment.…

Analyzing heterogeneous treatment effects (HTE) plays a crucial role in understanding the impacts of educational interventions. A standard practice for HTE analysis is to examine interactions between treatment status and pre-intervention participant characteristics, such as pretest scores, to identify how different groups respond to treatment.…

In this study, we examined the potential impact of item misfit on the reported scores of an admission test from the subpopulation invariance perspective. The target population of the test consisted of 3 major subgroups with different geographic regions. We used the logistic regression function to estimate item parameters of the operational items…

This study discusses the need, development, and validation of the Innovation Test Instrument (ITI). This article outlines how the researchers identified the content domain of the assessment and created test items. Then, it describes initial validation testing of the instrument. The findings suggest that the ITI is a good first step in creating an…

The purpose of this study was to develop a parallel bilingual vocabulary measure for the comparative study of receptive and expressive vocabulary growth in young Armenian-English bilinguals. The measure was comprised of four independent vocabulary lists equivalent on age of acquisition ratings. The lists were counterbalanced across four tasks,…

This study aims to develop Taiwan undergraduates' volunteer service motivation scale. To begin with, item pool was proposed on the basis of literature. After discussing with three Taiwan undergraduates, item pool, exploratory factor analysis (EFA) (N = 150) was proceeded, where three tests were conducted EFA: 1. Item analysis: comparisons of…

Are South Africans financially literate, and how can this be measured? Until 2009 there was no South African financial literacy measure and, therefore, the aim was to develop a South African measurement instrument that is scientific, socially acceptable, valid and reliable. To achieve this aim a contextual and conceptual analysis of financial…

The aims of the study were (a) to develop a scale to measure university students' task value and (b) to use confirmatory factor analytic techniques to investigate the construct validity of the scale. The questionnaire items were developed based on theoretical considerations and the final version contained 38 items divided into 4 subscales.…

The potential of computer-based assessments for capturing complex learning outcomes has been discussed; however, relatively little is understood about how to leverage such potential for summative and accountability purposes. The aim of this study is to develop and validate a multimedia-based assessment of scientific inquiry abilities (MASIA) to…

Nearly 100 students were given a Pre-Test in psychology on the first day of class without warning in order to assess their knowledge of basic course content derived from the prerequisites of the course (PSYC-100 Introduction to Psychology or PSYC-220 Child Development) and other life experiences. This was intended as a low-stakes testing…

Describes a program system which was developed for the purpose of making estimates about the nature of the distribution of test scores which will result from an administration of a test composed of items of which estimates of item-difficulty and discrimination are available. (Author/RC)

This study examines the Average System, an alternate procedure to the Rasch Model, for equating test scores. This technique does not require computers and can be easily employed by classroom teachers. A validation experiment using 23 sets of 10-item arithmetic tests constructed from a 230-item bank is described. (BS)

The problems stated at the outset were: to discover whether information provided by confidence testing would result in a more accurate assessment of student knowledge so more personal individualized instruction could be presented, and whether sufficient precise data could be attained to be of significant aid in curriculum planning. Analysis has…

The desirable characteristics of criterion referenced test items and sets of items are described. A two-stage item tryout and item selection procedure are also described. The paper presents the results of using the procedure as compared with traditional item selection procedures used in selecting items for norm referenced tests. It was found that…

Under the guidance of an advisory committee from the American Association for Respiratory Therapy (AART), The Psychological Corporation developed three forms of two criterion-referenced proficiency examinations to measure the skills, understandings, and knowledge required in entry level jobs for two levels of respiratory therapy personnel. The…