The early stage of computerized adaptive testing (CAT) refers to the phase of the trait estimation during the administration of only a few items. This phase can be characterized by bias and instability of estimation. In this study, an item selection criterion is introduced in an attempt to lessen this instability: the D-optimality criterion. A…

Evaluators often make key decisions about what content to include when designing new scales. However, without clear conceptual grounding, there is a risk these decisions may compromise the scale's validity. Techniques such as concept mapping are available to evaluators for the specification of conceptual frameworks, but have not been used as a…

Lissitz and Samuelsen (2007) have proposed a framework that seemingly deems construct validity evidence irrelevant to supporting educational test meaning. The author of this article agrees with Lissitz and Samuelsen that internal evidence establishes test meaning, but she argues that construct validity need not be removed from the validity sphere.…

Although researchers have developed various scales for measuring users' computer anxiety or Internet anxiety, none of the literature has addressed the measurement of mobile computer anxiety (MCA). The purpose of this study is to develop and validate a multidimensional mobile computer anxiety scale (MCAS) based on previous research on computer…

College tests need to be better thought out, constructed, administered, evaluated, and explained to students in order to render exams fair, learning experience, and relevant to classes and students. Ways to accomplish these goals are offered in this essay. (Contains 20 endnotes.)

A historical increase in the number of factors purportedly measured by commercial tests of cognitive ability may result from four distinct pressures including: increasingly complex models of intelligence, test publishers' desires to provide clinically useful assessment instruments with greater interpretive value, test publishers' desires to…

This paper describes the development of the fear survey for adults with mental retardation (FSAMR) and provides initial evidence of its psychometric properties. The FSAMR was designed to be sensitive to the assessment needs of individuals with mental retardation. The items were developed through open-ended interviews, a review of existing…

The reasoning behind popular methods for analysing the raw data generated by multiple choice question (MCQ) tests is not always appreciated, occasionally with disastrous results. This article discusses and analyses three options for processing the raw data produced by MCQ tests. The article shows that one extreme option is not to penalize a…

How do the best administrators find out how to improve their schools? They actively engage the people who work and study there. In "From Questions to Actions: Using Questionnaire Data for Continuous School Improvement," data experts Victoria L. Bernhardt and Bradley J. Geise explain how to collect and analyze data with an eye toward positive…

Holland's theory of six work personalities has become a staple of vocational psychology, providing a robust and simple model for understanding the structure of vocational interests. Though Holland's types provide a common vocabulary for vocational psychologists working with a variety of populations, until this point there has not been a measure of…

Purpose: The purpose of this paper is to report on the rationale behind the use of a unique paper-based individualised accounting assignment, which automated the provision to students of immediate formative and timely summative feedback. Design/methodology/approach: As students worked towards completing their assignment, the package provided…

Lexical competence is considered to be an essential step in the development and consolidation of a student's linguistic ability, and thus the reliable assessment of such competence turns out to be a fundamental aspect in this process. The design and construction of vocabulary tests has become an area of special interest, as it may provide teachers…

We propose an extension of the Teaching Machine project, called Quiz Generator, that allows instructors to produce assessment quizzes in the field of algorithm and data structures quite easily. This extension makes use of visualization techniques and is based on new features of the Teaching Machine that allow third-party visualizers to be added as…

The authors report the development of an assessment process for distinguishing between higher and lower risk youth offenders through the use of 3 measures. Preliminary results and applications for practice are included. (Contains 2 tables.)

Self-efficacy is an important cognitive predictor of substance abuse treatment outcome. Although measures of coping self-efficacy are related to substance use relapse in adults, their properties are not well-known in adolescent populations. The present study examined 223 adolescents while in treatment for substance abuse and comorbid psychiatric…