Scoring high-dimensional assessments (e.g., > 15 traits) can be a challenging task. This paper introduces the multilabel neural network (MNN) as a scoring method for high-dimensional assessments. Additionally, it demonstrates how MNN can score the same test responses to maximize different performance metrics, such as accuracy, recall, or…

This guide is designed to assist States, agencies, and/or facilities who work with youth who are neglected, delinquent, or at-risk (N or D). The information in the guide will benefit those who are (a) interested in implementing pre-posttests, (b) in the process of identifying an appropriate pre-posttest, or (c) ready to evaluate current testing…

The reporting of scores on educational tests is at times misunderstood, misinterpreted, and potentially confusing to examinees and other stakeholders who may need to interpret test scores. In reporting test results to examinees, there is a need for clarity in the message communicated. As pressure rises for students to demonstrate performance at a…

In the United States, when English language learners (ELLs) are tested, they are usually tested in English and their limited English proficiency is a potential cause of construct-irrelevant variance. When such irrelevancies affect test scores, inaccurate interpretations of ELLs' knowledge, skills, and abilities may occur. In this article, we…

Results of gifted fourth-sixth graders on the Structure of the Intellect Learning Abilities Test are analyzed in terms of the test's measure of five operations (evaluation, convergent production, divergent production, memory, and cognition). (CL)

Despite their shortcomings, standardized tests provide numerical, intelligible data on how a child, school, or district is performing and vital information about patterns of strengths and weaknesses among students in a classroom, school, or district. A sensible compromise in the testing debate would be helpful. (MLH)

The American Psychological Association, in the late 1940s, began work to establish a code of ethics to include and address the needs of members in scientific and applied fields. Out of the ethics work emerged a set of standards for evaluating psychological tests. Four categories, or types of validity, were identified: content, predictive,…

Recognizes the attraction of Goal Attainment Scaling (GAS), a technique that uses a scale to measure client's achievement, but suggests that there are concerns about the calculation of its standard scores. Examples show how GAS may be used in service development, whether or not numerical values are attached. (Author/CR)

A critical, but often neglected, component of any large-scale assessment program is the reporting of test results. In the past decade, a body of evidence has been compiled that raises concerns over the ways in which these results are reported to and understood by their intended audiences. In this study, current approaches for reporting…

Methods of adjusting group differences in assessment and test scores are described, classified, and evaluated. Investigation of the relationship between intended use of test scores and the appropriate meaning of scores is essential for fair treatment in assessment. (SLD)

This paper describes a process used to assess the technical competency of non-direct line candidates for managerial positions in computer specialties. The Training and Experience (T&E) qualifying test, a multi-method approach combining task-based, computer scorable evaluations of training and experience with multiple-choice batteries, was used as…

It is argued that consequential validity is a concept worth considering. The solution to defining "validity" is not to narrow the concept, but to allow for the differential prediction provided by tests in different circumstances. Consequences of the uses and interpretations of test scores are central to their evaluation. (SLD)

Community college students' (n=662) scores on My Vocational Situation related modestly to some concurrent signs of career progress but did not predict grades or enrollment decisions, thereby calling into question the instrument's usefulness for prescription or evaluation, unless it is revised. (Author)

The mission of the "Journal of Counseling and Development" (JCD) includes the attempt to serve as a "scholarly record of the counseling profession" and as part of the "conscience of the profession." This responsibility requires the willingness to engage in self-study. This study investigated two aspects of research…

Specific recommendations are made concerning the circumstances under which the benefits of out-of-level testing outweigh the problems associated with it. Topics explored are: various methods for deciding when a set of test scores is invalid and the utility of these methods for local evaluators, the accuracy of vertical scaling, and the usefulness…