Scoring high-dimensional assessments (e.g., > 15 traits) can be a challenging task. This paper introduces the multilabel neural network (MNN) as a scoring method for high-dimensional assessments. Additionally, it demonstrates how MNN can score the same test responses to maximize different performance metrics, such as accuracy, recall, or…

In the present paper, we assess whether website rating systems are useful for selecting educational apps for preschool age children. We selected the 10 highest scoring and 10 lowest scoring apps for 2-4-year-olds from two widely used websites (Good App Guide; Common Sense Media). Apps rated highly by the two websites had a higher educational…

Clients display considerable variations in functioning across the contexts that encompass their social environments (e.g., home, school/workplace, peer interactions). No single measurement method can fully capture these variations. Yet, assessors must balance the need to accurately capture clients' clinical presentations, and at the same time…

Although people with autism are protected under the Americans with Disabilities Act of 1990, there is little theoretical or practical effort to determine whether traditional pre-employment assessments unfairly impact autistic job seekers. Due to the lack of emphasis on social communication, game-based assessments (GBAs) may offer a way of…

The "TextEvaluator"® text analysis tool is a fully automated text complexity evaluation tool designed to help teachers and other educators select texts that are consistent with the text complexity guidelines specified in the Common Core State Standards (CCSS). This paper provides an overview of the TextEvaluator measurement approach and…

This guide is designed to assist States, agencies, and/or facilities who work with youth who are neglected, delinquent, or at-risk (N or D). The information in the guide will benefit those who are (a) interested in implementing pre-posttests, (b) in the process of identifying an appropriate pre-posttest, or (c) ready to evaluate current testing…

The purpose of this study was to determine if a commercial teacher selection tool, the Ventures for Excellence Teacher StyleProfile, had a statistically significant relationship with teacher evaluation and performance feedback data gathered during a teacher's first year of teaching in the Midwest School District. A review of the literature…

While federal law requires students to be tested in math, English-language arts and science in particular grades, states are still struggling to mount the resources and expertise necessary to fully implement college and career readiness standards, let alone new assessments aligned to these higher standards. New assessments are not only more…

Teachers in the United States are compensated largely on the basis of fixed schedules that reward experience and credentials. However, there is a growing interest in whether performance-based incentives based on rigorous teacher evaluations can improve teacher retention and performance. The evidence available to date has been mixed at best. This…

This article describes TextEvaluator, a comprehensive text-analysis system designed to help teachers, textbook publishers, test developers, and literacy researchers select reading materials that are consistent with the text complexity goals outlined in the Common Core State Standards. Three particular aspects of the TextEvaluator measurement…

I address two issues that were inspired by my work on the Dutch Committee on Tests and Testing (COTAN). The first issue is the understanding of problems test constructors and researchers using tests have of psychometric knowledge. I argue that this understanding is important for a field, like psychometrics, for which the dissemination of…

English language learners (ELLs) with disabilities are an increasing presence in schools in the United States. Title I and Title III of the Elementary and Secondary Education Act require that these students meet the same academic grade-level standards and participate in content assessments as their fluent-English speaking peers without…

The NEO-PI-R (Costa & McCrae, 1992b) is an assessment of normal personality composition that is used in clinical counseling contexts as well as for personnel selection. There has been some debate regarding the necessity and usefulness of validity scales to detect response distortion on this instrument. Because the authors of the instrument,…

The 11th International Conference on Educational Data Mining (EDM 2018) is held under the auspices of the International Educational Data Mining Society at the Templeton Landing in Buffalo, New York. This year's EDM conference was highly competitive, with 145 long and short paper submissions. Of these, 23 were accepted as full papers and 37…

Reviews potential Internet applications in counseling test selection, orientation, administration, scoring and interpretation. Explores inappropriate assessment use, relationship issues, ethics, credentialing, and training. (Contains 39 references and an appendix.) (Author/GCP)