We used data simulations to test whether composites consisting of cohesive subtest scores are more accurate than composites consisting of divergent subtest scores. We demonstrate that when multivariate normality holds, divergent and cohesive scores are equally accurate. Furthermore, excluding divergent scores results in biased estimates of…

This study uses a complexity-accuracy-lexis-fluency (CALF) framework to explore performance on 2 speaking tasks: a narrative picture-based task and an interactive decision-making task. A preliminary aim is to compare performance on the 2 tasks, using a wide range of CALF measures to explore where scores are similar and where they are different.…

The latent class reliability coefficient (LCRC) is improved by using the divisive latent class model instead of the unrestricted latent class model. This results in the divisive latent class reliability coefficient (DLCRC), which unlike LCRC avoids making subjective decisions about the best solution and thus avoids judgment error. A computational…

Being able to accurately spell in Standard English requires efficient coordination of multiple knowledge sources. Therefore, spelling is a word-formation problem-solving process that can be difficult to learn. The present study uses Triple Word Form Theory as a conceptual framework to analyse Standard English spelling performance levels of…

Traditionally, students with learning disabilities (LD) have been identified using an aptitude--achievement discrepancy or response to intervention approach. As profiles of the cognitive deficits of discrepancy-defined students with LD have already been developed using these approaches, these deficits can in turn be used to identify LD using the…

Advancements in technology have greatly influenced how students write, the ways they interact with readers, and the genres they create. In order to reflect real-world writing behaviors in the assessment setting and to be able to generalize test-takers' performance from the assessment to their true writing ability, the current study investigated…

We examined the diagnostic accuracy and efficiency of three approaches to universal screening for reading difficulties using retrospective data from 1,307 students in Grades 3 through 5. School staff collected screening data using the Measures of Academic Progress (MAP), a curriculum-based measure (CBM), and running records (RR). The criterion…

Component Universe Score Profile analysis (CUSP) is introduced in this paper as a psychometric alternative to multivariate profile analysis. The theoretical foundations of CUSP analysis are reviewed, which include multivariate generalizability theory and constrained principal components analysis. Because CUSP is a combination of generalizability…

Millions of adults in the United States lack the necessary literacy skills for most living wage jobs. For students from adult learning classes, we used a lexical decision task to measure their knowledge of words and we used a decision-making model (Ratcliff's, 1978, diffusion model) to abstract the mechanisms underlying their performance from…

This study explored graduate teaching assistant (GTA) grading on 480 papers across two writing assignments as integrated into large Introductory Psychology courses. We measured GTA accuracy, consistency, and commenting (feedback) quality. Results indicate that GTA graders improved, although unevenly, in accuracy and consistency from Time 1 to 2…

Improving the mathematical skills of the next generation of students will require that elementary and middle school teachers are competent and confident in their abilities to perform fraction operations and to solve algebra equations The present study was conducted to (a) quantify relationships between prospective teachers' abilities to perform…

The advent of No Child Left Behind led to increased teacher accountability for student performance and placed strict sanctions in place for failure to meet a certain level of performance each year. With instructional time at a premium, it is imperative that educators have brief academic assessments that accurately predict performance on…

As the government aimed to provide appropriate education to all children (No Child Left Behind Act), it is important that the education providers can assess the performance of the students correctly so that they can provide the appropriate education for the students. Profile analysis is a very useful tool to interpret test scores and measure…

This experiment involved college students (N = 464) working on an authentic learning task (writing an essay) under 3 conditions: no feedback, detailed feedback (perceived by participants to be provided by the course instructor), and detailed feedback (perceived by participants to be computer generated). Additionally, conditions were crossed with 2…