The "e-rater"® automated essay scoring system is used operationally in the scoring of "TOEFL iBT"® independent and integrated tasks. In this study we explored the psychometric added value of reporting four trait scores for each of these two tasks, beyond the total e-rater score.The four trait scores are word choice, grammatical…

In a common-item (anchor) equating design, the common items should be evaluated for item parameter drift. Drifted items are often removed. For a test that contains mostly dichotomous items and only a small number of polytomous items, removing some drifted polytomous anchor items may result in anchor sets that no longer resemble mini-versions of…

For mixed-type tests composed of dichotomous and polytomous items, polytomous items often yield more information than dichotomous items. To reflect the difference between the two types of items and to improve the precision of ability estimation, an adaptive weighted maximum-a-posteriori (WMAP) estimation is proposed. To evaluate the performance of…

While research has shown the statistical significance of high school grade point averages (HSGPAs) in predicting future academic outcomes, the systems with which HSGPAs are calculated vary drastically across schools. Some schools employ unweighted grades that carry the same point value regardless of the course in which they are earned; other…

Models of cue weighting in judgment have typically focused on how decision-makers weight cues individually. Here, the authors propose that people might recognize and weight "groups" of cues. They examine how judgments change when decision-makers focus on cues individually or as parts of groups. Several experiments demonstrate that people can…

This study uses a national sample of 1,215 children, ages 6-17, who spent some time in formal kinship or nonrelative foster care to identify the effect of placement type on academic achievement, behavior, and health. Several identification strategies are used to reduce selection bias, including ordinary least squares, change score models,…

This study introduces a new set of weighting procedures for revealing the mediation mechanism in multi-level settings. These methods are illustrated through an investigation of whether the impact of a system-wide policy change on student outcomes is mediated by policy-induced peer composition change. When the policy changed not only…

Schools and neighborhoods are thought to be two of the most important contextual influences on student academic outcomes. Drawing on a unique data set that permits simultaneous estimation of neighborhood and school contributions to student test score gains, we analyze the distributions of these contributions to consider the relative importance of…

In this paper, multiple criteria optimization has been investigated. A new decision support system (DSS) has been developed for interactive solving of multiple criteria optimization problems (MOPs). The weighted-sum (WS) approach is implemented to solve the MOPs. The MOPs are solved by selecting different weight coefficient values for the criteria…

Youth practitioners often select life skills as intentionally targeted program outcomes. While research findings suggest the efficacy of program experiences to positively influence a variety of life skills, it remains difficult to compare these findings due to measurement incongruities. Individual life skills (e.g., leadership, decision making,…

A performance-based funding system like the United Kingdom's "Research Excellence Framework" (REF) symbolizes the re-rationalization of higher education according to neoliberal ideology and New Public Management technologies. The REF is also significant for disclosing the kinds of behaviour that characterize universities' response to…

Purpose: The purpose of this paper is to assess the research efficiency of the Chilean higher education institutions (HEIs). As it has been argued in the literature, universities in Chile are far from being considered research-oriented institutions. Current governmental reforms have put pressures on the efficient use of public resources,…

There is currently a considerable diversity of quantitative measures available for summarizing the results in single-case studies. Given that the interpretation of some of them is difficult due to the lack of established benchmarks, the current article proposes an approach for obtaining further numerical evidence on the importance of the results,…

Providing feedback on draft essays is an accepted means of enacting a social-constructivist approach to assessment, aligning with current views on the value of formative feedback and assessment for learning (AFL). However, the use of this process as a means of improving not only content but also students' academic writing skills has not been…

With the rapid advances in computer technology during recent years, researchers have demonstrated the pivotal influences of computer-assisted diagnostic systems on student learning performance improvement. This research aims to develop a Diagnostic and Remedial Learning System (DRLS) for an algebra course in a Thai lower secondary school context…