The impact school leaders have on student achievement is prominent in the national conversation regarding educational reform. Perhaps, one of the most highly debated topics is how to assess their impact, and recent legislation tasked every state with determining how to evaluate principal effectiveness. Any new or customized evaluation tool…

Purpose: The purpose of this letter is to clarify the psycholinguistic underpinnings of the tense marker total and tense agreement productivity score and to extend the discussion of when composite diversity and productivity measures are best used. Conclusion: We encourage the use of composite diversity and productivity measures when assessing…

The purpose of this article was two-fold (1) provide an overview of the commonly reported and under-reported absolute agreement indices in the kinesiology literature for continuous data; and (2) present examples of these indices for hypothetical data along with recommendations for future use. It is recommended that three types of information be…

A distinction is made between scores as measures of a construct and predictions of a criterion or outcome variable. The interpretation attached to predictions of criteria, such as job performance or college grade point average (GPA), differs from that attached to scores that are measures of a construct, such as reading proficiency or knowledge…

In this study, the equated score results of the kernel equating (KE) method compared with the results of traditional equating methods--equipercentile and linear equating and 9th grade 2009 ÖBBS Form B of Social Sciences and 2009 ÖBBS Form D of Social Sciences was used under an equivalent groups (EG) design. Study sample consists of 16.249 students…

A key part of determining cut-scores when performing Angoff standard setting is utilizing equating methods to place standard-setting ratings onto the scale used to report scores to examinees. This article describes three equating methods that can be employed to place Angoff ratings onto the scale used to report scores to examinees when applying…

As the primary interface between test developers and multiple educational stakeholders, score reports are a critical component to the success (or failure) of any assessment program. The purpose of this review is to document recent research on individual-level score reporting to advance the research and practice of score reporting. We conducted a…

Reliability is a measure of consistency. It is the degree to which student results are the same when they take the same test on different occasions, when different scorers score the same item or task, and when different but equivalent tests are taken at the same time or at different times. Reliability is about making sure that different test forms…

The purpose of this study was to identify perceptions of environmental changes that promote self-directed learning in the workplace by Human Resources Development (HRD) practitioners and to investigate possible differences of the dependent LPA score variables to independent variables of highest level of education achieved, race/ethnicity, age,…

The automatic evaluation of text-based assessment items, such as short answers or essays, is an open and important research challenge. In this paper, we compare several features for the classification of short open-ended responses to questions related to a large first-year health sciences course. These features include a) traditional n-gram…

This research is motivated by the perspective that when empirical studies and assessment frameworks inform each other, assessments can enrich science education and strengthen its connections to modern science. The research proposes a bioenergy competency assessment for science education. It uses an argument-based approach to validation. Multiple…

Charles Spearman and L. L. Thurstone were pioneers in the field of intelligence. They not only developed methods to assess and understand intelligence, but also developed theories about its structure and function. Methodologically, their approaches were not that distinct, but their theories of intelligence were philosophically very different --…

In this research note, the author checks for correlations between different dimensions in an analytic rubric used for scoring discussion performance. Highly correlated dimensions can be cause for concern that the different aspects of performance are not well defined or not adequately observed. The author's analysis showed some weak to moderate…

When students with the capacity to succeed in a 4-year college do not take a college admission test, this represents a potential loss of opportunity for students and colleges alike. However, the costs of testing--both pecuniary and nonpecuniary--may exceed the benefits for students who lack the interest in or qualifications for college attendance.…

Problem Statement: Equating can be defined as a statistical process that allows modifying the differences between test forms with similar content and difficulty so that the scores obtained from these forms can be used interchangeably. In the literature, there are many equating methods, one of which is Kernel equating. Trends in International…