With today's technology, Extension professionals have a variety of tools available for program evaluation. This article describes an innovative platform called VoiceThread that has been used in many classrooms but also is useful for conducting virtual focus group research. I explain how this tool can be used to collect qualitative participant…

This is the first book to gather and address what we have learned about the impacts and challenges of data-intensive teacher evaluation systems--a defining characteristic of the current education policy landscape. Expert researchers and practitioners speak to what we know (and what remains to be known) about evaluation measures themselves, the…

Since Topping published his literature review on peer assessment in 1998, the number of studies on this subject has doubled, if not tripled. However, along with this expansion, the diversity of peer assessment applications increased equally fast. Based on recent literature, this contribution focuses specifically on the diversity that has come to…

As bibliometric indicators are objective, reliable, and cost-effective measures of peer-reviewed research outputs, they are expected to play an increasingly important role in research assessment/management. Recently, a bibliometric approach was developed and integrated within the evaluation framework of research funded by the National Cancer…

Background: The relation between academic self-concept and achievement has been examined in a large number of studies. The majority of these studies have found evidence for a reciprocal effects model. However, there is an ongoing debate on how students' achievement should be measured and whether the type of achievement indicator (grades, tests,…

Recent work has shown that multidimensionally scoring responses from different tests can provide better ability estimates. For educational assessment data, applications of this approach have been limited to binary scores. Of the different variants, the de la Torre and Patz model is considered more general because implementing the scoring procedure…

Early identification of social-emotional behavioral problems in infants and preschoolers is critical. Nine parent-report and caregiver/teacher-report instruments measuring preschool social-emotional behavioral problems and strengths are reviewed. Advantages to the use of parent-report and caregiver/teacher-report instruments are that they are easy…

Value-added models help to evaluate the knowledge that school districts, schools, and teachers add to student learning as students progress through school. In this article, the well-known Education Value-Added Assessment System (EVAAS) is examined. The author presents a practical investigation of the methodological issues associated with the…

The derivation of a general retrieval effectiveness measure is investigated. Inconsistencies in the definition of relative importance are resolved, and it is shown that the influence of the assigned weight on the effectiveness measure can produce counterintuitive results. An alternative effectiveness measure provided by the Marczewski-Steinhaus…

Numerous studies have shown increasing item reliabilities as an effect of the item position in personality scales. Traditionally, these context effects are analyzed based on item-total correlations. This approach neglects that trends in item reliabilities can be caused either by an increase in true score variance or by a decrease in error…

Three groups of judges (n=18) differing in stuttering judgment experience identified stuttering events in repeated speech samples, to investigate a measurement methodology based on time-interval analyses. Results showed interjudge agreement was affected by the particular speech sample, the judges' previous experience, and the length of the…

A new method to calculate a spectral harmonics-to-noise (HNR) ratio is presented. The method discriminates between harmonic and noise energy in the magnitude spectrum by means of a comb-filtering operation in the cepstrum domain. HNR is seen to be a useful parameter in the analysis of voice quality. (Author/DB)

This replication study of time-interval judgments of stuttering found higher interjudge agreement than previously reported for event-based analyses of stuttering judgments or time-interval analyses of event judgments. Judges with high intrajudge agreement levels also showed higher interjudge agreement levels than did judges with low intrajudge…

A scaling procedure has been developed for ordering binary parallelogram preference data. The procedure uses minimum variance of the item ranks averaged across persons as the optimization criterion. Two seriation strategies are employed. One is pairwise interchange. The second joins together the vector end points and breaks this circle between…

Sixty-one examiners provided a rating of whether a significant change in performance of handicapped individuals occurred across the baseline and treatment phases of six graphs of hypothetical data from single-subject designs. Results revealed considerable interrater disagreement on four graphs, especially those involving change in variability or…