This study examines the development and implementation of a survey-based instrument assessing the effectiveness of a course redesign initiative focused on student centeredness at a large midwestern university in the United States. Given the scope of the reform initiative under investigation in this study, researchers developed an instrument called…

This study reviewed prominent journals within the field of emotional and behavioral disorders to identify direct observation approaches, reported reliability statistics, and key features of direct observation. Selected journals were systematically reviewed for the past 10 years identifying and quantifying specific direct observation systems and…

The aim of this study was to test reliabilities and validations for the Arabic translation of the Early Childhood Environment Rating Scale, Revised (ECERS-R) scale [Harms, T., Clifford, R. M., & Cryer, D. (1998). "Early childhood environment rating scale, revised edition." New York: Teachers College Press]. ECERS-R mean scores were…

This study describes the development of an instrument to investigate the extent to which technology is integrated in science instruction in ways aligned to science reform outlined in standards documents. The instrument was developed by: (a) creating items consistent with the five dimensions identified in science education literature, (b)…

This article reports analyses of the verdicts of various film organizations that annually present awards to motion pictures and investigates whether they award/nominate the same movies in a given year. This research disputes previous findings that reported a high level of agreement between those juries, by the means of reliability analysis and the…

Purpose: The purpose of this study was to determine the extent to which vowel metrics are capable of distinguishing healthy from dysarthric speech and among different forms of dysarthria. Method: A variety of vowel metrics were derived from spectral and temporal measurements of vowel tokens embedded in phrases produced by 45 speakers with…

As a global measure of precision, item response theory (IRT) estimated reliability is derived for four coefficients (Cronbach's a, Feldt-Raju, stratified a, and marginal reliability). Models with different underlying assumptions concerning test-part similarity are discussed. A detailed computational example is presented for the targeted…

Social media are ubiquitous and used by millions of people every day. Existing research on social media is primarily descriptive, survey based, and focused on who is using social media and how people and organizations are using the tools. Although many organizations have shown interest in using social media, they often demonstrate uncertainty…

This meta-analysis reviewed research between 2012 and 2018 focused on technology-assisted second language (L2) vocabulary learning for English as a foreign language (EFL) learner. A total of 45 studies of 2,374 preschool-to-college EFL students contributed effect sizes to this meta-analysis. Compared with traditional instructional methods, the…

Rigorous evaluation of social and emotional learning programs requires the use of measures that provide reliable and valid information on the meaningful differences in children's social emotional skills across treatment and control groups, as well as changes over time. In contexts affected by conflict and crisis, few measures can provide the…

We assess the consistency of measures of individual local ecological knowledge obtained through peer evaluation against three standard measures: identification tasks, structured questionnaires, and self-reported skills questionnaires. We collected ethnographic information among the Baka (Congo), the Punan (Borneo), and the Tsimane' (Amazon) to…

Purpose: The goal of this study is to explore the psychometric properties of the Parent Rating Scales-V1 (S. K. Millard, S. Edwards, & F. M. Cook, 2009), an assessment tool for parents of children who stutter, and to refine the measure accordingly. Method: We included 259 scales completed prior to therapy. An exploratory factor analysis…

Student attitudes toward mathematics play an important role in the teaching and learning processes of mathematics as positive attitudes correlate with higher student achievement. This paper aims to develop and explore the validity of a Chinese version of the short attitudes toward mathematics inventory (short ATMI) for Taiwanese undergraduates,…

As an alternative to rubric scoring, comparative judgment generates essay scores by aggregating decisions about the relative quality of the essays. Comparative judgment eliminates certain scorer biases and potentially reduces training requirements, thereby allowing a large number of judges, including teachers, to participate in essay evaluation.…

Although there is a common understanding of instructional sensitivity, it lacks a common operationalization. Various approaches have been proposed, some focusing on item responses, others on test scores. As approaches often do not produce consistent results, previous research has created the impression that approaches to instructional sensitivity…