The use of multi-category scales is increasing for the monitoring of IEP goals, classroom and school rules, and Behavior Improvement Plans (BIPs). Although they require greater inference than traditional data counting, little is known about the inter-rater reliability of these scales. This simulation study examined the performance of nine…

This article reports analyses of the verdicts of various film organizations that annually present awards to motion pictures and investigates whether they award/nominate the same movies in a given year. This research disputes previous findings that reported a high level of agreement between those juries, by the means of reliability analysis and the…

The study of capital juries remains a subject of critical interest for the public and for legislative and judicial policy makers as well as legal scholars and social scientists. Cowan, Thompson, and Ellsworth established one of the standard methodologies for examination of this topic in their 1984 seminal study by observing the subjects' debate…

Purpose: The purpose of this study was to determine the extent to which vowel metrics are capable of distinguishing healthy from dysarthric speech and among different forms of dysarthria. Method: A variety of vowel metrics were derived from spectral and temporal measurements of vowel tokens embedded in phrases produced by 45 speakers with…

As a global measure of precision, item response theory (IRT) estimated reliability is derived for four coefficients (Cronbach's a, Feldt-Raju, stratified a, and marginal reliability). Models with different underlying assumptions concerning test-part similarity are discussed. A detailed computational example is presented for the targeted…

Purpose: This study examined the test-retest stability of select word-retrieval measures in the discourses of people with aphasia who completed a 5-stimulus discourse task. Method: Discourse samples across 3 sessions from 12 individuals with aphasia were analyzed for the stability of measures of informativeness, efficiency, main concepts, noun and…

Social media are ubiquitous and used by millions of people every day. Existing research on social media is primarily descriptive, survey based, and focused on who is using social media and how people and organizations are using the tools. Although many organizations have shown interest in using social media, they often demonstrate uncertainty…

The Sustainable Development Goals mandate that by 2030, all children should have access to quality early child development opportunities, healthcare and pre-primary education. Yet validated measures of ECD in low and middle income countries (LMICs) are rare. To address this gap, a Systematic Review (SR) of measures available to profile the…

This meta-analysis reviewed research between 2012 and 2018 focused on technology-assisted second language (L2) vocabulary learning for English as a foreign language (EFL) learner. A total of 45 studies of 2,374 preschool-to-college EFL students contributed effect sizes to this meta-analysis. Compared with traditional instructional methods, the…

Rigorous evaluation of social and emotional learning programs requires the use of measures that provide reliable and valid information on the meaningful differences in children's social emotional skills across treatment and control groups, as well as changes over time. In contexts affected by conflict and crisis, few measures can provide the…

Background: Conceptual understanding is a prerequisite for engineering competence. Concept maps may be effective tools for assessing conceptual knowledge, yet further work is needed to examine scoring methods. Purpose: Our purpose was to evaluate the efficacy of three concept map scoring methods. Traditional scoring requires judges to count…

Schools are social organizations where children came together from different cultures. Creating sense of community is important for schools for the formation of social culture. In schools where sense of community is formed, it is observed that students treat each other with respect, are caring and sharing and have high academic success, and rates…

We assess the consistency of measures of individual local ecological knowledge obtained through peer evaluation against three standard measures: identification tasks, structured questionnaires, and self-reported skills questionnaires. We collected ethnographic information among the Baka (Congo), the Punan (Borneo), and the Tsimane' (Amazon) to…

Purpose: The goal of this study is to explore the psychometric properties of the Parent Rating Scales-V1 (S. K. Millard, S. Edwards, & F. M. Cook, 2009), an assessment tool for parents of children who stutter, and to refine the measure accordingly. Method: We included 259 scales completed prior to therapy. An exploratory factor analysis…

Student attitudes toward mathematics play an important role in the teaching and learning processes of mathematics as positive attitudes correlate with higher student achievement. This paper aims to develop and explore the validity of a Chinese version of the short attitudes toward mathematics inventory (short ATMI) for Taiwanese undergraduates,…