The authors evaluated the extent to which interobserver agreement (IOA) scores, using the block-by-block method for events scored with continuous duration recording (CDR), were higher when the data from the same sessions were converted to discontinuous methods. Sessions with IOA scores of 89% or less with CDR were rescored using 10-s partial…

The Autism Mental Status Examination (AMSE) described here is an eight-item observational assessment that prompts the observation and recording of signs and symptoms of autism spectrum disorders (ASD). The AMSE is intended to take place seamlessly in the context of a clinical exam and produces a total score. Subjects were independently…

Objective: To evaluate reliability and validity of a new tool for assessing the placement and promotional environment in grocery stores. Methods: Trained observers used the "GroPromo" instrument in 40 stores to code the placement of 7 products in 9 locations within a store, along with other promotional characteristics. To test construct validity,…

The purpose of this study was to determine whether: (a) inexperienced listeners can reliably judge listener effort and (b) whether listener effort provides unique information beyond speech intelligibility or acceptability in tracheoesophageal speech. Twenty inexperienced listeners made judgments of speech acceptability and amount of effort…

This article describes two separate, related studies that provide insight into the effectiveness of "e-rater" score calibration methods based on different distributional targets. In the first study, we developed and evaluated a new type of "e-rater" scoring model that was cost-effective and applicable under conditions of absent human rating and…

Letters of reference are commonly used in acquiring a job in education. Despite serious issues of validity and reliability in writing and evaluating letters, there is a dearth of research that systematically examines the evaluation process and defines the constructs that define high quality letters. The current study used NVivo to examine 160…

Assuming item parameters on a test are known constants, the reliability coefficient for item response theory (IRT) ability estimates is defined for a population of examinees in two different ways: as (a) the product-moment correlation between ability estimates on two parallel forms of a test and (b) the squared correlation between the true…

Purpose: The purpose of this study is to explain critical factors affecting student satisfaction levels in selected state universities in Sri Lanka. Design/methodology/approach: The study has applied an quantitative survey design guided by six hypotheses. A conceptual framework has been developed to address the research questions on the basis of a…

The increasing number of educational services has caused a high competition in this industry. In Indonesia, the number of private universities is the highest compared to state universities and other forms of higher education institutions. Ability to predict factors that are important in providing educational services to achieve student…

An increased enthusiasm on teacher accountability, in recent times, has led policy makers and teachers to a significant care over evaluating teachers' success. To this aim, a 40-item Teacher Success questionnaire was developed and validated by the application of the Rasch model. The Rasch model is used to decide whether the scores of an instrument…

Despite all the progress that has been made in research on language learning strategies since the publication of Rubin's (1975) seminal paper on good language learners, there are areas that have been neglected by strategy experts. Perhaps the most blatant manifestation of this neglect is the paucity of research into grammar learning strategies…

This study describes the development and evaluation of a new measure, the Teacher Responses to Anxiety in Children (TRAC) questionnaire in 74 primary school teachers. TRAC presents 9 hypothetical scenarios in which a child displays generalized anxiety/worry, social anxiety or separation anxiety symptoms. Teachers rate each scenario on six…

Expressing sexuality is part of the human experience, yet sexual health is often ignored in regard to persons with disabilities. Individuals with disabilities are at risk of sexual abuse and exploitation, unwanted pregnancies, and sexually transmitted diseases. Additionally, many adolescents with disabilities lack the knowledge needed to develop a…

Parent empowerment involves the ability of caregivers to meet the needs of their family while maintaining feelings of control and is particularly important for families of children at-risk. It is necessary to establish reliable and valid tools to measure parent empowerment. The purpose of this study was to examine the internal factor structure,…

Ratings are present in many areas of assessment including peer review of research proposals and journal articles, teacher observations, university admissions and selection of new hires. One feature present in any rating process with multiple raters is that different raters often assign different scores to the same assessee, with the potential for…