Turnover in the teacher workforce imposes significant costs to schools, both in terms of student achievement and the time and expense required to recruit and train new staff. This paper examines the potential for structured ratings of teacher applicants, solicited from their professional references, to inform hiring decisions through the selection…

Research Findings: This study explores the inter-rater reliability of WaKIDS, Washington State's kindergarten entry assessment (KEA). Specifically, we analyze (1) the extent to which teachers' assessments are in agreement with a master code, (2) how often inaccurate assessment decisions lead to misidentification of school readiness, and (3)…

There is growing interest in using measures of teacher applicant quality to improve hiring decisions, but the statistical properties of such measures are not well understood. We use unique data on structured ratings solicited from the references of teacher applicants to explore the dimensionality of measures of teacher applicant quality and the…

This case study discusses an assessment project in which a rubric was used to evaluate information literacy (IL) skills as reflected in undergraduate students' research papers. Subsequent analysis sought relationships between the students' IL skills and their contact with the library through various channels. The project proved far longer and more…

Inter-rater reliability, commonly assessed by intra-class correlation coefficient ICC, is an important index for describing the extent to which there is consistency amongst two or more raters in assigned measures. In organizational research, the data structure is often hierarchical and designs deviate substantially from the ideal of a balanced…

Ratings are present in many areas of assessment including peer review of research proposals and journal articles, teacher observations, university admissions and selection of new hires. One feature present in any rating process with multiple raters is that different raters often assign different scores to the same assessee, with the potential for…

The difficulty in covering chemical engineering concepts using traditional lectures and whiteboard teaching approaches means today's students' learning demands are unfulfilled, so alternate methods are needed. Desktop learning modules (DLMs) are designed to show industrial fluid flow and heat transfer concepts in a standard classroom so students…

As cyberschooling options expand, it is vital that we understand the nuances of these particular learning opportunities. Because little research exists on leaders of K-12 cyberschools, this exploratory case study had two purposes. We first examined how 18 cyberschool leaders in the United States obtained their position. Second, we explored the…

This article relates the efforts of faculty at one community college to define standards for achievement of two SLOs (critical thinking and effective communication) and to gather and analyze evidence of how well students meet those standards. Faculty from 13 disciplines assessed writing samples from 265 students. We found that, in general,…

A standardized protocol for a pediatric heel-rise test was developed and reliability and validity are reported. Fifty-seven children developing typically (CDT) and 34 children with plantar flexion weakness performed three tests: unilateral heel rise, vertical jump, and force measurement using handheld dynamometry. Intraclass correlation…

Human patient simulation (HPS) provides experiential learning opportunities for student nurses and may be used as a supplement or alternative to traditional clinical education. The body of evidence supporting HPS as a teaching strategy is growing. However, challenges associated with measuring student learning and performance in HPS activities…

Purpose: Accurate description of an individual's communication status is critical in both research and practice. Describing the communication status of individuals with severe intellectual and developmental disabilities is difficult because these individuals often communicate with presymbolic means that may not be readily recognized. Our goal was…

The "Personnel Development Program to Improve Services and Results for Children with Disabilities" is authorized under Section 662 of the Individuals with Disabilities Education Act (IDEA) and is known as the Personnel Development Program (PDP). The PDP is administered by the U.S. Department of Education's (ED's) Office of Special…

This study compares mean ratings, inter-rater reliabilities, and the factor structure of items for online and paper student-rating forms from the University of Washington's Instructional Assessment System. (Contains 3 figures and 2 tables.)