In 2017, the Office of Planning, Research, and Evaluation (OPRE) in the Administration for Children and Families (ACF) funded Mathematica to conduct the Infant and Toddler Teacher and Caregiver Competencies (ITTCC) project. The project aims to examine existing efforts across states, institutions of higher education, professional organizations, and…

School accountability is subject to considerable scrutiny. It generates sharp political debate, policy challenges, and continuous discussion. Growth models are now a part of that discussion. To many practitioners the sheer volume of "important to know" information is daunting. The members of the Technical Issues in Large Scale Assessment…

Current methods for obtaining reliability indices for mastery tests can be laborious. This paper offers practitioners tables from which agreement and kappa coefficients can be read directly and provides criterion for acceptable values of agreement and kappa coefficients. (TJH)

This book is a guide to categorizing, measuring, testing, and assessing aspects of language, and is intended for language teachers, speech therapists and other language-related practitioners, and researchers, in conjunction with other resources on research methods and statistics. The first part is a discussion of basic terminology and the varied…

This manual describes development and use of the revised "Scales for Rating the Behavioral Characteristics of Superior Students" (SRBCSS-R), a teacher judgment instrument appropriate for use as one measure in the identification of gifted students. Part 1 explains the judgmental and empirical procedures used to revise the items on the original…

The performance of foreign medical school graduates on multistation standardized patient-based tests was used to determine the validity and generalizability of global ratings of their clinical competence made by expert examiners. Results suggest that these ratings can be used as an effective form of assessment in this context. (Author/MSE)

This book offers a descriptive account of the world of the British external examiner: who they are, what they do, how they are appointed, and what problems they face. Findings are based on a questionnaire survey of and personal interviews with examiners. The external examiner is independent of the university awarding the degree and quite…

Examines reasons for using essay tests in the direct assessment of writing ability. Reviews the steps in developing a large-scale testing program; e.g., creating a pool of topics or prompts; developing scoring procedures; training raters; field-testing the system; scoring writing samples; assessing reliability; and assessing validity. (DMM)

This study explored whether standard administration and scoring of conventional articulation tests accurately identified 20 children (ages 5-9) as phonologically disordered and whether test data established severity levels and programing needs. Tests correctly identified the phonological disorders but failed to reliably differentiate severity…

Extensive research efforts in the past decade have measured academic proficiency and progress in both theory and practice of large-scale writing assessment. The following major situational variables were identified in these investigations: (1) topic variables such as writing prompts, subject matter, mode of discourse, length, and rhetorical…

This manual summarizes technical information regarding the 1982 Stanford Achievement Test, Seventh Edition when administered to hearing-impaired students. In Section 1, the procedures used to select the norming sample (7,557 hearing-impaired students) are described, and the demographic characteristics of the resulting sample are compared to those…

The evaluation tools written by teachers are rarely valid or reliable. One teaching aid that can help in the creation of an effective evaluation instrument is called a test map. A test map is a systematic method to consider variables that are important in the construction of the format of a test. Five variables that are discussed in the test…

Investigates differences in marking standard and reliability when experienced teachers carried out assessments of the performance on practical exercises. The results showed that there was no difference between the assessments from the groups containing 5 and 20 students. (Author/YP)

The Center for the Study of Evaluation's (CSE) expository and narrative rating scales have been developed to meet the need for instructionally relevant methods for assessing students' writing competence. Research indicates that large numbers of raters can be trained in the use of these scales and that, during training and independent rating, they…

This collection contains four papers that were presented as part of a short course delivered at the 1991 annual meeting of the Speech Communication Association. The papers discuss various aspects of the development and use of "The Competent Speaker," a public speaking assessment instrument designed for the college sophomore level. The papers and…