In 2017, the Office of Planning, Research, and Evaluation (OPRE) in the Administration for Children and Families (ACF) funded Mathematica to conduct the Infant and Toddler Teacher and Caregiver Competencies (ITTCC) project. The project aims to examine existing efforts across states, institutions of higher education, professional organizations, and…

Current methods for obtaining reliability indices for mastery tests can be laborious. This paper offers practitioners tables from which agreement and kappa coefficients can be read directly and provides criterion for acceptable values of agreement and kappa coefficients. (TJH)

This manual describes development and use of the revised "Scales for Rating the Behavioral Characteristics of Superior Students" (SRBCSS-R), a teacher judgment instrument appropriate for use as one measure in the identification of gifted students. Part 1 explains the judgmental and empirical procedures used to revise the items on the original…

The performance of foreign medical school graduates on multistation standardized patient-based tests was used to determine the validity and generalizability of global ratings of their clinical competence made by expert examiners. Results suggest that these ratings can be used as an effective form of assessment in this context. (Author/MSE)

Examines reasons for using essay tests in the direct assessment of writing ability. Reviews the steps in developing a large-scale testing program; e.g., creating a pool of topics or prompts; developing scoring procedures; training raters; field-testing the system; scoring writing samples; assessing reliability; and assessing validity. (DMM)

This study explored whether standard administration and scoring of conventional articulation tests accurately identified 20 children (ages 5-9) as phonologically disordered and whether test data established severity levels and programing needs. Tests correctly identified the phonological disorders but failed to reliably differentiate severity…

Extensive research efforts in the past decade have measured academic proficiency and progress in both theory and practice of large-scale writing assessment. The following major situational variables were identified in these investigations: (1) topic variables such as writing prompts, subject matter, mode of discourse, length, and rhetorical…

This manual summarizes technical information regarding the 1982 Stanford Achievement Test, Seventh Edition when administered to hearing-impaired students. In Section 1, the procedures used to select the norming sample (7,557 hearing-impaired students) are described, and the demographic characteristics of the resulting sample are compared to those…

The evaluation tools written by teachers are rarely valid or reliable. One teaching aid that can help in the creation of an effective evaluation instrument is called a test map. A test map is a systematic method to consider variables that are important in the construction of the format of a test. Five variables that are discussed in the test…

Investigates differences in marking standard and reliability when experienced teachers carried out assessments of the performance on practical exercises. The results showed that there was no difference between the assessments from the groups containing 5 and 20 students. (Author/YP)

This collection contains four papers that were presented as part of a short course delivered at the 1991 annual meeting of the Speech Communication Association. The papers discuss various aspects of the development and use of "The Competent Speaker," a public speaking assessment instrument designed for the college sophomore level. The papers and…

The Ohio Vocational Achievement Tests are specially designed instruments for use by teachers, supervisors, and administrators to evaluate and diagnose vocational achievement for improving instruction in secondary vocational programs at the 11th and 12th grade levels. This guide explains the Ohio Vocational Achievement Tests and how they are used.…

The School Subjects Attitude Scales is an instrument for measuring students' attitudes toward school subjects for grades 5-12. Twenty-four bipolar word pairs are used with evaluation, usefulness, and difficulty scales. The word pairs were selected on the basis of discussions and analysis of trial forms. Results can be used in program evaluation…

It has been repeatedly demonstrated that persons who experience a high degree of test anxiety also experience decrements in performance in evaluative situations. A study was conducted to develop a test anxiety questionnaire for student nurses in order to identify test anxiety. A 40-item, self-report questionaire was developed by two panels of…

Intended for administrators and policymakers as well as teachers, this digest explores methods of listening and speaking skills assessment. The digest first provides a rationale for teaching and assessing listening and speaking skills. It then examines definitions of oral communication and listening, noting (1) the trend toward defining oral…