In 2017, the Office of Planning, Research, and Evaluation (OPRE) in the Administration for Children and Families (ACF) funded Mathematica to conduct the Infant and Toddler Teacher and Caregiver Competencies (ITTCC) project. The project aims to examine existing efforts across states, institutions of higher education, professional organizations, and…

In spite of new methodologies in foreign language instruction, much testing is still of the traditional type. Paper and pencil tests are given, testing in exactly the same way the teachers themselves were tested. This article suggests 25 points for language teachers on all levels. (Author/PJM)

In foreign language testing, as in all testing, validity is the primary criterion for test quality. However plausible the concept of validity, in practice it is not always easy to arrive at congruence between the test situation and the real-life situation the learner is expected to master. Some language educators make authenticity a major…

Describes an attempt to construct an ESL dictation test that would: (1) be appropriate for a wide range of ability, (2) be easy and fast to score, (3) consist of set items that would form both a unidimensional and cumulative scale, and (4) yield scores that would be directly interpretable with respect to specified levels of English proficiency.…

This manual describes development and use of the revised "Scales for Rating the Behavioral Characteristics of Superior Students" (SRBCSS-R), a teacher judgment instrument appropriate for use as one measure in the identification of gifted students. Part 1 explains the judgmental and empirical procedures used to revise the items on the original…

The performance of foreign medical school graduates on multistation standardized patient-based tests was used to determine the validity and generalizability of global ratings of their clinical competence made by expert examiners. Results suggest that these ratings can be used as an effective form of assessment in this context. (Author/MSE)

This paper deals with six sets of concerns and suggestions that arise as attitudes toward urban teaching are assessed. The first set arises from the complexity of measuring attitudes. It is strongly recommended that critiques of attitude data be based on plausible rival hypotheses. The second set involves the identification of beliefs related to a…

A school system's testing program can be used as a tool in curriculum development and instructional improvement if the tests match the goals and objectives of the instructional program and what is taught in the classroom. Test-taking skills should be taught so that the test will accurately reflect certain knowledge. Test results should be an…

Examines reasons for using essay tests in the direct assessment of writing ability. Reviews the steps in developing a large-scale testing program; e.g., creating a pool of topics or prompts; developing scoring procedures; training raters; field-testing the system; scoring writing samples; assessing reliability; and assessing validity. (DMM)

Presents a comparative analysis of the psychometric properties of three group tests of logical thinking used in science education research. Findings dealing with Longeot's Test of Logical Thinking, Lawson's Test of Formal Reasoning, and Tobin and Capie's Test of Logical Thinking demonstrate a lack of concurrent validity. Includes recommendations.…

Reviews procedures followed in developing a set of science items for Chemistry, Physics, Biology, Geology content areas and examines the items' construct validity in relation to a specific technique of evaluation. Analysis supported the items' construct validity and viability for testing certain science skills at the secondary level. (ML)

Suggested are ways to improve the SAT and its face validity. Suggestions include greater emphasis on more-realistic problems, inclusion of realistic percent problems, modification of the multiple-choice format, and the use of the National Council of Mathematics "Curriculum and Evaluation Standards" as a guide to construct the test. (MDH)

This study explored whether standard administration and scoring of conventional articulation tests accurately identified 20 children (ages 5-9) as phonologically disordered and whether test data established severity levels and programing needs. Tests correctly identified the phonological disorders but failed to reliably differentiate severity…

This manual summarizes technical information regarding the 1982 Stanford Achievement Test, Seventh Edition when administered to hearing-impaired students. In Section 1, the procedures used to select the norming sample (7,557 hearing-impaired students) are described, and the demographic characteristics of the resulting sample are compared to those…

The evaluation tools written by teachers are rarely valid or reliable. One teaching aid that can help in the creation of an effective evaluation instrument is called a test map. A test map is a systematic method to consider variables that are important in the construction of the format of a test. Five variables that are discussed in the test…