A method is presented for collecting information about the match between students' learning issues in problem-based learning and teachers' objectives. Subjects were 82 second-year medical students at the University of Limburg in Maastricht (Netherlands) in a problem-based curriculum. During a unit on pregnancy, childbirth, and child development,…

A case is presented for adjusting the scores for free response items in the Advanced Placement (AP) tests. Using information about the rating process from the reliability studies, administrations of the AP test for three subject areas, psychology, computer science, and English language and composition, are analyzed. In the reliability studies, 299…

The relationship between levels of reliability and the power of two bias and differential item functioning (DIF) detection methods is examined. Both methods, the Mantel-Haenszel (MH) procedure of P. W. Holland and D. T. Thayer (1988) and the Simultaneous Item Bias (SIB) procedure of R. Shealy and W. Stout (1991), use examinees' raw scores as a…

Literacy Volunteers of America (LVA) affiliates were surveyed regarding standardized and informal assessment devices they currently used and their frequency of use and effectiveness. A literature review focused on assessment tools and their limitations. The survey was sent to 39 LVA affiliates in Illinois, Indiana, Michigan, Missouri, Ohio, and…

At Golden College (California), student writing samples are holistically scored by pairs of judges on a six-point scale. Judges are allowed to use plus and minus figures, thus converting the integer scale to a decimal scale of evaluation. In 1991, 499 writing samples written as part of the placement testing process for students in the Coast…

The Quest program offers a comprehensive test and questionnaire analysis environment by providing a data analyst (a computer program) with access to the most recent developments in Rasch measurement theory, as well as a range of traditional analysis procedures. This manual helps the user use Quest to construct and validate variables based on…

Although mastery motivation appears to predict school success, individual assessment of mastery motivation is too time consuming and limits the application of this research. This study examined the psychometric properties of the Dimensions of Mastery Questionnaire (DMQ). The study focused on the validity of the measure for Head Start parents,…

The nine-volume Survey Kit is designed to help readers prepare and conduct surveys and become better users of survey results. All the books in the series contain instructional objectives, exercises and answers, examples of surveys in use, illustrations of survey questions, guidelines for action, checklists of "dos and don'ts," and…

The nine-volume Survey Kit is designed to help readers prepare and conduct surveys and become better users of survey results. All the books in the series contain instructional objectives, exercises and answers, examples of surveys in use, illustrations of survey questions, guidelines for action, checklists of "dos and don'ts," and…

Generalizability theory (g-theory) was used, as an alternative to classical test theory, to evaluate measurement error in a behaviorally anchored role-play measure, highlighting the usefulness of this theory in instrument development. G-theory partitions an observed score into the universe score and error scores associated with separate sources of…

This 1-year project identified several goals to increase the awareness of chemical abuse among older women, older adults, and disabled people. The goals included: develop an assessment instrument; identify chemical health service providers; develop a process to coordinate outreach and case-finding; develop a guide for chemical health service…

This letter is an interim response to the October 7, 1991 request from the Committee on Education and Labor and the Subcommittee on Elementary, Secondary, and Vocational Education of the House of Representatives asking for a review of the National Assessment Governing Board (NAGB) achievement levels for the National Assessment of Educational…

This study investigates the Computer Attitude Scale (CAS) in terms of reliability, factorial validity, and fit to a unidimensional model. The sample for this study consisted of 265 teachers from 20 schools and school districts in one state who attended evening and weekend classes that emphasized teachers teaching teachers about classroom…

This report describes the development, construction, and validation of the Preliminary Chinese Proficiency Test (Pre-CPT), a standardized, nationally-normed test of listening and reading comprehension for beginning-level native English-speaking learners of Chinese as a second language. The Pre-CPT was designed as a lower-level version of the…

Understanding the behavior of those evaluating a speech is important for a complete understanding of the public communication process. Ratings of public speaking were submitted to a Rasch analysis to determine whether objective measurement can create and maintain a standard of speech evaluation. Data used were 1,022 ratings of 168 speeches given…