Certification is often viewed to promote lifelong professional development. Industry accreditation agencies include standards for the Maintenance of Certification (MOC) that emphasize the measurement or promotion of continued competency throughout an individual's professional career. In 2013, NBCOT partnered with BreakAway Games to create the…

Purpose: Development Agents (DAs) are employed by agricultural departments to provide capacity development for farmers. In this contribution, the adjustment of a competence profile originally developed for the Province of Esfahan [Karbasioun, M., M. Mulder, and H. J. A. Biemans. 2007. "Towards a Job Competency Profile for Agricultural…

Establishing cut scores using the Angoff method requires panelists to evaluate every item on a test and make a probability judgment. This can be time-consuming when there are large numbers of items on the test. Previous research using resampling studies suggest that it is possible to recommend stable Angoff-based cut score estimates using a…

The aim of this study is to develop a scale determining the visual literacy levels of university students. After reviewing the relevant literature a 75 item draft scale was prepared. The scale was applied to 3rd and 4th year students of Education Faculty of Amasya University. Non-functional items have been excluded from the scale as a result of…

A US sample (N = 360) of psychology educators assessed 73 writing skills and competencies with regard to (a) the importance of each and (b) the typical performance of the top half of local psychology majors. An analysis of gap scores yielded results showing that specific skills, such as supporting claims with citations and proofreading ability,…

Background: To improve global health, the workforce capacity of health promotion professionals must be strengthened through the provision of competencies necessary to deliver effective programs. Purpose: This study provides an updated analysis of the validity of the worksite health promotion (WHP) professional competencies developed in 2000 by the…

Using the nationally representative, cohort-based data of the Education Longitudinal Study of 2002 (ELS:02), this study employs multiple regression to examine the effects of exit exams on student achievement and school completion. This study finds that exit exams as a whole do not have substantial effects on student achievement in mathematics,…

Purpose: The purpose of the research was to develop a competency-based performance appraisal resource for evaluating school nutrition (SN) managers and assistants/technicians. Methods: A two-phased process was used to develop the competency-based performance appraisal resource for SN managers and assistants/technicians. In Phase I, draft…

Multiple matrix sampling is applied to a variation of Angoff's standard setting method. Thirty-six experts (internists) and 190 items were divided into five groups, and borderline examinee performance was estimated. There was some variability in the cutting scores produced by the individual groups, but various components were well estimated. (SLD)

Alternative group judgment approaches to setting minimum competency standards were compared. Replication of results was possible for eight different tests (reading and mathematics, across four grade levels). The Kansas Competency Based Tests in reading and mathematics were administered statewide to students in grades two, four, six, and eight.…

This report offers advice on the issues to be considered and the steps to be taken when implementing a high school graduation test. The research was conducted, specifically, to address problems with Mississippi's high school exit test. An external panel, developed by Southeastern Regional Vision for Education (SERVE), reviewed data obtained…

Three studies assessed the psychometric characteristics of the Direct Standard Setting Method (DSSM). The Angoff technique was also used in each study. The DSSM requires judges to consider an examination 10 items at a time and determine the minimum items in that set a candidate should answer correctly to receive the credential. Nine judges set a…

This report presents baseline findings from a 3-year study of state exit exams. The study involved data from all states with current or planned exit exams; case studies of five states; and research review. Researchers examined: why so many states are adopting high school exit exams, impacts of exit exams on students, what the exams are like, and…

An ignored aspect of standard setting, namely the possibility that Angoff or Nedelsky judges specify inconsistent probabilities (e.g., low probabilities for easy items but large probabilities for hard items) is explored. A latent trait method is proposed to estimate such misspecifications, and an index of consistency is defined. (Author/PN)

The sources of variability in the Angoff standard-setting procedure, when applied to the Alabama High School Graduation Examination (AHSGE), were examined. The sources of variability examined are judges, rounds (replications), competencies (items), and interactions among these three sources. After training, the judges were given a statement of a…