Minimum Competency Assessment (MCA) is the latest assessment conducted nationally in Indonesia. MCA measures students' cognitive in literacy and numeracy. This study illustrates the difficulty of students in solving numeracy questions in the minimum competency assessment. This research is included in case study research with a qualitative…

Teachers who can adapt and be ready for all changes will also be able to provide a balance to increase the competence of vocational high school students. This is also not denied when teachers become assessors in student competency tests. The objectives of this study were to produce an instrument for the readiness of teachers as assessors; to…

The authors investigated whether some advantages of tutoring over other instructional methods are due to microadaptation, or, tutors basing their actions on assessments of tutees they develop during tutoring. In a 2 × 2 between-subjects experiment, independent variables were shared experience (tutors either worked with the same or a different…

Psychometric issues arising from the use of minimum competency tests in local option states were examined in seven school districts. The effect of variability in reliability and difficulty level of subtests on the accuracy of decisions based on such tests is questioned, particularly as they affect mildly handicapped and marginal students.…

Setting standards for the purpose of certification is frequently performed using judgmental techniques such as the Angoff method. This study was performed to identify types of items that judges find hard to rate accurately, that is, types of items on which examinees perform differently than predicted by the judges. Once identified these item types…

An investigation of the effect on the difficulty value of an item due to position placement within a test was made. Using a 60-item operational test comprised of 5 subtests, 60 items were placed as experimental items on a number of spiralled test forms in three different positions (first, middle, last) within the subtest composed of like items.…

To replace traditional methods of minimum competency testing in personnel selection, a two stage cutting score procedure is proposed. The Angoff procedure is modified so that only a subset of test items, which assess essential job related skills, are used to determine the cutting score and to identify qualifed applicants. As a measure of item…

One of the most prevalent and controversial accommodations for students with disabilities is an audio presentation of written test material, the "read-aloud" accommodation. This study used test administration data from the Missouri Assessment Program to examine effects of using the read-aloud accommodation on the characteristics of…

The influence of judges' knowledge on standard setting for competency tests was studied with 17 judges who took an economics teacher certification test while setting competency standards using the Angoff procedure. Judges tended to set higher standards for items they answered correctly and lower standards for items they answered incorrectly. (SLD)

An approach is presented to the definition of minimal competence for judges to use in standard setting. Panelists in standard setting must receive training to ensure that differences in rating result from differences in perceptions of item difficulty, not in differences of opinion about the definition of minimal competence. (SLD)

Training judges to generate item ratings in standard setting once the reference group has been defined is discussed. It is proposed that sensitivity to the factors that determine difficulty can be improved through training. Three criteria for determining when training is sufficient are offered. (SLD)

Studies of the Angoff method of standard setting suggest that judges agree in their estimates of the relative difficulties of test questions for minimally competent examinees and that each judge's estimates correlate well with the observed item difficulties for examinees whose total test scores are near the judge's personal standard (G. E.…

The effects of feedback about the ratings of other judges on subsequent ratings using the Nedelsky method and the ability of judges to retain or eliminate options in a manner consistent with the judgments of minimally competent examinees were studied using data from a basic algebra examination administered to 227 college students in 1987. The…

The effect of increased writing or planning time on a test of basic college level writing ability was studied. The essay portion of the New Jersey College Basic Skills Placement Test was given to students in nine New Jersey public colleges and three New Jersey public high schools. Each student wrote two essays on two different topics. The first…

The New York State Preliminary Competency Test in Reading is designed to measure a student's ability to understand written material of varying levels of difficulty. Results are used to evaluate a student's current level of achievement in reading and to indicate the extent of compensatory or remedial help which may be necessary to pass the final…