Descriptor
| Judges | 9 |
| Testing Programs | 9 |
| State Programs | 6 |
| Cutting Scores | 3 |
| Educational Assessment | 3 |
| Evaluation Methods | 3 |
| Interrater Reliability | 3 |
| Mathematics Tests | 3 |
| Scoring | 3 |
| Writing Evaluation | 3 |
| Academic Standards | 2 |
| More ▼ | |
Author
Publication Type
| Reports - Descriptive | 4 |
| Journal Articles | 3 |
| Numerical/Quantitative Data | 3 |
| Reports - Evaluative | 3 |
| Speeches/Meeting Papers | 3 |
| Reports - Research | 2 |
Education Level
Audience
| Researchers | 1 |
Laws, Policies, & Programs
Assessments and Surveys
| Delaware Student Testing… | 2 |
| National Assessment of… | 2 |
What Works Clearinghouse Rating
Peer reviewedBoileau, Don M.; And Others – Communication Education, 1981
Describes a program to certify state and district judges of high school debate tournaments. Covers constructing the written test, evaluating the ballot test, implementing certification, and assessing the program. (PD)
Descriptors: Accountability, Certification, Debate, Evaluation Methods
Peer reviewedEngelhard, George, Jr.; Anderson, David W. – Applied Measurement in Education, 1998
A new approach for examining the quality of judgments from standard-setting judges using a Binomial Trials Model (BTM) is presented and illustrated with 26 judges from the Georgia High School Graduation Test. Results suggest that the BTM provides information not available from other methods. (SLD)
Descriptors: Graduation Requirements, High Schools, Judges, Standard Setting (Scoring)
Download full textDelaware State Dept. of Education, Dover. Assessment and Accountability Branch. – 2002
This document contains the results of a standard setting conducted in January 2002 on the Delaware Student Testing Program (DSTP) Science and Social Studies tests at grades 4 and 6. Each standard setting process entailed convening four groups, one for each grade level and content area, and each group met for 2 days. At the standard setting judges…
Descriptors: Academic Achievement, Academic Standards, Cutting Scores, Judges
Peer reviewedPage, Ellis Batten – Journal of Experimental Education, 1994
National Assessment of Educational Progress writing sample essays from 1988 and 1990 (495 and 599 essays) were subjected to computerized grading and human ratings. Cross-validation suggests that computer scoring is superior to a two-judge panel, a finding encouraging for large programs of essay evaluation. (SLD)
Descriptors: Computer Assisted Testing, Computer Software, Essays, Evaluation Methods
Sanford, Eleanor E.; Fabrizio, Louis M. – 1999
The North Carolina End-of-Grade (NCEOG) Test of Mathematics, Grade 8 was compared to the National Assessment of Educational Progress (NAEP)--Grade 8 along three dimensions: technical, content, and cognitive. An expert panel of six judges (mathematics educators) examined the supporting documents, the content frameworks, the items, and actual test…
Descriptors: Comparative Analysis, Educational Assessment, Grade 8, Judges
Delaware State Dept. of Education, Dover. Assessment and Accountability Branch. – 1999
This document contains the results of a standard setting conducted between August 2 and August 12, 1999, on the Delaware Student Testing Program (DSTP) Mathematics, Reading, and Writing subtests at grades 3, 5, 8, and 10. At the standard setting, judges were asked to recommend only the cut point between "Below the Standard" and…
Descriptors: Achievement Tests, Cutting Scores, Elementary Secondary Education, Judges
Braungart-Bloom, Diane S. – 1986
The research described in this paper examines the relationship between raters and the training raters receive to apply that rating. The primary concern is maintaining scoring consistency within the context of raters' perceptions. If the criteria for holistic and/or analytic scoring can be recognized as communication based, rather than topic based,…
Descriptors: High Schools, Holistic Evaluation, Interrater Reliability, Judges
Gearhart, Maryl; Novak, John R.; Herman, Joan L. – 1994
Technical questions regarding the reliability and validity of large-scale portfolio assessment were studied which focused on: (1) whether raters can score collections of writing reliably with rubrics designed for single samples; (2) whether ratings derived from different frameworks differ in their capacities to support technically sound…
Descriptors: Educational Assessment, Elementary Education, Elementary School Students, Essay Tests
Kahl, Stuart R.; And Others – 1995
The assessment instruments of the Maine Educational Assessment emphasize extended constructed-response questions. The results from these assessments are reported in terms of percentages of students at four performance levels. The Student-Based Constructed-Response Method was used to establish performance standards for these levels on the…
Descriptors: Academic Standards, Achievement Tests, Constructed Response, Cutting Scores
